PyPI page
Home page
Author:
None
License:
Apache-2.0
Summary:
Complexity + VRAM-aware routing for local dual-tier LLM deployments
Latest version:
0.1.1
Required dependencies:
fastapi
|
httpx
|
litellm
|
nvidia-ml-py
|
prometheus-client
|
pyyaml
|
uvicorn
Optional dependencies:
build
|
mypy
|
pytest
|
pytest-asyncio
|
ruff
|
types-pyyaml
Downloads last day:
8
Downloads last week:
53
Downloads last month:
240