PyPI page
Home page
Author:
Goutam Adwant
License:
MIT
Summary:
Production-grade, KV-cache-aware intelligent routing for self-hosted and hybrid LLM fleets.
Latest version:
0.11.2
Required dependencies:
httpx
|
prometheus-client
|
pydantic
|
pyyaml
|
rich
|
typer
Optional dependencies:
build
|
hypothesis
|
mypy
|
numpy
|
pip-audit
|
pre-commit
|
pytest
|
pytest-asyncio
|
pytest-cov
|
respx
|
ruff
|
sentence-transformers
|
starlette
|
twine
|
uvicorn
Downloads last day:
5
Downloads last week:
27
Downloads last month:
131