PyPI page
Home page
Author:
.: HinchK :.
Summary:
Local-first LLM routing proxy: weigh every prompt, route to the cheapest model that can carry it, tally the savings.
Latest version:
0.4.1
Required dependencies:
fastapi
|
httpx
|
numpy
|
python-dotenv
|
rich
|
uvicorn
Downloads last day:
2
Downloads last week:
6
Downloads last month:
123
7-day smoothing