PyPI page
Home page
Author:
None
Summary:
Lightweight async LLM API proxy with concurrency control, telemetry, and a live dashboard.
Latest version:
0.8.7
Required dependencies:
aiohttp
|
aiosqlite
|
blacksheep
|
brotli
|
msgspec
|
uvicorn
Optional dependencies:
httpx
|
pytest
|
pytest-asyncio
|
starlette
|
watchfiles
Downloads last day:
308
Downloads last week:
2,903
Downloads last month:
7,447