PyPI page
Summary:
Lightweight async LLM API proxy with concurrency control, telemetry, and a live dashboard.
Latest version:
0.13.1
Required dependencies:
aiosqlite
|
blacksheep
|
brotli
|
httpcore
|
msgspec
|
uvicorn
Optional dependencies:
aiohttp
|
httpx
|
pytest
|
pytest-asyncio
|
starlette
|
watchfiles
Downloads last day:
18
Downloads last week:
64
Downloads last month:
882
7-day smoothing