PyPI page
Home page
Author:
None
Summary:
High-performance Rust-based load balancer for VLLM with multiple routing algorithms and prefill-decode disaggregation support
Latest version:
0.1.14
Required dependencies:
aiohttp
|
fastapi
|
orjson
|
requests
|
setproctitle
|
uvicorn
Optional dependencies:
pytest
|
pytest-asyncio
|
pytest-cov
Downloads last day:
324
Downloads last week:
2,706
Downloads last month:
18,140