PyPI page
Author:
Simo Lin
License:
Apache-2.0
Summary:
High-performance Rust-based load balancer for SGLang with multiple routing algorithms and prefill-decode disaggregation support
Latest version:
0.3.2
Required dependencies:
aiohttp
|
fastapi
|
orjson
|
setproctitle
|
uvicorn
Optional dependencies:
pytest
|
requests
Downloads last day:
4,667
Downloads last week:
34,972
Downloads last month:
272,883
7-day smoothing