PyPI page
Home page
Author:
None
License:
Apache-2.0
Summary:
High-performance Rust-based load balancer for SGLang with multiple routing algorithms and prefill-decode disaggregation support
Latest version:
0.3.2
Required dependencies:
aiohttp
|
fastapi
|
orjson
|
setproctitle
|
uvicorn
Optional dependencies:
pytest
|
requests
Downloads last day:
9,086
Downloads last week:
114,382
Downloads last month:
454,148