PyPI page
Home page
Author:
Simo Lin
Summary:
High-performance Rust-based inference gateway for large-scale LLM deployments
Latest version:
1.13.0.post20261016
Required dependencies:
grpcio
|
grpcio-health-checking
|
pyyaml
|
setproctitle
Optional dependencies:
mypy
|
pytest
|
requests
|
ruff
Downloads last day:
145
Downloads last week:
1,223
Downloads last month:
7,732
7-day smoothing