PyPI page
Home page
Author:
Judotens Budiarto
License:
MIT
Summary:
The streaming inference runtime for open-weight LLMs.
Latest version:
0.1.1
Required dependencies:
numpy
Optional dependencies:
fastapi
|
mypy
|
pybind11
|
pydantic
|
pytest
|
pytest-cov
|
ruff
|
safetensors
|
uvicorn
Downloads last day:
1
Downloads last week:
4
Downloads last month:
18
7-day smoothing