PyPI page
Home page
Author:
Sunay Hegde
Summary:
High-performance, memory-fluid LLM inference engine — Rust speed, Python convenience.
Latest version:
1.1.5
Required dependencies:
semble
Optional dependencies:
mypy
|
pytest
|
ruff
Downloads last day:
5
Downloads last week:
66
Downloads last month:
213