PyPI page
Home page
Author:
Sunay Hegde
Summary:
High-performance, memory-fluid LLM inference engine — Rust speed, Python convenience.
Latest version:
1.3.0
Required dependencies:
semble
Optional dependencies:
mypy
|
pytest
|
ruff
Downloads last day:
3
Downloads last week:
63
Downloads last month:
228
7-day smoothing