PyPI page
Home page
Author:
None
License:
MIT
Summary:
39% faster TTFT, 67% less KV cache, zero config — autotune optimises local LLMs on Ollama, LM Studio, and MLX
Latest version:
1.6.0
Required dependencies:
click
|
fastapi
|
httpx
|
packaging
|
psutil
|
py-cpuinfo
|
pydantic
|
rich
|
uvicorn
Optional dependencies:
fastapi
|
httpx
|
mlx-lm
|
mypy
|
pytest
|
pytest-asyncio
|
pytest-cov
|
ruff
|
scipy
|
types-psutil
Downloads last day:
18
Downloads last week:
85
Downloads last month:
548