PyPI page
Home page
Author:
None
License:
MIT
Summary:
39% faster TTFT, 67% less KV cache, zero config — autotune optimises local LLMs on Ollama, LM Studio, and MLX
Latest version:
1.1.2
Required dependencies:
click
|
fastapi
|
httpx
|
packaging
|
psutil
|
py-cpuinfo
|
pydantic
|
rich
|
uvicorn
Optional dependencies:
fastapi
|
httpx
|
mlx-lm
|
mypy
|
pytest
|
pytest-asyncio
|
pytest-cov
|
ruff
|
scipy
|
types-psutil
Downloads last day:
13
Downloads last week:
1,173
Downloads last month:
2,664