PyPI page
Home page
Author:
Pavel Horak
License:
Apache-2.0
Summary:
Pion prompt cache for mlx-lm on Apple Silicon — reuse a prefix's K/V across processes and restarts
Latest version:
0.1.6
Required dependencies:
numpy
|
redis
Optional dependencies:
mlx
|
mlx-lm
|
pytest
Downloads last day:
7
Downloads last week:
306
Downloads last month:
546
7-day smoothing