PyPI page
Home page
Author:
The kvcached team
Summary:
A KV cache management system that supports on-demand KV cache allocation for LLMs with GPU virtual memory
Latest version:
0.1.6
Required dependencies:
numpy
|
posix-ipc
|
wrapt
Optional dependencies:
pre-commit
|
setuptools
|
wheel
Downloads last day:
48
Downloads last week:
364
Downloads last month:
925
7-day smoothing