PyPI page
Home page
Author:
The kvcached team
Summary:
A KV cache management system that supports on-demand KV cache allocation for LLMs with GPU virtual memory
Latest version:
0.1.5
Required dependencies:
numpy
|
posix_ipc
|
wrapt
Optional dependencies:
pre-commit
|
setuptools
|
wheel
Downloads last day:
39
Downloads last week:
231
Downloads last month:
810