kvcr

PyPI page
Summary: Framework-neutral KV Cache Runner
Latest version: 0.1.1
Required dependencies: msgspec | nixl | pyzmq

Downloads last day: 81
Downloads last week: 97
Downloads last month: 690
7-day smoothing