PyPI page
Home page
Author:
Chuangtao Chen
Summary:
KV Packet: recomputation-free context-independent KV caching via trainable soft-token header/trailer adapters.
Latest version:
0.1.0
Required dependencies:
pyyaml
|
torch
|
transformers
Optional dependencies:
kvpress
|
mcp
|
starlette
|
uvicorn
Downloads last day:
0
Downloads last week:
12
Downloads last month:
22
7-day smoothing