PyPI page
Home page
Author:
None
License:
Apache-2.0
Summary:
Up to 28x KV cache compression for LLMs via spectral SVD projection
Latest version:
1.0.0
Required dependencies:
numpy
|
torch
Optional dependencies:
accelerate
|
bitsandbytes
|
pytest
|
pytest-cov
|
transformers
Downloads last day:
4
Downloads last week:
15
Downloads last month:
43