PyPI page
Home page
Author:
Nils Persson Suorra
License:
Apache License
Version 2.0, January 2004
http://www.apache.org/licenses/
TERMS AND CONDITIONS FOR USE, REPRODUCTI...
Summary:
Training-free long-context KV compression under fixed VRAM
Latest version:
0.2.0
Required dependencies:
accelerate
|
numpy
|
protobuf
|
psutil
|
safetensors
|
sentencepiece
|
torch
|
tqdm
|
transformers
Optional dependencies:
matplotlib
|
pytest
Downloads last day:
0
Downloads last week:
10
Downloads last month:
35
7-day smoothing