PyPI page
Home page
Author:
None
License:
Apache License
Version 2.0, January 2004
http://www.apache.org/licenses/
TERMS AND CONDITIONS FOR USE, REPRODUCTI...
Summary:
FADE: Frequency-Adaptive Decay Encoding — attention-aware tiered KV cache compression for LLM inference.
Latest version:
1.1.0
Required dependencies:
numpy
|
torch
|
tqdm
|
transformers
Optional dependencies:
accelerate
|
build
|
datasets
|
fastapi
|
pre-commit
|
pydantic
|
pyright
|
pytest
|
pytest-xdist
|
ruff
|
scikit-learn
|
turboquant-kv
|
uvicorn
Downloads last day:
45
Downloads last week:
125
Downloads last month:
1,188