PyPI page
Home page
Author:
hackimov
Summary:
Open-source implementation of Google TurboQuant for extreme KV-cache compression
Latest version:
1.0.0
Required dependencies:
numpy
|
torch
|
triton
|
triton-windows
Optional dependencies:
transformers
Downloads last day:
26
Downloads last week:
79
Downloads last month:
302