turboquant-kv

PyPI page
Home page
Author: hackimov
Summary: Open-source implementation of Google TurboQuant for extreme KV-cache compression
Latest version: 1.0.0
Required dependencies: numpy | torch
Optional dependencies: transformers | triton | triton-windows

Downloads last day: 0
Downloads last week: 12
Downloads last month: 24
7-day smoothing