PyPI page
Home page
Author:
None
License:
MIT License
Copyright (c) 2025-2026 Rajveer Rathod
Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associate...
Summary:
Fast KV cache quantization for Apple Silicon — TurboQuant, RVQ, VecInfer (with Metal kernels), RateQuant, PolarQuant, SpectralQuant, CommVQ, RaBitQ, QJL, KIVI, KIVI-Sink, SVDq, Kitty, AdaKV-proxy, XQuant, KVQuant-NUQ, PALU, CacheGen, MiniCache, GEAR, ZipCache-adapted, SnapKV-adapted, StreamingLLM-adapted, H2O-adapted, TOVA-adapted, PyramidKV-adapted, SqueezeAttention-adapted, ChunkKV-adapted, CaM-adapted, and xKV-adapted in MLX
Latest version:
0.29.0
Required dependencies:
matplotlib
|
mlx
|
numpy
Optional dependencies:
build
|
psutil
|
pytest
|
pytest-xdist
|
scipy
|
twine
Downloads last day:
153
Downloads last week:
1,788
Downloads last month:
2,922