auto-gptq

PyPI page
Home page
Author: PanQiWei
License:
Summary: An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
Latest version: 0.7.1
Required dependencies: accelerate | datasets | gekko | numpy | peft | rouge | safetensors | sentencepiece | torch | tqdm | transformers
Optional dependencies: parameterized | pytest | ruff | triton

Downloads last day: 1,461
Downloads last week: 17,194
Downloads last month: 86,956