PyPI page
Home page
Author:
PanQiWei
License:
Summary:
An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
Latest version:
0.7.1
Required dependencies:
accelerate
|
datasets
|
gekko
|
numpy
|
peft
|
rouge
|
safetensors
|
sentencepiece
|
torch
|
tqdm
|
transformers
Optional dependencies:
parameterized
|
pytest
|
ruff
|
triton
Downloads last day:
1,952
Downloads last week:
20,791
Downloads last month:
93,864