PyPI page
Home page
Author:
PanQiWei
License:
Summary:
An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
Latest version:
0.7.1
Required dependencies:
accelerate
|
datasets
|
gekko
|
numpy
|
peft
|
rouge
|
safetensors
|
sentencepiece
|
torch
|
tqdm
|
transformers
Optional dependencies:
parameterized
|
pytest
|
ruff
|
triton
Downloads last day:
1,763
Downloads last week:
21,509
Downloads last month:
90,403