PyPI page
Home page
Author:
qllm Team
License:
Apache 2.0
Summary:
A general x-bit quantization engine for LLMs,[2-8] bits, awq/gptq/hqq/vptq
Latest version:
0.2.3.1
Required dependencies:
accelerate
|
datasets
|
numpy
|
onnx
|
pandas
|
pyarrow
|
safetensors
|
texttable
|
torch
|
tqdm
|
transformers
|
zstandard
Downloads last day:
61
Downloads last week:
145
Downloads last month:
292