PyPI page
Home page
Author:
Intel AIPT Team
License:
Apache 2.0
Summary:
Repository of AutoRound: Advanced Weight-Only Quantization Algorithm for LLMs
Latest version:
0.4.4
Required dependencies:
accelerate
|
datasets
|
lm-eval
|
numba
|
numpy
|
packaging
|
pillow
|
py-cpuinfo
|
sentencepiece
|
tbb
|
threadpoolctl
|
torch
|
tqdm
|
transformers
Optional dependencies:
auto-gptq
|
intel-extension-for-pytorch
|
intel-extension-for-transformers
Downloads last day:
58
Downloads last week:
368
Downloads last month:
2,614