PyPI page
Home page
Author:
Intel AIPT Team
License:
Apache 2.0
Summary:
Repository of AutoRound: Advanced Weight-Only Quantization Algorithm for LLMs
Latest version:
0.9.2
Required dependencies:
accelerate
|
datasets
|
lm-eval
|
numpy
|
packaging
|
pillow
|
py-cpuinfo
|
sentencepiece
|
threadpoolctl
|
torch
|
tqdm
|
transformers
Optional dependencies:
intel-extension-for-pytorch
|
numba
|
tbb
Downloads last day:
246
Downloads last week:
2,398
Downloads last month:
6,347