PyPI page
Home page
Author:
Intel AIPT Team
License:
Apache 2.0
Summary:
Repository of AutoRound: Advanced Weight-Only Quantization Algorithm for LLMs
Latest version:
0.12.3
Required dependencies:
accelerate
|
datasets
|
numpy
|
py-cpuinfo
|
pydantic
|
torch
|
tqdm
|
transformers
Optional dependencies:
auto-round-lib
|
numba
|
tbb
Downloads last day:
2,949
Downloads last week:
16,788
Downloads last month:
70,136