PyPI page
Home page
Author:
Intel AIPT Team
License:
Apache 2.0
Summary:
Repository of AutoRound: Advanced Weight-Only Quantization Algorithm for LLMs
Latest version:
0.16.1
Required dependencies:
accelerate
|
datasets
|
numpy
|
py-cpuinfo
|
pydantic
|
requests
|
torch
|
tqdm
|
transformers
Optional dependencies:
auto-round-lib
|
numba
|
tbb
Downloads last day:
8,260
Downloads last week:
57,644
Downloads last month:
379,390
7-day smoothing