PyPI page
Home page
Author:
ModelCloud
Summary:
A LLM quantization package with user-friendly apis. Based on GPTQ algorithm.
Latest version:
1.4.5
Optional dependencies:
auto_round
|
bitblas
|
clearml
|
evalplus
|
flashinfer
|
intel_extension_for_pytorch
|
isort
|
lm_eval
|
optimum
|
parameterized
|
plotly
|
pytest
|
random_word
|
ruff
|
sglang
|
triton
|
vllm
Downloads last day:
38
Downloads last week:
563
Downloads last month:
1,320