PyPI page
Home page
Author:
ModelCloud
Summary:
A LLM quantization package with user-friendly apis. Based on GPTQ algorithm.
Latest version:
1.7.3
Optional dependencies:
auto_round
|
bitblas
|
clearml
|
evalplus
|
fastapi
|
flashinfer
|
intel_extension_for_pytorch
|
isort
|
lm_eval
|
mlx_lm
|
optimum
|
parameterized
|
plotly
|
pydantic
|
pytest
|
random_word
|
ruff
|
sglang
|
triton
|
uvicorn
|
vllm
Downloads last day:
110
Downloads last week:
561
Downloads last month:
2,577