PyPI page
Home page
Author:
Imanol Rodriguez
Summary:
INT4/INT8 quantization of language models (GPTQ + AWQ) for modest hardware and Android phones, with GGUF export
Latest version:
0.1.5
Required dependencies:
numpy
|
psutil
|
rich
|
safetensors
|
torch
|
typer
Optional dependencies:
accelerate
|
datasets
|
gguf
|
pytest
|
pytest-cov
|
ruff
|
sentencepiece
|
transformers
Downloads last day:
3
Downloads last week:
28
Downloads last month:
632
7-day smoothing