PyPI page
Home page
Author:
None
License:
MIT License
Summary:
cli tool for downloading and quantizing LLMs
Latest version:
0.29
Required dependencies:
click
|
einops
|
exllamav2
|
hqq
|
huggingface-hub
|
llama-cpp-conv
|
safetensors
|
sentencepiece
|
torch
|
tqdm
|
transformers
Optional dependencies:
auto-gptq
|
autoawq
Downloads last day:
46
Downloads last week:
94
Downloads last month:
209