PyPI page
Author:
xhedit
License:
MIT License
Summary:
cli tool for downloading and quantizing LLMs
Latest version:
0.29
Required dependencies:
click
|
einops
|
exllamav2
|
hqq
|
huggingface-hub
|
llama-cpp-conv
|
safetensors
|
sentencepiece
|
torch
|
tqdm
|
transformers
Optional dependencies:
auto-gptq
|
autoawq
Downloads last day:
0
Downloads last week:
77
Downloads last month:
55
7-day smoothing