PyPI page
Home page
Author:
None
License:
MIT License
Summary:
cli tool for downloading and quantizing LLMs
Latest version:
0.29
Required dependencies:
click
|
einops
|
exllamav2
|
hqq
|
huggingface-hub
|
llama-cpp-conv
|
safetensors
|
sentencepiece
|
torch
|
tqdm
|
transformers
Optional dependencies:
auto-gptq
|
autoawq
Downloads last day:
7
Downloads last week:
111
Downloads last month:
268