PyPI page
Home page
Author:
TurboQuant
License:
MIT
Summary:
Crush any LLM to 6x smaller in one command. GGUF, GPTQ, AWQ.
Latest version:
0.1.0
Required dependencies:
huggingface-hub
|
torch
|
transformers
Optional dependencies:
auto-gptq
|
autoawq
|
datasets
|
llama-cpp-python
Downloads last day:
4
Downloads last week:
9
Downloads last month:
60