PyPI page
Home page
Author:
Sahil Kadadekar
Summary:
Quantize an LLM and check it still refuses what it should — a GPU-aware quantization CLI with a built-in safety-tax check.
Latest version:
0.1.0
Required dependencies:
accelerate
|
datasets
|
gptqmodel
|
huggingface_hub
|
llmcompressor
|
psutil
|
torch
|
transformers
Optional dependencies:
gguf
|
pytest
Downloads last day:
0
Downloads last week:
6
Downloads last month:
142