PyPI page
Summary:
Out-of-tree GGUF quantization plugin for vLLM
Latest version:
0.0.5
Required dependencies:
gguf
|
torch
|
vllm
Optional dependencies:
pre-commit
Downloads last day:
151
Downloads last week:
1,017
Downloads last month:
6,859
7-day smoothing