PyPI page
Summary:
Out-of-tree bitsandbytes quantization plugin for vLLM
Latest version:
0.0.3
Required dependencies:
bitsandbytes
|
vllm
Downloads last day:
490
Downloads last week:
2,853
Downloads last month:
10,430
7-day smoothing