PyPI page
Home page
Author:
None
Summary:
Efficient LLM inference on Slurm clusters using vLLM.
Latest version:
0.8.0
Required dependencies:
click
|
pydantic
|
pyyaml
|
requests
|
rich
Optional dependencies:
orjson
|
ray
|
sgl-kernel
|
sglang
|
torchao
|
vllm
Downloads last day:
0
Downloads last week:
47
Downloads last month:
324