PyPI page
Home page
Author:
None
Summary:
Efficient LLM inference on Slurm clusters using vLLM.
Latest version:
0.8.1
Required dependencies:
click
|
pydantic
|
pyyaml
|
requests
|
rich
Optional dependencies:
orjson
|
ray
|
sgl-kernel
|
sglang
|
torchao
|
torchcodec
|
vllm
Downloads last day:
5
Downloads last week:
36
Downloads last month:
394