PyPI page
Home page
Author:
Mohan Qiao
Summary:
CLI for managing LLM inference on GPU workstations
Latest version:
0.5.0
Required dependencies:
huggingface-hub
|
nvidia-ml-py
|
pyyaml
|
rich
|
simple-term-menu
|
typer
Optional dependencies:
gguf
Downloads last day:
38
Downloads last week:
61
Downloads last month:
565