PyPI page
Home page
Author:
Mohan Qiao
Summary:
CLI for managing LLM inference on GPU workstations
Latest version:
0.6.7
Required dependencies:
huggingface-hub
|
nvidia-ml-py
|
packaging
|
pyyaml
|
rich
|
simple-term-menu
|
typer
Optional dependencies:
gguf
Downloads last day:
47
Downloads last week:
304
Downloads last month:
1,017