PyPI page
Summary:
Benchmark-driven configuration optimization for vLLM inference servers
Latest version:
0.1.0a21
Required dependencies:
optuna
|
pyyaml
Optional dependencies:
build
|
coverage
|
guidellm
|
mypy
|
pip-audit
|
pytest
|
ruff
|
twine
|
types-pyyaml
|
vllm
Downloads last day:
8
Downloads last week:
93
Downloads last month:
651
7-day smoothing