vtune

PyPI page
Summary: Benchmark-driven configuration tuning for vLLM inference servers
Latest version: 0.1.0a10
Required dependencies: optuna | pyyaml
Optional dependencies: guidellm | pytest | vllm

Downloads last day: 0
Downloads last week: 1
Downloads last month: 144
7-day smoothing