llm-benchmark-runner

PyPI page
Home page
Author: None
Summary: LLM Inference Benchmark CLI - measure TTFT, TPS, ITL, E2E latency for any OpenAI-compatible API
Latest version: 0.2.0
Required dependencies: httpx | rich

Downloads last day: 6
Downloads last week: 33
Downloads last month: 152