PyPI page
Home page
Author:
Zacharie Bhatti
License:
Apache-2.0
Summary:
Benchmark any OpenAI-compatible LLM endpoint. TTFT, inter-token latency, throughput, P50-P99 — in one command.
Latest version:
0.3.0
Required dependencies:
httpx
Optional dependencies:
click
|
rich
Downloads last day:
18
Downloads last week:
59
Downloads last month:
308