PyPI page
Home page
Author:
Zacharie Bhatti
License:
Apache-2.0
Summary:
Benchmark any OpenAI-compatible LLM endpoint. TTFT, inter-token latency, throughput, P50-P99 — in one command.
Latest version:
0.3.0
Required dependencies:
httpx
Optional dependencies:
click
|
rich
Downloads last day:
13
Downloads last week:
35
Downloads last month:
135