PyPI page
Home page
Author:
kuhung
Summary:
LLM Inference Benchmark CLI - measure TTFT, TPS, ITL, E2E latency for any OpenAI-compatible API
Latest version:
0.2.0
Required dependencies:
httpx
|
rich
Downloads last day:
1
Downloads last week:
2
Downloads last month:
23
7-day smoothing