PyPI page
Home page
Author:
Llamathon contributors
License:
MIT
Summary:
Benchmark the LLM inference capacity of a server (llama-benchy orchestrator with auto-detection, real-workload sizing, charts and reports).
Latest version:
1.0.1
Required dependencies:
llama-benchy
|
matplotlib
Optional dependencies:
llamathon
|
mypy
|
pytest
|
ruff
|
tiktoken
|
tokenizers
|
transformers
Downloads last day:
0
Downloads last week:
5
Downloads last month:
23
7-day smoothing