PyPI page
Home page
Author:
Rafal Warzycha
Summary:
Benchmarking and profiling rig for local LLMs on Ollama, Microsoft Foundry Local, and ONNX Runtime GenAI.
Latest version:
0.2.0
Required dependencies:
pyyaml
|
requests
|
rich
Optional dependencies:
benchrig
|
build
|
matplotlib
|
mkdocs
|
mkdocs-material
|
onnxruntime-genai-cuda
|
pytest
|
ruff
|
twine
Downloads last day:
2
Downloads last week:
13
Downloads last month:
234
7-day smoothing