PyPI page
Home page
Author:
yutoTachibana
License:
MIT
Summary:
Cost-vs-accuracy CI for LLM ops. Pick the cheapest API tier, compare self-hosted vLLM vs cloud APIs on one Pareto, and grade open-ended outputs with an LLM-as-judge scorer — all on your own data with Wilson 95% CIs.
Latest version:
2.2.0
Required dependencies:
click
|
matplotlib
|
numpy
|
pydantic
|
tqdm
Optional dependencies:
anthropic
|
google-genai
|
open-mythos
|
openai
|
pytest
|
pytest-cov
|
ruff
|
streamlit
|
torch
|
transformers
Downloads last day:
0
Downloads last week:
6
Downloads last month:
93