PyPI page
Home page
Author:
None
Summary:
A framework for serving and evaluating large language model routers.
Latest version:
0.2.0
Required dependencies:
datasets
|
importlib-metadata
|
litellm
|
numpy
|
openai
|
pandas
|
pydantic
|
pyyaml
|
scikit-learn
|
torch
|
tqdm
|
transformers
Optional dependencies:
black
|
fastapi
|
isort
|
matplotlib
|
pandarallel
|
pre-commit
|
sglang
|
shortuuid
|
tiktoken
|
uvicorn
Downloads last day:
139
Downloads last week:
2,456
Downloads last month:
10,125