PyPI page
Home page
Author:
Tao Feng
License:
MIT License
Copyright (c) 2024 U Lab @UIUC
Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated d...
Summary:
A unified framework for LLM routing and evaluation.
Latest version:
0.4.0
Required dependencies:
datasets
|
fastapi
|
gradio
|
httpx
|
litellm
|
numpy
|
pandas
|
peft
|
protobuf
|
pydantic
|
pyyaml
|
scikit-learn
|
scipy
|
sentencepiece
|
torch
|
torch-geometric
|
tqdm
|
transformers
|
uvicorn
|
websockets
Optional dependencies:
openai
|
torch
|
vllm
Downloads last day:
12
Downloads last week:
164
Downloads last month:
759
7-day smoothing