PyPI page
Home page
Author:
None
License:
MIT License
Copyright (c) 2024 U Lab @UIUC
Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated docume...
Summary:
A unified framework for LLM routing and evaluation.
Latest version:
0.3.1
Required dependencies:
datasets
|
fastapi
|
gradio
|
httpx
|
litellm
|
numpy
|
pandas
|
peft
|
protobuf
|
pydantic
|
pyyaml
|
scikit-learn
|
scipy
|
sentencepiece
|
torch
|
torch-geometric
|
tqdm
|
transformers
|
uvicorn
Optional dependencies:
openai
|
torch
|
vllm
Downloads last day:
20
Downloads last week:
409
Downloads last month:
1,355