PyPI page
Home page
Author:
ashhadahsan
License:
MIT
Summary:
Intelligent LLM dispatching with performance-based routing, multimodal support, streaming, monitoring, and comprehensive analytics
Latest version:
1.0.0
Required dependencies:
aiohttp
|
alembic
|
annotated-types
|
anthropic
|
anyio
|
asyncio-mqtt
|
bcrypt
|
bert-score
|
cachetools
|
certifi
|
charset-normalizer
|
cryptography
|
datasets
|
distro
|
docstring-parser
|
evaluate
|
google-ai-generativelanguage
|
google-api-core
|
google-api-python-client
|
google-auth
|
google-auth-httplib2
|
google-generativeai
|
googleapis-common-protos
|
grpcio
|
grpcio-status
|
httplib2
|
httpx
|
idna
|
jiter
|
langchain
|
langchain-anthropic
|
langchain-google-genai
|
langchain-openai
|
librosa
|
matplotlib
|
numpy
|
openai
|
pillow
|
plotly
|
proto-plus
|
protobuf
|
pyasn1
|
pyasn1-modules
|
pydantic
|
pydantic-core
|
pydub
|
pyparsing
|
python-dotenv
|
pyyaml
|
ragas
|
redis
|
regex
|
requests
|
rouge-score
|
rsa
|
sacrebleu
|
scikit-learn
|
seaborn
|
sentence-transformers
|
sniffio
|
soundfile
|
sqlalchemy
|
tenacity
|
tiktoken
|
tqdm
|
typing-extensions
|
typing-inspection
|
uritemplate
|
urllib3
Optional dependencies:
accelerate
|
black
|
datasets
|
evaluate
|
flake8
|
ipykernel
|
isort
|
jupyter
|
mkdocs
|
mkdocs-git-revision-date-localized-plugin
|
mkdocs-material
|
mkdocs-minify-plugin
|
mkdocs-social-plugin
|
pre-commit
|
pytest
|
pytest-asyncio
|
pytest-cov
|
torch
|
transformers
Downloads last day:
1
Downloads last week:
54
Downloads last month:
62