PyPI page
Home page
Author:
Sudev Mukherjee, Purusoth Mahendran, Clint Solomon
License:
Apache License
Version 2.0, January 2004
http://www.apache.org/licenses/
TERMS AND CONDITIONS FOR USE, REPRODUCTI...
Summary:
Adaptive LLM cascade engine with semantic caching and reliability tracking
Latest version:
0.1.3
Required dependencies:
cryptography
|
fastapi
|
fastembed
|
httpx
|
litellm
|
llmlingua
|
numpy
|
pydantic
|
pydantic-settings
|
python-dotenv
|
pyyaml
|
redis
|
transformers
|
uvicorn
Optional dependencies:
pytest
|
pytest-asyncio
Downloads last day:
8
Downloads last week:
15
Downloads last month:
427
7-day smoothing