PyPI page
Home page
Author:
Havencto
License:
MIT
Summary:
A multiplexer for Large Language Model APIs built on the OpenAI SDK. It combines quotas from multiple models and automatically uses fallback models when the primary models are rate limited.
Latest version:
0.2.3
Required dependencies:
openai
|
typing-extensions
Optional dependencies:
black
|
flake8
|
isort
|
mypy
|
pytest
|
pytest-asyncio
|
pytest-mock
Downloads last day:
28
Downloads last week:
218
Downloads last month:
430