PyPI page
Home page
Author:
Shaishav Pidadi
Summary:
Ollama for free cloud inference. Local OpenAI-compatible gateway routing across OpenRouter, Groq, NVIDIA NIM, Cloudflare Workers AI, HuggingFace, Cerebras, and your own Ollama with automatic failover.
Latest version:
0.4.0a25
Required dependencies:
fastapi
|
httpx
|
pydantic
|
uvicorn
Optional dependencies:
openai
|
pytest
|
pytest-asyncio
|
pytest-httpx
|
pytest-timeout
|
ruff
Downloads last day:
12
Downloads last week:
180
Downloads last month:
367
7-day smoothing