PyPI page
Author:
Vitalii Stepanenko
Summary:
LLM Proxy Server is an OpenAI-compatible http proxy server for inferencing various LLMs capable of working with Google, Anthropic, OpenAI APIs, local PyTorch inference, etc.
Latest version:
3.3.2
Required dependencies:
ai-microcore
|
fastapi
|
pydantic
|
requests
|
typer
|
uvicorn
|
websockets
Optional dependencies:
anthropic
|
google-genai
|
pytest
|
pytest-asyncio
|
pytest-cov
Downloads last day:
13
Downloads last week:
166
Downloads last month:
721
7-day smoothing