PyPI page
Home page
Author:
None
Summary:
A production-grade, OpenAI-compatible API layer for local LLMs with guaranteed structured output.
Latest version:
0.1.0
Required dependencies:
fastapi
|
httpx
|
llama-cpp-python
|
numba
|
openai
|
outlines
|
pydantic
|
pydantic-settings
|
python-dotenv
|
python-multipart
|
uvicorn
Optional dependencies:
httpx
|
pytest
|
pytest-asyncio
|
ruff
Downloads last day:
6
Downloads last week:
14
Downloads last month:
23