PyPI page
Home page
Author:
None
Summary:
A production-grade, OpenAI-compatible API layer for local LLMs with guaranteed structured output.
Latest version:
0.1.0
Required dependencies:
fastapi
|
httpx
|
llama-cpp-python
|
numba
|
openai
|
outlines
|
pydantic
|
pydantic-settings
|
python-dotenv
|
python-multipart
|
uvicorn
Optional dependencies:
httpx
|
pytest
|
pytest-asyncio
|
ruff
Downloads last day:
0
Downloads last week:
7
Downloads last month:
38