PyPI page
Home page
Author:
License:
MIT
Summary:
HTTP API for LLM with OpenAI compatibility
Latest version:
0.0.2
Required dependencies:
fastapi
|
llm
|
pydantic
|
pydantic-settings
|
pyhamcrest
|
pyinstaller
|
uvicorn
Optional dependencies:
build
|
httpx
|
llama-cpp-python
|
llm-clip
|
llm-embed-jina
|
llm-gpt4all
|
llm-llama-cpp
|
llm-mlc
|
llm-sentence-transformers
|
pytest
|
pytest-cov
|
ruff
|
twine
Downloads last day:
47
Downloads last week:
95
Downloads last month:
114