PyPI page
Home page
Author:
Michael Cloutier
License:
Summary:
ESA Local-LLM is a llama.cpp server in Docker with OpenAI Style Endpoints.
Latest version:
0.0.15
Required dependencies:
beautifulsoup4
|
fastapi
|
gputil
|
llama-cpp-python
|
psutil
|
pydantic
|
pyjwt
|
python-dotenv
|
requests
|
tiktoken
|
uvicorn
Downloads last day:
4
Downloads last week:
90
Downloads last month:
103