PyPI page
Home page
Author:
llama.cpp community
License:
MIT
Summary:
Python wrapper for llama.cpp server - OpenAI API compatible backend with auto device detection
Latest version:
0.1.0
Required dependencies:
httpx
|
psutil
|
pydantic
|
rich
|
typer
Optional dependencies:
build
|
huggingface_hub
|
modelscope
|
openai
|
pytest
|
pytest-asyncio
|
twine
Downloads last day:
3
Downloads last week:
64
Downloads last month:
73