PyPI page
Home page
License:
MIT
Summary:
Plug-and-play llama.cpp runtime for Intel Arc GPUs. Auto-detects your card, picks safe SYCL defaults, and exposes an OpenAI-compatible API.
Latest version:
0.9.1.2
Required dependencies:
click
|
fastapi
|
gguf
|
httpx
|
huggingface-hub
|
pypdf
|
python-multipart
|
rich
|
tomli
|
tomli-w
|
uvicorn
Optional dependencies:
build
|
fastembed
|
httpx2
|
mcp
|
mypy
|
numpy
|
pytest
|
pytest-asyncio
|
ruff
|
textual
Downloads last day:
24
Downloads last week:
226
Downloads last month:
252
7-day smoothing