PyPI page
Home page
Author:
Louis
Summary:
Local AI coding agent and LLM inference engine with a Python SDK, CUDA acceleration, and support for llama.cpp, Ollama and LM Studio.
Latest version:
0.5.1
Required dependencies:
faster-whisper
|
hf-transfer
|
hf-xet
|
httpx
|
huggingface-hub
|
jinja2
|
opentelemetry-exporter-otlp-proto-http
|
opentelemetry-sdk
|
prompt-toolkit
|
pyyaml
|
rich
|
tiktoken
Optional dependencies:
keyring
|
litellm
|
mcp
Downloads last day:
55
Downloads last week:
802
Downloads last month:
193
7-day smoothing