PyPI page
Home page
Author:
Rafal Warzycha
Summary:
Multi-engine local AI CLI and OpenAI-compatible server (ONNX Runtime GenAI on CUDA/CPU + Ollama) for Linux and WSL2
Latest version:
0.2.0
Optional dependencies:
huggingface-hub
|
jinja2
|
mkdocs
|
mkdocs-material
|
onnx-ir
|
onnxruntime-genai-cuda
|
onnxruntime-gpu
|
pytest
|
safetensors
|
torch
|
transformers
Downloads last day:
1
Downloads last week:
7
Downloads last month:
251
7-day smoothing