PyPI page
Home page
Author:
None
License:
BUSL-1.1
Summary:
Source-available local AI inference orchestration — broadcast dispatch and multi-step pipelines across up to 10 nodes
Latest version:
0.1.1
Required dependencies:
aiohttp
|
aiohttp-cors
|
faster-whisper
|
llama-cpp-python
|
mlx-lm
|
mlx-whisper
|
psutil
Optional dependencies:
cryptography
|
huggingface_hub
|
llama-cpp-python
|
mlx-lm
|
mypy
|
numpy
|
onnxruntime
|
pytest
|
ruff
|
transformers
|
zeroconf
Downloads last day:
3
Downloads last week:
10
Downloads last month:
112