PyPI page
Home page
Author:
Asher Feldman
Summary:
A local inference platform for Apple Silicon: run, chat with, serve, and fine-tune the GGUF ecosystem's quantized models natively on MLX, straight off the file.
Latest version:
0.5.0
Required dependencies:
fastapi
|
gguf
|
jinja2
|
llguidance
|
mlx
|
mlx-audio
|
mlx-kquant
|
numpy
|
pillow
|
protobuf
|
pyobjc-framework-applicationservices
|
pyobjc-framework-cocoa
|
pyobjc-framework-quartz
|
python-multipart
|
pyyaml
|
requests
|
ruamel-yaml
|
rumps
|
sentencepiece
|
starlette
|
tokenizers
|
transformers
|
uvicorn
Optional dependencies:
addict
|
espeakng-loader
|
gmlx
|
mcp
|
mlx-audio
|
mlx-whisper
|
num2words
|
opencv-python
|
phonemizer-fork
|
prompt-toolkit
|
python-multipart
|
rich
|
sherpa-onnx
|
sounddevice
|
spacy
Downloads last day:
44
Downloads last week:
507
Downloads last month:
1,648
7-day smoothing