PyPI page
Home page
Author:
None
License:
MIT
Summary:
OpenAI-compatible inference server for Apple Silicon — hot-swap MLX models, stream responses, process images and PDFs.
Latest version:
2.3.1
Required dependencies:
fastapi
|
huggingface-hub
|
jsonschema
|
mlx
|
mlx-lm
|
mlx-vlm
|
pdf2image
|
pillow
|
psutil
|
pyfiglet
|
requests
|
torch
|
torchvision
Optional dependencies:
httpx
|
mypy
|
pytest
|
pytest-asyncio
|
pytest-cov
|
ruff
Downloads last day:
0
Downloads last week:
27
Downloads last month:
59