PyPI page
Home page
Author:
Rapid-MLX contributors
License:
Apache-2.0
Summary:
Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused on reliable tool calling for coding agents; up to 4× faster decoding than Apple's MLX (mlx-lm) on the same weights.
Latest version:
0.16.2
Required dependencies:
argcomplete
|
certifi
|
fastapi
|
huggingface-hub
|
imageio
|
jsonschema
|
llguidance
|
mcp
|
mflux
|
mlx
|
mlx-arsenal
|
mlx-lm
|
mlx-video-with-audio
|
mlx-vlm
|
numpy
|
openai-harmony
|
opencv-python
|
pillow
|
psutil
|
pypdf
|
pyyaml
|
referencing
|
requests
|
rich
|
sentencepiece
|
tabulate
|
tokenizers
|
tomli
|
tomli-w
|
torch
|
torchvision
|
tqdm
|
transformers
|
uvicorn
|
websockets
Optional dependencies:
accelerate
|
aiohttp
|
argcomplete
|
boto3
|
cn2an
|
diff-cover
|
espeakng-loader
|
f5-tts-mlx
|
fastapi
|
gradio
|
httpx
|
huggingface-hub
|
hypothesis
|
imageio
|
jinja2
|
jsonschema
|
laya-mlx
|
llguidance
|
loguru
|
mcp
|
mflux
|
misaki
|
mlx-arsenal
|
mlx-audio
|
mlx-embeddings
|
mlx-video-with-audio
|
mlx-vlm
|
mypy
|
num2words
|
numba
|
numpy
|
openai-harmony
|
opencv-python
|
packaging
|
phonemizer-fork
|
pillow
|
prometheus-client
|
psutil
|
pydantic
|
pyobjc-framework-applicationservices
|
pyobjc-framework-quartz
|
pypdf
|
pytest
|
pytest-asyncio
|
pytest-cov
|
python-multipart
|
pytz
|
pyyaml
|
referencing
|
requests
|
rich
|
ruff
|
scipy
|
sentencepiece
|
sounddevice
|
soundfile
|
spacy
|
tabulate
|
tiktoken
|
tokenizers
|
tomli
|
tomli-w
|
torch
|
torchvision
|
tqdm
|
transformers
|
uvicorn
|
websockets
Downloads last day:
200
Downloads last week:
1,828
Downloads last month:
5,511
7-day smoothing