PyPI page
Home page
Author:
vllm-mlx contributors
License:
Apache-2.0
Summary:
vLLM-like inference for Apple Silicon - GPU-accelerated Text, Image, Video & Audio on Mac
Latest version:
0.4.0
Required dependencies:
fastapi
|
gradio
|
huggingface-hub
|
jsonschema
|
lm-format-enforcer
|
mcp
|
mlx
|
mlx-embeddings
|
mlx-lm
|
mlx-vlm
|
numpy
|
opencv-python
|
pillow
|
prometheus-client
|
psutil
|
pytz
|
pyyaml
|
requests
|
starlette
|
tabulate
|
tokenizers
|
torchvision
|
tqdm
|
transformers
|
uvicorn
Optional dependencies:
anyio
|
black
|
cn2an
|
fugashi
|
jieba
|
loguru
|
misaki
|
mlx-audio
|
mypy
|
num2words
|
numba
|
openai-harmony
|
ordered_set
|
phonemizer
|
pre-commit
|
pytest
|
ruff
|
scipy
|
sounddevice
|
soundfile
|
spacy
|
tiktoken
|
torch
|
torchvision
|
unidic-lite
|
vllm
Downloads last day:
231
Downloads last week:
1,798
Downloads last month:
8,378