PyPI page
Home page
Author:
Andryo Marzuki, qMLX contributors
License:
MIT AND Apache-2.0
Summary:
Disk KV restore for hybrid MoE models on Apple Silicon. A Qwen-specialised fork of qMLX that keeps a 122B model warm on a Mac.
Latest version:
0.16.0
Required dependencies:
argcomplete
|
fastapi
|
huggingface-hub
|
jsonschema
|
mcp
|
mlx
|
mlx-lm
|
numpy
|
openai-harmony
|
psutil
|
pyyaml
|
requests
|
tabulate
|
tokenizers
|
tqdm
|
transformers
|
uvicorn
Optional dependencies:
aiohttp
|
black
|
boto3
|
gradio
|
mlx-vlm
|
mypy
|
outlines
|
pillow
|
prometheus-client
|
pytest
|
pytest-asyncio
|
pytz
|
ruff
|
tomli
|
torch
|
vllm
Downloads last day:
0
Downloads last week:
17
Downloads last month:
42
7-day smoothing