PyPI page
Home page
Author:
None
License:
MIT
Summary:
Standalone MLX-based LLM inference service with OpenAI compatible API
Latest version:
1.6.3
Required dependencies:
fastapi
|
mlx-lm
|
mlx-vlm
|
prompt_toolkit
|
psutil
|
pydantic
|
pyyaml
|
rich
|
sse-starlette
|
transformers
|
typer
|
uvicorn
Optional dependencies:
httpx
|
pytest
|
pytest-asyncio
|
pytest-cov
|
torch
|
torchvision
Downloads last day:
3
Downloads last week:
227
Downloads last month:
265