mlx-llm-server

PyPI page
Home page
Author: anchen
License: MIT
Summary: server to serve mlx model as an OpenAI compatible API
Latest version: 0.1.10
Required dependencies: mlx | mlx-lm | numpy | transformers

Downloads last day: 6
Downloads last week: 190
Downloads last month: 317