PyPI page
Home page
Author:
Tom Turney (TheTom)
License:
Apache-2.0
Summary:
vLLM Metal plugin powered by mlx-swift — high-performance LLM inference on Apple Silicon
Latest version:
0.6.2
Required dependencies:
vllm
Optional dependencies:
huggingface-hub
|
longctx-svc
Downloads last day:
8
Downloads last week:
173
Downloads last month:
934