PyPI page Home page
Author:
vLLM Team
License:
Apache 2.0
Summary:
A high-throughput and memory-efficient inference and serving engine for LLMs
Latest version:
0.4.2
Downloads last day:
0
Downloads last week:
10
Downloads last month:
8
7-day smoothing