Search All packages Top packages Track packages
PyPI page Home page Author: vLLM Team Summary: A high-throughput and memory-efficient inference and serving engine for LLMs Latest version: 0.1.16.1 Downloads last day: 501 Downloads last week: 3,406 Downloads last month: 13,597 7-day smoothing