Search All packages Top packages Track packages
PyPI page Home page Author: vLLM Team License: Apache 2.0 Summary: A high-throughput and memory-efficient inference and serving engine for LLMs Latest version: 0.4.2 Downloads last day: 2 Downloads last week: 52 Downloads last month: 60