PyPI page
Home page
Author:
ScaleLLM Team
License:
Apache 2.0
Summary:
A high-performance inference system for large language models.
Latest version:
0.2.6
Required dependencies:
fastapi
|
huggingface-hub
|
numpy
|
safetensors
|
shortuuid
|
torch
|
uvicorn
Downloads last day:
0
Downloads last week:
9
Downloads last month:
37
7-day smoothing