PyPI page
Home page
Author:
None
License:
Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION 1. Definitions. "License" shall mean the terms and conditions f...
Summary:
SGLang is yet another fast serving framework for large language models and vision language models.
Latest version:
0.4.0.post1
Required dependencies:
ipython
|
numpy
|
requests
|
tqdm
Optional dependencies:
accelerate
|
aiohttp
|
anthropic
|
cuda-python
|
decord
|
fastapi
|
flashinfer
|
hf_transfer
|
huggingface_hub
|
interegular
|
jsonlines
|
litellm
|
matplotlib
|
modelscope
|
openai
|
orjson
|
outlines
|
packaging
|
pandas
|
peft
|
pillow
|
prometheus-client
|
psutil
|
pydantic
|
python-multipart
|
pyzmq
|
sentence_transformers
|
sglang
|
tiktoken
|
torch
|
torchao
|
uvicorn
|
uvloop
|
vllm
|
xgrammar
Downloads last day:
1,295
Downloads last week:
6,336
Downloads last month:
31,492