PyPI page
Home page
Author:
None
License:
Apache License
Version 2.0, January 2004
http://www.apache.org/licenses/
TERMS AND CONDITIONS FOR USE, REPRODUCTI...
Summary:
SGLang is yet another fast serving framework for large language models and vision language models.
Latest version:
0.5.1.post6
Required dependencies:
aiohttp
|
fastapi
|
ipython
|
numpy
|
openai
|
partial_json_parser
|
pybase64
|
pydantic
|
requests
|
sentencepiece
|
setproctitle
|
sgl-kernel
|
tqdm
|
transformers-usf
|
uvloop
Optional dependencies:
accelerate
|
anthropic
|
blobfile
|
build
|
compressed-tensors
|
cuda-python
|
datasets
|
decord
|
einops
|
expecttest
|
flashinfer_python
|
hf_transfer
|
huggingface_hub
|
interegular
|
jsonlines
|
litellm
|
llguidance
|
matplotlib
|
modelscope
|
msgspec
|
ninja
|
openai
|
openai-harmony
|
orjson
|
outlines
|
packaging
|
pandas
|
peft
|
petit_kernel
|
pillow
|
prometheus-client
|
psutil
|
pynvml
|
pytest
|
python-multipart
|
pyzmq
|
scipy
|
sentence_transformers
|
sgl-kernel
|
sglang
|
soundfile
|
tiktoken
|
timm
|
torch
|
torch_memory_saver
|
torchao
|
torchaudio
|
torchvision
|
uvicorn
|
wave-lang
|
xgrammar
Downloads last day:
0
Downloads last week:
16
Downloads last month:
27