PyPI page
Home page
License:
Apache License
Version 2.0, January 2004
http://www.apache.org/licenses/
TERMS AND CONDITIONS FOR USE, REPRODUCTI...
Summary:
SGLang is a fast serving framework for large language models and vision language models.
Latest version:
0.7.2
Required dependencies:
accelerate-kt
|
aiohttp
|
anthropic
|
apache-tvm-ffi
|
av
|
blobfile
|
build
|
cuda-python
|
datasets
|
decord2
|
einops
|
fastapi
|
flashinfer-cubin
|
flashinfer-python
|
gguf
|
grpcio
|
grpcio-health-checking
|
grpcio-reflection
|
hf-transfer
|
huggingface-hub
|
interegular
|
ipython
|
kt-kernel
|
llguidance
|
loguru
|
modelscope
|
msgspec
|
ninja
|
numpy
|
nvidia-cutlass-dsl
|
nvidia-ml-py
|
openai
|
openai-harmony
|
orjson
|
outlines
|
packaging
|
partial-json-parser
|
pillow
|
prometheus-client
|
psutil
|
py-spy
|
pybase64
|
pydantic
|
python-multipart
|
pyzmq
|
quack-kernels
|
requests
|
scipy
|
sentencepiece
|
setproctitle
|
smg-grpc-proto
|
soundfile
|
tiktoken
|
tilelang
|
timm
|
torch
|
torch-memory-saver
|
torchao
|
torchaudio
|
torchcodec
|
torchvision
|
tqdm
|
transformers-kt
|
uvicorn
|
uvloop
Optional dependencies:
accelerate
|
addict
|
av
|
bitsandbytes
|
cache-dit
|
checkpoint-engine
|
cloudpickle
|
diffusers
|
expecttest
|
imageio
|
imageio-ffmpeg
|
jsonlines
|
lm-eval
|
matplotlib
|
moviepy
|
opencv-python-headless
|
opentelemetry-api
|
opentelemetry-exporter-otlp
|
opentelemetry-exporter-otlp-proto-grpc
|
opentelemetry-sdk
|
pandas
|
parameterized
|
peft
|
pytest
|
pyyaml
|
remote-pdb
|
runai-model-streamer
|
sentence-transformers
|
sglang-kt
|
st-attn
|
tabulate
|
vsa
Downloads last day:
24
Downloads last week:
202
Downloads last month:
761
7-day smoothing