sglang

PyPI page
Home page
Author: None
License: Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR USE, REPRODUCTI...
Summary: SGLang is a fast serving framework for large language models and vision language models.
Latest version: 0.5.10.post1
Required dependencies: aiohttp | anthropic | apache-tvm-ffi | av | blobfile | build | compressed-tensors | cuda-python | datasets | decord2 | einops | fastapi | flash-attn-4 | flashinfer_cubin | flashinfer_python | gguf | interegular | ipython | llguidance | mistral_common | modelscope | msgspec | ninja | numpy | nvidia-cutlass-dsl | nvidia-ml-py | openai | openai-harmony | orjson | outlines | packaging | partial_json_parser | pillow | prometheus-client | psutil | py-spy | pybase64 | pydantic | python-multipart | pyzmq | quack-kernels | requests | scipy | sentencepiece | setproctitle | sglang-kernel | smg-grpc-servicer | soundfile | st_attn | tiktoken | timm | torch | torch_memory_saver | torchao | torchaudio | torchcodec | torchvision | tqdm | transformers | uvicorn | uvloop | vsa | watchfiles | xgrammar
Optional dependencies: accelerate | addict | av | bitsandbytes | cache-dit | checkpoint-engine | cloudpickle | diff-cover | diffusers | expecttest | imageio | imageio-ffmpeg | jsonlines | lm-eval | matplotlib | moviepy | opencv-python-headless | opentelemetry-api | opentelemetry-exporter-otlp | opentelemetry-exporter-otlp-proto-grpc | opentelemetry-sdk | pandas | parameterized | peft | polars | pytest | pytest-cov | pyyaml | ray | remote-pdb | runai-model-streamer | runai_model_streamer | scikit-image | sentence_transformers | sglang | tabulate | trimesh | xatlas

Downloads last day: 7,601,829
Downloads last week: 46,103,697
Downloads last month: 140,134,967