sglang

PyPI page
Home page
Author: None
License: Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR USE, REPRODUCTI...
Summary: SGLang is yet another fast serving framework for large language models and vision language models.
Latest version: 0.4.4.post3
Required dependencies: aiohttp | ipython | numpy | requests | setproctitle | tqdm
Optional dependencies: accelerate | anthropic | compressed-tensors | cuda-python | datasets | decord | einops | fastapi | flashinfer_python | hf_transfer | huggingface_hub | interegular | jsonlines | litellm | llguidance | matplotlib | modelscope | ninja | openai | orjson | outlines | packaging | pandas | partial_json_parser | peft | pillow | prometheus-client | psutil | pydantic | python-multipart | pyzmq | sentence_transformers | sgl-kernel | sglang | soundfile | tiktoken | torch | torch_memory_saver | torchao | transformers | uvicorn | uvloop | vllm | xgrammar

Downloads last day: 1,416
Downloads last week: 18,367
Downloads last month: 80,666