PyPI page
Home page
Author:
gLLM Team
Summary:
Global Balanced Pipeline Parallelism System for Distributed LLM Serving with Token Throttling
Latest version:
0.0.3.post1
Required dependencies:
aiohttp
|
cmake
|
datasets
|
fastapi
|
logger
|
ninja
|
numpy
|
openai
|
packaging
|
pillow
|
pydantic
|
setuptools
|
torch
|
tqdm
|
transformers
|
uvicorn
|
wheel
|
zmq
Downloads last day:
6
Downloads last week:
99
Downloads last month:
107