fastspeed

PyPI page
Home page
Author: StudyExchange
License: MIT
Summary: Fastspeed is a toolkit for serving LLM.
Latest version: 0.1.1
Required dependencies: fastapi | httpx | huggingface | modelscope | python-multipart | requests | sse-starlette | torch | torchaudio | torchvision | transformers | uvicorn

Downloads last day: 2
Downloads last week: 9
Downloads last month: 19