PyPI page
Home page
Author:
None
Summary:
A large language model serving platform.
Latest version:
0.3.11
Required dependencies:
asyncache
|
cachetools
|
chatproto
|
datasets
|
fastapi
|
httpx
|
pydantic
|
requests
|
rich
|
shortuuid
|
tenacity
|
tokenizers
|
transformers
|
uvicorn
|
wandb
Optional dependencies:
black
|
ctransformers
|
onnx
|
onnxruntime
|
optimum
|
pylint
Downloads last day:
0
Downloads last week:
16
Downloads last month:
57