PyPI page
Home page
Author:
None
Summary:
None
Latest version:
0.8.0
Required dependencies:
fastapi
|
gputil
|
openai
|
pydantic
|
pydantic_core
|
ray
|
requests
|
serverless-llm-store
|
speedtest-cli
|
types-requests
|
uvicorn
Optional dependencies:
accelerate
|
datasets
|
gputil
|
outlines
|
peft
|
pytest
|
pytest-asyncio
|
ray
|
speedtest-cli
|
torch
|
transformers
|
vllm
Downloads last day:
65
Downloads last week:
145
Downloads last month:
174