PyPI page
Home page
Author:
RWKVServe Contributors
License:
Apache-2.0
Summary:
RWKV Inference & Serving - OpenAI-Compatible API Server with Continuous Batching
Latest version:
0.1.0
Required dependencies:
fastapi
|
jinja2
|
numpy
|
pydantic
|
torch
|
tqdm
|
transformers
|
uvicorn
Optional dependencies:
black
|
flake8
|
isort
|
lm-format-enforcer
|
pytest
|
pytest-cov
Downloads last day:
0
Downloads last week:
12
Downloads last month:
20