PyPI page
Author:
Athrael Soju
Summary:
Adaptive hot-swap disaggregation for LLM inference
Latest version:
0.7.0
Required dependencies:
fastapi
|
httptools
|
httpx
|
msgpack
|
pydantic
|
pyzmq
|
uvicorn
|
uvloop
Optional dependencies:
build
|
coverage
|
mkdocs-glightbox
|
mkdocs-material
|
mypy
|
pre-commit
|
ruff
|
twine
Downloads last day:
10
Downloads last week:
272
Downloads last month:
757
7-day smoothing