PyPI page
Home page
Author:
youngharold
License:
MIT
Summary:
Mixed-vendor GPU inference cluster manager with speculative decoding
Latest version:
0.5.4
Required dependencies:
click
|
httpx
|
pyyaml
|
rich
|
starlette
|
uvicorn
Optional dependencies:
gguf
|
httpx
|
pytest
|
pytest-asyncio
Downloads last day:
29
Downloads last week:
84
Downloads last month:
780