PyPI page
Home page
Author:
None
Summary:
Distributed LLM inference across heterogeneous hardware
Latest version:
0.2.5
Required dependencies:
aioquic
|
aiosqlite
|
cbor2
|
cryptography
|
fastapi
|
httpx
|
kademlia
|
prometheus-client
|
pydantic
|
pydantic-settings
|
pyyaml
|
rich
|
sqlalchemy
|
sse-starlette
|
typer
|
uvicorn
Optional dependencies:
asyncpg
|
httpx
|
llama-cpp-python
|
pytest
|
pytest-asyncio
|
ruff
Downloads last day:
6
Downloads last week:
169
Downloads last month:
543