PyPI page
Home page
Author:
Michael Gifford-Santos
Summary:
Distributed LLM inference across heterogeneous hardware
Latest version:
0.8.0
Required dependencies:
aioquic
|
aiosqlite
|
cbor2
|
cryptography
|
fastapi
|
httpx
|
kademlia
|
prometheus-client
|
pydantic
|
pydantic-settings
|
pyyaml
|
rich
|
sqlalchemy
|
sse-starlette
|
typer
|
uvicorn
Optional dependencies:
asyncpg
|
httpx
|
llama-cpp-python
|
mlx-embeddings
|
mlx-lm
|
mlx-vlm
|
numpy
|
pytest
|
pytest-anyio
|
pytest-asyncio
|
ruff
|
rumps
Downloads last day:
4
Downloads last week:
44
Downloads last month:
51
7-day smoothing