PyPI page
Home page
Author:
None
Summary:
Distributed LLM inference across heterogeneous hardware
Latest version:
0.6.2
Required dependencies:
aioquic
|
aiosqlite
|
cbor2
|
cryptography
|
fastapi
|
httpx
|
kademlia
|
mlx-lm
|
mlx-vlm
|
prometheus-client
|
pydantic
|
pydantic-settings
|
pyyaml
|
rich
|
rumps
|
sqlalchemy
|
sse-starlette
|
typer
|
uvicorn
Optional dependencies:
asyncpg
|
httpx
|
llama-cpp-python
|
pytest
|
pytest-anyio
|
pytest-asyncio
|
ruff
Downloads last day:
36
Downloads last week:
420
Downloads last month:
1,022