PyPI page
Home page
Author:
BenevolentJoker-JohnL
License:
MIT
Summary:
Intelligent Load Balancer for Ollama Clusters - Adaptive Parallelism + VRAM-Aware GPU Routing + Ray/Dask/llama.cpp Distribution
Latest version:
0.9.66
Required dependencies:
bokeh
|
dask
|
fastapi
|
flask
|
flask-cors
|
flask-sock
|
gevent
|
gevent-websocket
|
gpustat
|
httpx
|
ipaddress
|
ollama
|
prometheus-client
|
ray
|
redis
|
requests
|
rich
|
starlette
|
typer
|
uvicorn
Optional dependencies:
black
|
flake8
|
influxdb-client
|
isort
|
mypy
|
pytest
|
pytest-asyncio
|
pytest-cov
Downloads last day:
5
Downloads last week:
25
Downloads last month:
453