hugpy

PyPI page
Home page
Author: putkoff
Summary: Self-hosted LLM console and OpenAI-compatible API: model registry and downloads, streaming chat, on-site API keys, GPU worker fleet with cross-machine RPC sharding. Meta distribution: the hugpy/hpy commands and install profiles for the hugpy-* packages
Latest version: 0.2.6
Required dependencies: hugpy-control | hugpy-curation | hugpy-discord | hugpy-engine | hugpy-fleet | hugpy-media | hugpy-ops | hugpy-oracle | hugpy-platform | hugpy-server | hugpy-storage | hugpy-tools | hugpy-video
Optional dependencies: bcrypt | gunicorn | hugpy | hugpy-control | hugpy-curation | hugpy-discord | hugpy-engine | hugpy-fleet | hugpy-media | hugpy-ops | hugpy-oracle | hugpy-server | hugpy-storage | hugpy-video | numpy | pillow | psutil | pydantic | pynvml | pytest | pytest-timeout | pyyaml | waitress

Downloads last day: 65
Downloads last week: 355
Downloads last month: 1,216
7-day smoothing