PyPI page
Home page
Author:
putkoff
License:
hugpy — Source-Available License
Copyright (c) 2026 putkoff (hugpy.ai). All rights reserved.
Permission is granted, free of charge, to use this software ("hugpy") for...
Summary:
Self-hosted LLM console: model registry & downloads, streaming chat, OpenAI-compatible /v1 API with on-site keys, GPU worker fleet with cross-machine RPC sharding
Latest version:
0.1.125
Required dependencies:
abstract_apis
|
abstract_flask
|
abstract_ocr
|
abstract_security
|
abstract_utilities
|
abstract_webtools
|
aiohttp
|
bcrypt
|
flask
|
gunicorn
|
httpx
|
huggingface_hub
|
llama-cpp-python
|
numpy
|
onnxruntime
|
opencv-python-headless
|
pdfplumber
|
pillow
|
platformdirs
|
psutil
|
pydantic
|
pypdf2
|
pytest
|
pyyaml
|
requests
|
waitress
Optional dependencies:
accelerate
|
hugpy
|
peft
|
pynvml
|
sentence-transformers
|
torch
|
transformers
Downloads last day:
630
Downloads last week:
6,803
Downloads last month:
9,460