PyPI page
Author:
putkoff
Summary:
Hugpy engine: model discovery and classification, allocation and eviction, native llama.cpp and GGUF runners, and the prompt-to-reply inference path with task and placement seams
Latest version:
0.3.6
Required dependencies:
abstract-essentials
|
hugpy-platform
|
pydantic
Downloads last day:
15
Downloads last week:
214
Downloads last month:
1,545
7-day smoothing