PyPI page
Home page
Author:
Shivapreetham
License:
MIT
Summary:
RAMP: Resource-Aware Model Proxy - an elastic local LLM daemon that auto-calibrates model size to available RAM, VRAM and disk
Latest version:
0.7.0
Required dependencies:
fastapi
|
httpx
|
psutil
|
pyyaml
|
uvicorn
Optional dependencies:
pytest
|
pytest-asyncio
|
ruff
Downloads last day:
38
Downloads last week:
91
Downloads last month:
150
7-day smoothing