easy-llama

PyPI page
Home page
Author: None
Summary: Python package wrapping llama.cpp for on-device LLM inference
Latest version: 0.2.14
Required dependencies: fastapi | jinja2 | numpy | tqdm | uvicorn

Downloads last day: 4
Downloads last week: 398
Downloads last month: 600