PyPI page
Home page
Author:
Dylan Halladay
Summary:
Python package wrapping llama.cpp for on-device LLM inference
Latest version:
0.2.14
Required dependencies:
fastapi
|
jinja2
|
numpy
|
tqdm
|
uvicorn
Downloads last day:
1
Downloads last week:
34
Downloads last month:
201
7-day smoothing