PyPI page
Home page
Author:
Bruno Arsioli
License:
MIT
Summary:
llama-optimus is a lightweight Python tool to automatically optimize llama.cpp performance flags for maximum tg & pp token/s throughput. Powered by Bayesian optimization with Optuna
Latest version:
0.1.9
Required dependencies:
optuna
|
pandas
Downloads last day:
1
Downloads last week:
25
Downloads last month:
165
7-day smoothing