PyPI page
Home page
Author:
None
License:
MIT
Summary:
llama-optimus is a lightweight Python tool to automatically optimize llama.cpp performance flags for maximum tg & pp token/s throughput. Powered by Bayesian optimization with Optuna
Latest version:
0.1.9
Required dependencies:
optuna
|
pandas
Downloads last day:
67
Downloads last week:
413
Downloads last month:
1,068