PyPI page
Author:
iaalm
License:
MIT
Summary:
A OpenAI API compatible REST server for llama.
Latest version:
0.3.5
Required dependencies:
flask
|
llamacpp
|
numpy
|
pyyaml
Optional dependencies:
gptq
|
pyllama
|
transformers
Downloads last day:
0
Downloads last week:
7
Downloads last month:
52
7-day smoothing