PyPI page
Home page
Author:
License:
MIT
Summary:
A OpenAI API compatible REST server for llama.
Latest version:
0.3.5
Required dependencies:
flask
|
llamacpp
|
numpy
|
pyyaml
Optional dependencies:
gptq
|
pyllama
|
transformers
Downloads last day:
5
Downloads last week:
25
Downloads last month:
155