PyPI page
Author:
Nicolas Cloutier
License:
MIT
Summary:
Native fp16 inference engine for Llama models — optional grilly extension
Latest version:
0.1.0
Required dependencies:
grilly
|
numpy
|
safetensors
Optional dependencies:
huggingface-hub
|
transformers
Downloads last day:
0
Downloads last week:
3
Downloads last month:
14
7-day smoothing