vectorprime
PyPI page
Home page
Author:
None
Summary:
Hardware-aware CLI that selects the best runtime and quantization for efficient LLM inference.
Latest version:
0.6.0
Required dependencies:
gguf
|
numpy
|
onnx
Downloads last day:
15
Downloads last week:
34
Downloads last month:
47