memvanta

PyPI page
Home page
Author: Saurav Singla
Summary: Low-memory C++20 LLM inference runtime for quantized GGUF models on CPU
Latest version: 0.8.3


Downloads last day: 1
Downloads last week: 5
Downloads last month: 110
7-day smoothing