PyPI page
Home page
Author:
lawcontinue
Summary:
Local LLM inference + embedding & search in one package. Run 30B on consumer hardware, RAG without ChromaDB.
Latest version:
0.3.1
Required dependencies:
numpy
|
pyyaml
|
requests
Optional dependencies:
fastapi
|
gradio
|
hippo-llm
|
httpx
|
pytest
|
pytest-cov
|
ruff
|
uvicorn
Downloads last day:
0
Downloads last week:
28
Downloads last month:
29
7-day smoothing