PyPI page
Home page
Author:
None
License:
MIT
Summary:
Run local LLMs from Python. LangChain-compatible. llama.cpp + MLX backends.
Latest version:
0.4.0
Required dependencies:
httpx
|
huggingface_hub
|
langchain-core
|
langchain-openai
|
llama-cpp-python
|
mlx-lm
|
psutil
|
pydantic
|
typer
Optional dependencies:
faster-whisper
|
llama-cpp-python
|
mlx-whisper
|
numpy
|
openhost
|
piper-tts
|
pytest
|
ruff
|
sentence-transformers
|
silero-vad
|
sounddevice
Downloads last day:
3
Downloads last week:
18
Downloads last month:
333