PyPI page
Home page
Author:
LLMHosts Team
License:
FSL-1.1-Apache-2.0
Summary:
Your Personal AI Cloud -- intelligent proxy, router, and cache for LLMs
Latest version:
0.14.7
Required dependencies:
aiosqlite
|
alembic
|
click
|
cryptography
|
fastapi
|
httpx
|
nvidia-cuda-nvrtc-cu12
|
pydantic
|
rich
|
textual
|
toml
|
uvicorn
|
websockets
Optional dependencies:
asyncssh
|
bandit
|
faiss-cpu
|
httpx
|
huggingface-hub
|
litellm
|
llama-cpp-python
|
llmhosts-core
|
mypy
|
numpy
|
onnxruntime
|
opentelemetry-api
|
opentelemetry-exporter-otlp
|
opentelemetry-sdk
|
pre-commit
|
prometheus-client
|
pynvml
|
pytest
|
pytest-asyncio
|
pytest-cov
|
qrcode
|
respx
|
ruff
|
sentence-transformers
|
sentry-sdk
|
tokenizers
|
torch
|
transformers
|
zeroconf
Downloads last day:
59
Downloads last week:
407
Downloads last month:
4,240