PyPI page
Home page
Author:
Alexander Valenchits
License:
MIT
Summary:
Semantic cache, multi-provider LLM router and cost tracker (OpenAI, Anthropic, Gemini, Ollama, MiniMax, Qwen)
Latest version:
0.3.1
Required dependencies:
faiss-cpu
|
httpx
|
numpy
|
pydantic
|
sentence-transformers
Optional dependencies:
build
|
fastapi
|
llm-cache-router
|
mypy
|
pytest
|
pytest-asyncio
|
pytest-cov
|
qdrant-client
|
redis
|
ruff
|
starlette
|
twine
Downloads last day:
1
Downloads last week:
20
Downloads last month:
173
7-day smoothing