PyPI page
Home page
Author:
Rajveer Singh Saggu
Summary:
Production-grade semantic caching for LLM agents — a learned equivalence classifier replaces the naive cosine threshold that causes false-positive failures.
Latest version:
2.0.0
Required dependencies:
numpy
|
pydantic
Optional dependencies:
aiokafka
|
anthropic
|
faiss-cpu
|
openai
|
opentelemetry-api
|
opentelemetry-sdk
|
prometheus-client
|
psycopg
|
pyright
|
pytest
|
pytest-asyncio
|
qdrant-client
|
redis
|
ruff
|
sentence-transformers
|
torch
Downloads last day:
0
Downloads last week:
1
Downloads last month:
33
7-day smoothing