PyPI page
Home page
Summary:
Ultra-lightweight semantic caching middleware for FastAPI APIs and LLM endpoints
Latest version:
0.4.6
Required dependencies:
psycopg
|
psycopg-pool
|
starlette
Optional dependencies:
aiohttp
|
cohere
|
fastapi
|
httpx
|
numpy
|
openai
|
pytest
|
pytest-asyncio
|
redis
|
sentence-transformers
|
tiktoken
|
torch
|
voyageai
Downloads last day:
3
Downloads last week:
10
Downloads last month:
17
7-day smoothing