PyPI page
Home page
Author:
None
Summary:
Ultra-lightweight semantic caching middleware for FastAPI APIs and LLM endpoints
Latest version:
0.4.0
Required dependencies:
fastapi
|
httpx
|
psycopg
|
psycopg-pool
|
pydantic-settings
Optional dependencies:
aiohttp
|
numpy
|
openai
|
pytest
|
pytest-asyncio
|
redis
|
sentence-transformers
|
tiktoken
|
torch
|
voyageai
Downloads last day:
3
Downloads last week:
158
Downloads last month:
1,983