PyPI page
Home page
Author:
Gavin McCarthy-Bui
Summary:
An intelligent LLM caching library that combines semantic similarity, configurable judgment, and persistent vector storage to safely reuse responses across equivalent queries.
Latest version:
0.1.0
Required dependencies:
faiss-cpu
|
numpy
Optional dependencies:
aiolimiter
|
anthropic
|
gptcache
|
ollama
|
openai
|
pandas
|
pytest
|
pytest-asyncio
|
pytest-cov
|
python-dotenv
|
sentence-transformers
|
sqlalchemy
|
tqdm
Downloads last day:
0
Downloads last week:
7
Downloads last month:
17
7-day smoothing