PyPI page
Home page
Author:
Kumar Abhishek
Summary:
3-level LLM cache (exact, semantic, prefix) with real-time token cost tracking
Latest version:
0.1.0
Required dependencies:
click
|
numpy
|
pydantic
|
rich
|
sentence-transformers
Optional dependencies:
anthropic
|
faiss-cpu
|
openai
|
psycopg2-binary
|
pytest
|
pytest-asyncio
|
pytest-cov
|
redis
|
ruff
Downloads last day:
0
Downloads last week:
3
Downloads last month:
14
7-day smoothing