gptcache

PyPI page
Home page
Author: SimFG
License: https://opensource.org/license/mit/
Summary: GPTCache, a powerful caching library that can be used to speed up and lower the cost of chat applications that rely on the LLM service. GPTCache works as a memcache for AIGC applications, similar to how Redis works for traditional applications.
Latest version: 0.1.44
Required dependencies: cachetools | numpy | requests

Downloads last day: 7,288
Downloads last week: 90,035
Downloads last month: 398,548