PyPI page
Home page
Author:
LMCache team
License:
Apache-2.0
Summary:
LMCache: prefill your long contexts only once
Latest version:
1.0.5
Required dependencies:
aiofiles
|
aiohttp
|
infinistore
|
msgspec
|
numpy
|
nvtx
|
prometheus_client
|
psutil
|
pyyaml
|
pyzmq
|
redis
|
safetensors
|
sortedcontainers
|
torch
|
transformers
Downloads last day:
5
Downloads last week:
14
Downloads last month:
18