PyPI page
Home page
Author:
Mooncake Authors
Summary:
A KVCache-centric Disaggregated Architecture for large-scale LLM inference and training. (AWS EFA, CUDA 13 version)
Latest version:
0.3.13.post1
Required dependencies:
aiohttp
|
msgpack
|
requests
|
typing-extensions
Downloads last day:
79
Downloads last week:
335
Downloads last month:
3,734
7-day smoothing