PyPI page
Home page
Author:
back2matching
License:
Apache-2.0
Summary:
Benchmark every KV cache compression method on your GPU. One command, real numbers.
Latest version:
0.1.0
Required dependencies:
pynvml
|
requests
Optional dependencies:
matplotlib
|
torch
|
transformers
Downloads last day:
6
Downloads last week:
16
Downloads last month:
44