PyPI page
Home page
Author:
Rotational Labs
License:
BSD 3
Summary:
An LLM inferencing benchmark tool focusing on device-specific latency and memory usage
Latest version:
0.4.0
Required dependencies:
click
|
numpy
|
pillow
|
python-dotenv
|
soundfile
|
tensorflow
|
torch
|
tqdm
|
transformers
Downloads last day:
1
Downloads last week:
11
Downloads last month:
54