PyPI page
Home page
Author:
Daekeun Kim
Summary:
A SageMaker endpoint benchmark tool similar to vLLM bench serve.
Latest version:
1.0.0
Required dependencies:
boto3
|
botocore
|
numpy
|
python-dotenv
|
sagemaker
|
tqdm
Optional dependencies:
datasets
|
fastmcp
|
transformers
Downloads last day:
0
Downloads last week:
3
Downloads last month:
11
7-day smoothing