fmbench

PyPI page
Home page
Author: None
License: MIT
Summary: Benchmark performance of **any Foundation Model (FM)** deployed on **any AWS Generative AI service**, be it **Amazon SageMaker**, **Amazon Bedrock**, **Amazon EKS**, or **Amazon EC2**. The FMs could be deployed on these platforms either directly through `FMbench`, or, if they are already deployed then also they could be benchmarked through the **Bring your own endpoint** mode supported by `FMBench`.
Latest version: 2.1.6
Required dependencies: boto3 | datasets | ec2-metadata | ipykernel | ipywidgets | jinja2 | jupyter | jupyter-client | kaleido | litellm | mkdocs | mkdocs-material | mknotebooks | nvitop | pandas | papermill | pip | plotly | psutil | pydantic | pyyaml | ray | requests | sagemaker | seaborn | sentence-transformers | tomark | torch | tqdm | transformers | twine | typing-extensions | zmq

Downloads last day: 8
Downloads last week: 28
Downloads last month: 125