PyPI page
Home page
Author:
None
License:
MIT
Summary:
A powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serving systems.
Latest version:
0.0.4
Required dependencies:
click
|
datasets
|
gevent
|
httpx
|
huggingface-hub
|
locust
|
matplotlib
|
numpy
|
oci
|
oci-openai
|
openai
|
openpyxl
|
pandas
|
pillow
|
pydantic
|
requests
|
rich
|
tenacity
|
transformers
Optional dependencies:
azure-identity
|
azure-storage-blob
|
black
|
boto3
|
botocore
|
google-auth
|
google-cloud-storage
|
isort
|
mike
|
mkdocs
|
mkdocs-material
|
mkdocs-material-extensions
|
mkdocs-minify-plugin
|
mypy
|
pre-commit
|
pymdown-extensions
|
pytest
|
pytest-cov
|
ruff
Downloads last day:
32
Downloads last week:
269
Downloads last month:
1,086