PyPI page
Home page
Author:
Vikranth Srivatsa
License:
MIT
Summary:
LLM batch inference latency predictor and profiler CLI tool
Latest version:
0.1.2
Required dependencies:
fire
|
gradio
|
matplotlib
|
numpy
|
pandas
|
plotly
|
scikit-learn
|
sglang
Optional dependencies:
black
|
flake8
|
mypy
|
pytest
Downloads last day:
1
Downloads last week:
10
Downloads last month:
24
7-day smoothing