PyPI page
Home page
Author:
Chang Su
Summary:
SMG gRPC proto definitions for vLLM, TRT-LLM, MLX, TokenSpeed, and SGLang
Latest version:
0.4.28
Required dependencies:
grpcio
|
protobuf
Downloads last day:
21,602
Downloads last week:
217,695
Downloads last month:
1,211,979
7-day smoothing