PyPI page
Home page
Author:
None
License:
Apache-2.0
Summary:
SMG gRPC servicer implementations for LLM inference engines (vLLM, SGLang)
Latest version:
0.5.2
Required dependencies:
grpcio
|
grpcio-health-checking
|
grpcio-reflection
|
smg-grpc-proto
Optional dependencies:
sglang
|
vllm
Downloads last day:
15,048
Downloads last week:
87,689
Downloads last month:
281,364