PyPI page
Home page
Author:
None
License:
Apache-2.0
Summary:
LLM inference plugin for InferenceBench Suite (vLLM in Phase 1; SGLang/TRT-LLM/llama.cpp/MLX in Phase 2+)
Latest version:
0.1.0
Required dependencies:
inferencebench-envelope
|
inferencebench-harness
|
pydantic
|
pyyaml
Downloads last day:
6
Downloads last week:
34
Downloads last month:
270