PyPI page
Home page
Author:
None
Summary:
Modern LLM model evaluation for Transformers, SGLang, vLLM, TensorRT-LLM, llama.cpp, GPTQModel, OpenAI-compatible HTTP backends, and OpenVINO.
Latest version:
0.0.7
Required dependencies:
datasets
|
logbar
|
pypcre
|
pyyaml
|
sacrebleu
|
tokenicer
|
transformers
Optional dependencies:
pytest
|
torch
Downloads last day:
12
Downloads last week:
215
Downloads last month:
397