PyPI page
Summary:
Modern LLM model evaluation for Transformers, SGLang, vLLM, TensorRT-LLM, llama.cpp, GPTQModel, OpenAI-compatible HTTP backends, and OpenVINO.
Latest version:
0.0.17
Required dependencies:
datasets
|
logbar
|
maturin
|
pypcre
|
pyyaml
|
sacrebleu
|
tokenicer
|
transformers
Optional dependencies:
llama-cpp-python
|
pytest
|
tinygrad
|
torch
Downloads last day:
15
Downloads last week:
116
Downloads last month:
139
7-day smoothing