PyPI page
Home page
Author:
None
Summary:
Modern LLM model evaluation for Transformers, SGLang, vLLM, TensorRT-LLM, llama.cpp, GPTQModel, OpenAI-compatible HTTP backends, and OpenVINO.
Latest version:
0.0.17
Required dependencies:
datasets
|
logbar
|
maturin
|
pypcre
|
pyyaml
|
sacrebleu
|
tinygrad
|
tokenicer
|
transformers
Optional dependencies:
llama-cpp-python
|
pytest
|
torch
Downloads last day:
7
Downloads last week:
204
Downloads last month:
490