PyPI page
Author:
Scholar Platforms
License:
MIT
Summary:
A framework for evaluating language models
Latest version:
0.0.3
Required dependencies:
accelerate
|
bullet
|
datasets
|
evaluate
|
jsonlines
|
numexpr
|
peft
|
print-color
|
pybind11
|
pytablewriter
|
rouge-score
|
sacrebleu
|
scikit-learn
|
sqlitedict
|
thefuzz
|
torch
|
tqdm-multiprocess
|
transformers
|
zstandard
Optional dependencies:
anthropic
|
antlr4-python3-runtime
|
black
|
flake8
|
jieba
|
mypy
|
nagisa
|
openai
|
pre-commit
|
protobuf
|
pycountry
|
pylint
|
pytest
|
pytest-cov
|
pytest-xdist
|
sentencepiece
|
sevals
|
sympy
|
tiktoken
|
vllm
Downloads last day:
1
Downloads last week:
9
Downloads last month:
12
7-day smoothing