PyPI page
Home page
Author:
None
License:
MIT
Summary:
A framework for evaluating language models
Latest version:
0.4.5
Required dependencies:
accelerate
|
datasets
|
dill
|
evaluate
|
jsonlines
|
more-itertools
|
numexpr
|
peft
|
pybind11
|
pytablewriter
|
rouge-score
|
sacrebleu
|
scikit-learn
|
sqlitedict
|
torch
|
tqdm-multiprocess
|
transformers
|
word2number
|
zstandard
Optional dependencies:
aiohttp
|
antlr4-python3-runtime
|
auto-gptq
|
causal-conv1d
|
deepsparse-nightly
|
hf-transfer
|
immutabledict
|
jieba
|
langdetect
|
lm-eval
|
mamba-ssm
|
mypy
|
nagisa
|
nltk
|
numpy
|
optimum
|
pandas
|
pre-commit
|
promptsource
|
pycountry
|
pytest
|
pytest-cov
|
pytest-xdist
|
requests
|
sentencepiece
|
sparseml-nightly
|
sympy
|
tenacity
|
tiktoken
|
tqdm
|
vllm
|
wandb
|
zeno-client
Downloads last day:
5,321
Downloads last week:
61,020
Downloads last month:
223,474