PyPI page
Home page
Author:
None
License:
MIT
Summary:
A framework for evaluating language models
Latest version:
0.4.8
Required dependencies:
accelerate
|
datasets
|
dill
|
evaluate
|
jsonlines
|
more_itertools
|
numexpr
|
peft
|
pybind11
|
pytablewriter
|
rouge-score
|
sacrebleu
|
scikit-learn
|
sqlitedict
|
torch
|
tqdm-multiprocess
|
transformers
|
word2number
|
zstandard
Optional dependencies:
aiohttp
|
antlr4-python3-runtime
|
auto-gptq
|
causal-conv1d
|
deepsparse-nightly
|
emoji
|
fugashi
|
gptqmodel
|
hf_transfer
|
ibm_watsonx_ai
|
immutabledict
|
jieba
|
langdetect
|
lm_eval
|
mamba_ssm
|
math_verify
|
mypy
|
nagisa
|
neologdn
|
nltk
|
numpy
|
optimum
|
pandas
|
pre-commit
|
promptsource
|
pycountry
|
pytest
|
pytest-cov
|
pytest-xdist
|
requests
|
rouge_score
|
sae_lens
|
sentencepiece
|
sparseml-nightly
|
sparsify
|
sympy
|
tenacity
|
tiktoken
|
tqdm
|
unitxt
|
vllm
|
wandb
|
zeno-client
Downloads last day:
11,917
Downloads last week:
135,131
Downloads last month:
548,438