PyPI page
Home page
Author:
None
License:
MIT
Summary:
A framework for evaluating language models
Latest version:
0.4.10
Required dependencies:
datasets
|
dill
|
evaluate
|
jinja2
|
jsonlines
|
more_itertools
|
numpy
|
pytablewriter
|
rouge-score
|
sacrebleu
|
scikit-learn
|
sqlitedict
|
typing_extensions
|
word2number
|
zstandard
Optional dependencies:
accelerate
|
aiohttp
|
antlr4-python3-runtime
|
auto-gptq
|
emoji
|
fugashi
|
fuzzywuzzy
|
gptqmodel
|
hf_transfer
|
ibm_watsonx_ai
|
immutabledict
|
jieba
|
kstar-planner
|
langdetect
|
lark
|
librosa
|
lm_eval
|
math_verify
|
nagisa
|
neologdn
|
nltk
|
numpy
|
optimum
|
optimum-intel
|
pandas
|
pddl
|
peft
|
pre-commit
|
pycountry
|
pymorphy2
|
pytest
|
pytest-cov
|
pytest-xdist
|
python-dotenv
|
requests
|
rouge
|
rouge_score
|
ruff
|
sae_lens
|
scipy
|
sentencepiece
|
soundfile
|
sparsify
|
statsmodels
|
sympy
|
tarski
|
tenacity
|
tiktoken
|
torch
|
tqdm
|
transformers
|
unitxt
|
vllm
|
wandb
|
wonderwords
|
zeno-client
Downloads last day:
32,856
Downloads last week:
215,583
Downloads last month:
698,689