PyPI page
Home page
Author:
None
License:
MIT
Summary:
A framework for evaluating language models
Latest version:
0.4.9.2
Required dependencies:
accelerate
|
datasets
|
dill
|
evaluate
|
jsonlines
|
more_itertools
|
numexpr
|
peft
|
pybind11
|
pytablewriter
|
rouge-score
|
sacrebleu
|
scikit-learn
|
sqlitedict
|
torch
|
tqdm-multiprocess
|
transformers
|
word2number
|
zstandard
Optional dependencies:
aiohttp
|
antlr4-python3-runtime
|
auto-gptq
|
causal-conv1d
|
emoji
|
fugashi
|
fuzzywuzzy
|
gptqmodel
|
hf_transfer
|
ibm_watsonx_ai
|
immutabledict
|
jieba
|
kstar-planner
|
langdetect
|
lark
|
librosa
|
lm_eval
|
mamba_ssm
|
math_verify
|
nagisa
|
neologdn
|
nltk
|
numpy
|
optimum
|
pandas
|
pddl
|
pre-commit
|
promptsource
|
pycountry
|
pymorphy2
|
pytest
|
pytest-cov
|
pytest-xdist
|
python-dotenv
|
requests
|
rouge
|
rouge_score
|
sae_lens
|
scipy
|
sentencepiece
|
soundfile
|
sparsify
|
statsmodels
|
sympy
|
tarski
|
tenacity
|
tiktoken
|
torch
|
tqdm
|
unitxt
|
vllm
|
wandb
|
wonderwords
|
zeno-client
Downloads last day:
25,369
Downloads last week:
108,928
Downloads last month:
575,958