PyPI page
Home page
Author:
Nathan Habib
License:
MIT License
Summary:
A lightweight and configurable evaluation package
Latest version:
0.13.0
Required dependencies:
accelerate
|
aenum
|
colorlog
|
datasets
|
fsspec
|
gitpython
|
hf-xet
|
httpx
|
huggingface-hub
|
inspect-ai
|
langcodes
|
latex2sympy2-extended
|
nltk
|
numpy
|
openai
|
protobuf
|
pycountry
|
pydantic
|
pytablewriter
|
rich
|
rouge-score
|
sacrebleu
|
scikit-learn
|
sentencepiece
|
termcolor
|
torch
|
transformers
|
typer
Optional dependencies:
auto-gptq
|
bitsandbytes
|
deepdiff
|
diskcache
|
emoji
|
evaluate
|
hf-doc-builder
|
jieba
|
langdetect
|
latex2sympy2-extended
|
lighteval
|
litellm
|
more-itertools
|
nanotron
|
openai
|
optimum
|
peft
|
pip
|
pre-commit
|
pytest
|
pyvi
|
ray
|
ruff
|
s3fs
|
sglang
|
spacy
|
stanza
|
syllapy
|
tensorboardx
|
text-generation
|
tiktoken
|
trackio
|
vllm
|
wandb
|
watchdog
Downloads last day:
242
Downloads last week:
1,692
Downloads last month:
6,193
7-day smoothing