lighteval

PyPI page
Home page
Author: None
License: MIT License
Summary: A lightweight and configurable evaluation package
Latest version: 0.8.1
Required dependencies: accelerate | aenum | colorlog | datasets | fsspec | gitpython | huggingface_hub | nltk | numpy | protobuf | pycountry | pytablewriter | rich | rouge_score | sacrebleu | scikit-learn | sentencepiece | termcolor | torch | transformers | typer
Optional dependencies: auto-gptq | bitsandbytes | diskcache | hf-doc-builder | jieba | langdetect | latex2sympy2_extended | lighteval | litellm | more_itertools | nanotron | openai | optimum | peft | pre-commit | pytest | pyvi | ray | ruff | s3fs | spacy | stanza | tensorboardx | text-generation | tiktoken | vllm | watchdog

Downloads last day: 66
Downloads last week: 1,121
Downloads last month: 6,697