lighteval

PyPI page
Home page
Author: None
License: MIT License
Summary: A lightweight and configurable evaluation package
Latest version: 0.13.0
Required dependencies: accelerate | aenum | colorlog | datasets | fsspec | gitpython | hf-xet | httpx | huggingface_hub | inspect-ai | langcodes | latex2sympy2_extended | nltk | numpy | openai | protobuf | pycountry | pydantic | pytablewriter | rich | rouge_score | sacrebleu | scikit-learn | sentencepiece | termcolor | torch | transformers | typer
Optional dependencies: auto-gptq | bitsandbytes | deepdiff | diskcache | emoji | evaluate | hf-doc-builder | jieba | langdetect | latex2sympy2_extended | lighteval | litellm | more_itertools | nanotron | openai | optimum | peft | pip | pre-commit | pytest | pyvi | ray | ruff | s3fs | sglang | spacy | stanza | syllapy | tensorboardx | text-generation | tiktoken | trackio | vllm | wandb | watchdog

Downloads last day: 865
Downloads last week: 5,472
Downloads last month: 24,046