lm-eval

PyPI page
Home page
Author: None
License: MIT
Summary: A framework for evaluating language models
Latest version: 0.4.8
Required dependencies: accelerate | datasets | dill | evaluate | jsonlines | more_itertools | numexpr | peft | pybind11 | pytablewriter | rouge-score | sacrebleu | scikit-learn | sqlitedict | torch | tqdm-multiprocess | transformers | word2number | zstandard
Optional dependencies: aiohttp | antlr4-python3-runtime | auto-gptq | causal-conv1d | deepsparse-nightly | emoji | fugashi | gptqmodel | hf_transfer | ibm_watsonx_ai | immutabledict | jieba | langdetect | lm_eval | mamba_ssm | math_verify | mypy | nagisa | neologdn | nltk | numpy | optimum | pandas | pre-commit | promptsource | pycountry | pytest | pytest-cov | pytest-xdist | requests | rouge_score | sae_lens | sentencepiece | sparseml-nightly | sparsify | sympy | tenacity | tiktoken | tqdm | unitxt | vllm | wandb | zeno-client

Downloads last day: 7,546
Downloads last week: 122,834
Downloads last month: 468,015