PyPI Stats

Search

All packages
Top packages

Track packages

lm-eval


PyPI page
Home page
Author: None
License: MIT
Summary: A framework for evaluating language models
Latest version: 0.4.7
Required dependencies: accelerate | datasets | dill | evaluate | jsonlines | more_itertools | numexpr | peft | pybind11 | pytablewriter | rouge-score | sacrebleu | scikit-learn | sqlitedict | torch | tqdm-multiprocess | transformers | word2number | zstandard
Optional dependencies: aiohttp | antlr4-python3-runtime | auto-gptq | causal-conv1d | deepsparse-nightly | emoji | fugashi | gptqmodel | hf_transfer | ibm_watsonx_ai | immutabledict | jieba | langdetect | lm_eval | mamba_ssm | mypy | nagisa | neologdn | nltk | numpy | optimum | pandas | pre-commit | promptsource | pycountry | pytest | pytest-cov | pytest-xdist | requests | rouge_score | sentencepiece | sparseml-nightly | sympy | tenacity | tiktoken | tqdm | vllm | wandb | zeno-client

Downloads last day: 3,456
Downloads last week: 55,269
Downloads last month: 218,790