evalscope

PyPI page
Home page
Author: ModelScope team
License: Apache License 2.0
Summary: EvalScope: Lightweight LLMs Evaluation Framework
Latest version: 1.6.0
Required dependencies: colorlog | docstring_parser | dotenv | editdistance | jieba | jinja2 | jsonlines | jsonschema | latex2sympy2_extended | markdown | modelscope | more_itertools | nltk | openai | overrides | pandas | pillow | plotly | pydantic | pylatexenc | pyyaml | requests | rich | rouge-chinese | rouge-score | sacrebleu | sympy | tabulate | tqdm | transformers | word2number | zhconv
Optional dependencies: aiohttp | apted | beautifulsoup4 | bfcl-eval | diffusers | distance | docutils | editdistance | emoji | fastapi | flask | gradio | harbor | iopath | jellyfish | jieba | jinja2 | jiwer | langchain | langchain-community | langchain-core | langchain-openai | langdetect | latex2sympy2_extended | lxml | matplotlib | ms-enclave | ms-opencompass | ms-vlmeval | mteb | myst_parser | nltk | numpy | omegaconf | open_clip_torch | opencv-python | peft | plotly | polygon3 | pycocoevalcap | pytest | pytest-cov | pythainlp | python-dotenv | python-levenshtein | ragas | recommonmark | rich | scikit-learn | seaborn | sphinx | sphinx-design | sphinxawesome-theme | sse_starlette | swebench | syllapy | tiktoken | torch | torchvision | transformers | unbabel-comet | uvicorn | webdataset | zss

Downloads last day: 1,550
Downloads last week: 15,918
Downloads last month: 37,757