evalscope

PyPI page
Home page
Author: ModelScope team
Summary: EvalScope: Lightweight LLMs Evaluation Framework
Latest version: 1.9.0
Required dependencies: aiohttp | colorlog | docstring_parser | dotenv | editdistance | jieba | jinja2 | jsonlines | jsonschema | latex2sympy2_extended | litellm | markdown | modelscope | more_itertools | nltk | openai | overrides | pandas | pillow | plotly | pydantic | pylatexenc | pyyaml | requests | rich | rouge-chinese | rouge-score | sacrebleu | sympy | tabulate | tqdm | transformers | uvloop | word2number | zhconv
Optional dependencies: aiohttp | apted | beautifulsoup4 | bfcl-eval | datacurve-pier | diffusers | distance | docutils | editdistance | emoji | fastapi | flask | harbor | instructor | iopath | jellyfish | jieba | jinja2 | jiwer | langchain | langchain-community | langchain-core | langchain-huggingface | langchain-openai | langdetect | latex2sympy2_extended | lpips | lxml | matplotlib | mcp | mcp-server-fetch | modelscope | ms-enclave | ms-opencompass | ms-vlmeval | mteb | myst_parser | nltk | numpy | omegaconf | open_clip_torch | openai | opencv-python | peft | pillow | plotly | polygon3 | pycocoevalcap | pytest | pytest-cov | pythainlp | python-dotenv | python-levenshtein | ragas | recommonmark | rich | scikit-learn | seaborn | sentence-transformers | shapely | soundfile | sphinx | sphinx-design | sphinxawesome-theme | sse_starlette | swebench | syllapy | tiktoken | torch | torchvision | transformers | unbabel-comet | unstructured | uvicorn | webdataset | zss

Downloads last day: 2,056
Downloads last week: 10,155
Downloads last month: 37,621