PyPI page
Home page
Author:
LMMMs-Lab Evaluation Team
Summary:
A framework for evaluating large multi-modality language models
Latest version:
0.7.3
Required dependencies:
accelerate
|
aiohttp
|
av
|
datasets
|
einops
|
evaluate
|
ftfy
|
hf-transfer
|
httpx
|
jinja2
|
jsonlines
|
latex2sympy2
|
loguru
|
math-verify
|
mpmath
|
nltk
|
numexpr
|
numpy
|
openai
|
opencv-python-headless
|
openpyxl
|
packaging
|
peft
|
pillow
|
pre-commit
|
protobuf
|
pybind11
|
pycocoevalcap
|
pydantic
|
pytablewriter
|
python-dotenv
|
pyyaml
|
qwen-vl-utils
|
ruff
|
sacrebleu
|
scikit-learn
|
sentence-transformers
|
sentencepiece
|
sympy
|
tenacity
|
tiktoken
|
timm
|
torch
|
torchvision
|
tqdm-multiprocess
|
transformers
|
transformers-stream-generator
|
wandb
|
yt-dlp
|
zss
|
zstandard
Optional dependencies:
anls
|
beautifulsoup4
|
capture-metric
|
decord
|
duckduckgo-search
|
editdistance
|
eva-decord
|
fastapi
|
flagembedding
|
google-genai
|
httpx
|
langchain
|
langchain-community
|
levenshtein
|
librosa
|
litellm
|
lmms-eval
|
matplotlib
|
mcp
|
more-itertools
|
pdf2image
|
pdfplumber
|
playwright
|
pywsd
|
qwen-vl-utils
|
reka-api
|
requests
|
rouge
|
soundfile
|
spacy
|
swanlab
|
torchcodec
|
uvicorn
|
zhconv
Downloads last day:
271
Downloads last week:
1,078
Downloads last month:
4,408
7-day smoothing