crfm-helm

PyPI page
Home page
Author: Stanford CRFM
License: Apache License 2.0
Summary: Benchmark for language models
Latest version: 0.5.5
Required dependencies: bottle | cattrs | dacite | datasets | importlib-resources | mako | nltk | numpy | pandas | pyarrow | pyarrow-hotfix | pyhocon | retrying | rouge-score | scikit-learn | scipy | spacy | sqlitedict | torch | torchvision | tqdm | transformers | uncertainty-calibration | zstandard
Optional dependencies: accelerate | ai2-olmo | aleph-alpha-client | anthropic | autokeras | awscli | bert-score | black | boto3 | botocore | clip-anytorch | cohere | colorcet | crfm-helm | diffusers | einops | einops-exts | evaluate | fairlearn | ffmpeg-python | flake8 | flax | ftfy | gdown | google-api-python-client | google-cloud-aiplatform | google-cloud-storage | google-cloud-translate | gradio_client | gunicorn | html2text | httpx | ibm-watsonx-ai | icetk | imagehash | immutabledict | jax | jaxlib | jieba | jiwer | langchain | langdetect | latex | librosa | lpips | lxml | matplotlib | mistralai | multilingual-clip | mypy | nudenet | numba | omegaconf | open-clip-torch | openai | openai-whisper | opencc | opencv-python | openpyxl | pdf2image | pillow | pre-commit | pycocoevalcap | pydantic | pydub | pymongo | pyonmttok | pypinyin | pytest | pythainlp | python-crfsuite | python-docx | pytorch-fid | pytorch-lightning | pytrec_eval | qwen-vl-utils | rapidfuzz | reka-api | sacrebleu | scaleapi | scikit-image | scipy | seaborn | selenium | sentencepiece | simple-slurm | soundfile | summ-eval | surge-api | sympy | tensorflow | tiktoken | timm | together | tokenizers | torch | torch-fidelity | torchmetrics | torchvision | transformers | transformers_stream_generator | unidecode | wandb | websocket-client | xlrd

Downloads last day: 106
Downloads last week: 746
Downloads last month: 2,434