PyPI page
Home page
Author:
Stanford CRFM, NVIDIA
License:
Apache License 2.0
Summary:
NVIDIA: Benchmark for language models - Fork of Stanford CRFM HELM
Latest version:
25.10
Required dependencies:
bottle
|
cattrs
|
colorlog
|
dacite
|
datasets
|
diskcache
|
importlib-resources
|
mako
|
murmurhash
|
nemo-evaluator
|
nltk
|
numpy
|
pandas
|
preshed
|
pyarrow
|
pyarrow-hotfix
|
pyhocon
|
python-docx
|
retrying
|
rouge-score
|
scikit-learn
|
scipy
|
spacy
|
spacy-legacy
|
spacy-loggers
|
srsly
|
torch
|
torchvision
|
tqdm
|
transformers
|
uncertainty-calibration
|
zstandard
Optional dependencies:
accelerate
|
ai2-olmo
|
aiohttp
|
aleph-alpha-client
|
anthropic
|
awscli
|
bert-score
|
boto3
|
botocore
|
bottle
|
cohere
|
colorcet
|
datasets
|
einops
|
einops-exts
|
evaluate
|
fairlearn
|
flask
|
gdown
|
gin-config
|
google-api-python-client
|
google-cloud-aiplatform
|
gradio_client
|
gunicorn
|
httpx
|
huggingface-hub
|
immutabledict
|
jieba
|
langdetect
|
lxml
|
matplotlib
|
mistralai
|
nltk
|
numba
|
numpy
|
open-clip-torch
|
openai
|
opencc
|
openpyxl
|
pandas
|
parameterized
|
pillow
|
protobuf
|
psutil
|
pyarrow
|
pyarrow-hotfix
|
pydantic
|
pymongo
|
pyonmttok
|
pypinyin
|
pythainlp
|
python-crfsuite
|
python-dateutil
|
python-docx
|
python-dotenv
|
pytrec_eval
|
pyyaml
|
regex
|
reka-api
|
requests
|
retrying
|
rich
|
rouge_score
|
sacrebleu
|
scaleapi
|
scikit-learn
|
scipy
|
seaborn
|
sentencepiece
|
setuptools
|
simple-slurm
|
six
|
smart-open
|
spacy
|
structlog
|
surge-api
|
sympy
|
tiktoken
|
together
|
tokenizers
|
toml
|
torch
|
torchvision
|
tqdm
|
transformers
|
transformers_stream_generator
|
triton
|
typer
|
typing_extensions
|
uncertainty-calibration
|
unidecode
|
websocket-client
|
writerai
|
xlrd
|
xmltodict
|
yq
|
zstandard
Downloads last day:
0
Downloads last week:
15
Downloads last month:
31