PyPI page
Home page
Author:
OpenCompass Contributors
License:
Apache License 2.0
Summary:
A lightweight toolkit for evaluating LLMs based on OpenCompass.
Latest version:
0.1.6
Required dependencies:
absl-py
|
accelerate
|
cpm-kernels
|
dacite
|
datasets
|
einops
|
evaluate
|
func-timeout
|
fuzzywuzzy
|
h5py
|
human-eval
|
immutabledict
|
jieba
|
json5
|
mmengine-lite
|
nltk
|
numpy
|
openai
|
opencc
|
pandas
|
prettytable
|
protobuf
|
pypinyin
|
python-levenshtein
|
rank-bm25
|
rapidfuzz
|
requests
|
rich
|
rouge
|
rouge-chinese
|
rouge-score
|
sacrebleu
|
scikit-learn
|
seaborn
|
sentence-transformers
|
tabulate
|
tiktoken
|
timeout-decorator
|
tokenizers
|
torch
|
tqdm
|
transformers
|
typer
Optional dependencies:
absl-py
|
accelerate
|
alpaca-eval
|
anthropic
|
cn2an
|
cpm-kernels
|
dacite
|
dashscope
|
datasets
|
dingo-python
|
einops
|
evaluate
|
faiss-gpu
|
func-timeout
|
fuzzywuzzy
|
h5py
|
human-eval
|
immutabledict
|
jieba
|
json5
|
langdetect
|
latex2sympy2
|
ltp
|
mmengine-lite
|
nltk
|
numpy
|
openai
|
opencc
|
pandas
|
prettytable
|
protobuf
|
pyext
|
pypinyin
|
python-levenshtein
|
rank-bm25
|
rapidfuzz
|
requests
|
rich
|
rouge
|
rouge-chinese
|
rouge-score
|
sacrebleu
|
scikit-learn
|
seaborn
|
sentence-transformers
|
spark-ai-python
|
sseclient-py
|
tabulate
|
tencentcloud-sdk-python
|
tiktoken
|
timeout-decorator
|
tokenizers
|
torch
|
tqdm
|
transformers
|
typer
|
volcengine
|
volcengine-python-sdk
|
websocket-client
|
wonderwords
|
zhipuai
Downloads last day:
341
Downloads last week:
2,299
Downloads last month:
5,964