PyPI page
Home page
Author:
Common Crawl
License:
Apache License
Version 2.0, January 2004
http://www.apache.org/licenses/
TERMS AND CONDITIONS FOR USE, REPRODUCTI...
Summary:
Evaluate language identification models on CommonLID and other benchmarks.
Latest version:
0.2.2
Required dependencies:
datasets
|
fasttext-predict
|
huggingface-hub
|
iso639-lang
|
numpy
|
pandas
|
pycld2
|
pyfranc
|
regex
|
scikit-learn
|
tqdm
|
typer
Optional dependencies:
azure-identity
|
botocore
|
cld3-py
|
dspy
|
fsspec
|
gradio
|
jupyterlab
|
langid
|
matplotlib
|
mypy
|
nbclient
|
protobuf
|
pytest
|
pytest-cov
|
ruff
|
sentencepiece
|
torch
|
transformers
|
types-regex
|
types-tqdm
Downloads last day:
0
Downloads last week:
117
Downloads last month:
448