PyPI page
Home page
Author:
None
Summary:
DOM-aware tokenization for 🤗 Hugging Face language models
Latest version:
0.0.17
Required dependencies:
python-magic
|
tokenizers
|
unidecode
Optional dependencies:
build
|
datasets
|
flake8
|
flake8-custom-import-rules
|
flake8-quotes
|
pillow
|
pytest
|
pytest-cov
|
transformers
Downloads last day:
0
Downloads last week:
35
Downloads last month:
84