PyPI page
Home page
Author:
Henry Hale
Summary:
A translation-grouped tokenizer: subwords that translate each other share a group
Latest version:
0.5.0
Required dependencies:
tokenizers
Optional dependencies:
datasets
|
mkdocs-material
|
mkdocstrings
|
pytest
|
torch
|
transformers
Downloads last day:
29
Downloads last week:
485
Downloads last month:
269
7-day smoothing