PyPI page
Home page
Author:
Schizo00
Summary:
Grapheme Pair Encoding Tokenizer for Sinhala Language
Latest version:
0.1.6.4
Required dependencies:
datasets
|
grapheme
|
huggingface-hub
|
joblib
|
regex
|
tokenizers
|
torch
|
transformers
Downloads last day:
0
Downloads last week:
4
Downloads last month:
96