PyPI page
Home page
Author:
Code-Yay-Mal
Summary:
A Unigram tokenizer for Mon (mnw), Burmese and English, with full byte fallback
Latest version:
1.0.1
Required dependencies:
regex
|
tokenizers
Optional dependencies:
click
|
rich
Downloads last day:
4
Downloads last week:
37
Downloads last month:
58
7-day smoothing