PyPI page
Home page
Author:
chandralegend
License:
MIT
Summary:
Python package that provides tokenization of multilingual texts using language-specific tokenizers
Latest version:
0.1.4
Required dependencies:
lingua-language-detector
|
tokenizers
Downloads last day:
25
Downloads last week:
28
Downloads last month:
51