PyPI page
Home page
Author:
chandralegend
License:
MIT
Summary:
Python package that provides tokenization of multilingual texts using language-specific tokenizers
Latest version:
0.1.4
Required dependencies:
lingua-language-detector
|
tokenizers
Downloads last day:
3
Downloads last week:
13
Downloads last month:
107