PyPI page
Home page
Author:
sunnyboxs
License:
BSD
Summary:
This is a multilingual tokenization tool that currently supports for zh/ja/en/ko, and more languages.
Latest version:
0.2.0
Required dependencies:
numpy
|
py3langid
Downloads last day:
307
Downloads last week:
1,738
Downloads last month:
5,740