PyPI page
Author:
Jing Hua
License:
CC0 1.0 Universal
Summary:
A Lightweight Word Piece Tokenizer
Latest version:
1.0.1
Optional dependencies:
transformers
Downloads last day:
2
Downloads last week:
70
Downloads last month:
453
7-day smoothing