PyPI page
Home page
Author:
Vihanga Malaviarachchi
License:
MIT
Summary:
A fast, modular and light-weight BPE tokenizer for NLP research and prototyping.
Latest version:
0.4.0
Required dependencies:
regex
Downloads last day:
1
Downloads last week:
60
Downloads last month:
338
7-day smoothing