youtokentome

PyPI page
Home page
Author: Ivan Belonogov
License: MIT
Summary: Unsupervised text tokenizer focused on computational efficiency
Latest version: 1.0.6
Required dependencies: click

Downloads last day: 143
Downloads last week: 1,807
Downloads last month: 9,880