tokenization-scorer

PyPI page
Author: Vilém Zouhar
License: MIT License
Summary: Package for evaluating text tokenizations.
Latest version: 1.1.8
Required dependencies: numpy | tqdm

Downloads last day: 3
Downloads last week: 25
Downloads last month: 103
7-day smoothing