pyonmttok

PyPI page
Home page
Author: OpenNMT
License: MIT
Summary: Fast and customizable text tokenization library with BPE and SentencePiece support
Latest version: 1.38.0


Downloads last day: 1,458
Downloads last week: 8,352
Downloads last month: 31,640