turbobpe

PyPI page
Home page
Author: Amrendra Gupta
Summary: A fast BPE tokenizer, minbpe with CPython-accelerated core
Latest version: 0.1.1
Required dependencies: regex

Downloads last day: 38
Downloads last week: 62
Downloads last month: 2,887