bytetok

PyPI page
Home page
Author: Vihanga Malaviarachchi
License: MIT
Summary: A fast, modular and light-weight BPE tokenizer for NLP research and prototyping.
Latest version: 0.3.0
Required dependencies: regex

Downloads last day: 58
Downloads last week: 96
Downloads last month: 161