lexibyte

PyPI page
Home page
Author: Bibek Dhakal
Summary: A production-grade, from-scratch implementation of a Byte-Pair Encoding (BPE) tokenizer.
Latest version: 0.3.1
Required dependencies: regex

Downloads last day: 0
Downloads last week: 5
Downloads last month: 44
7-day smoothing