mayatok

PyPI page
Home page
Author: Ashwin Rajhans
License: Apache-2.0
Summary: High performance BPE tokenizer written in Rust with Python bindings
Latest version: 2.1.4


Downloads last day: 0
Downloads last week: 4
Downloads last month: 61
7-day smoothing