Search All packages Top packages Track packages
PyPI page Home page Author: None License: Apache-2.0 Summary: High performance BPE tokenizer written in Rust with Python bindings Latest version: 2.1.4 Downloads last day: 109 Downloads last week: 141 Downloads last month: 2,553