tokenizerz

PyPI page
Home page
Author: J Joe
Summary: Minimal BPE tokenizer in Zig
Latest version: 0.0.3
Required dependencies: jinja2 | ziglang

Downloads last day: 32
Downloads last week: 36
Downloads last month: 60