PyPI page
Home page
Author:
vectorize-io
Summary:
Fast, exact BPE tokenizer for OpenAI encodings — Rust core, tiktoken-identical ids
Latest version:
0.1.4
Optional dependencies:
numpy
Downloads last day:
5,258
Downloads last week:
25,750
Downloads last month:
88,135
7-day smoothing