PyPI page Home page
Author:
adam2go
License:
MIT
Summary:
tiktoken in pure Python: byte-for-byte compatible BPE tokenizer with no Rust extension
Latest version:
0.2.1
Downloads last day:
11
Downloads last week:
73
Downloads last month:
332
7-day smoothing