runtoken

PyPI page
Home page
Author: Thibault Jaigu
License: MIT
Summary: A blazing-fast BPE tokenizer for LLMs. Drop-in tiktoken replacement, 20-80x faster.
Latest version: 0.1.2


Downloads last day: 1
Downloads last week: 35
Downloads last month: 158