PyPI page
Home page
Author:
None
License:
MIT
Summary:
Fast bare-bones BPE for modern tokenizer training
Latest version:
0.1.6
Required dependencies:
tiktoken
Optional dependencies:
black
|
pytest
|
pytest-cov
|
tokenizers
|
tqdm
Downloads last day:
5
Downloads last week:
58
Downloads last month:
477