PyPI page
License:
MIT
Summary:
Fast bare-bones BPE for modern tokenizer training
Latest version:
0.1.6
Required dependencies:
tiktoken
Optional dependencies:
black
|
pytest
|
pytest-cov
|
tokenizers
|
tqdm
Downloads last day:
52
Downloads last week:
396
Downloads last month:
913
7-day smoothing