PyPI page
Home page
Author:
gweidart <gweidart@gmail.com>
License:
MIT
Summary:
A ridiculously fast Python BPE (Byte Pair Encoder) implementation written in Rust
Latest version:
0.1.0
Optional dependencies:
matplotlib
|
maturin
|
mypy
|
numpy
|
pytest
|
ruff
|
scikit-learn
|
tiktoken
|
tokenizers
|
tomli
Downloads last day:
750
Downloads last week:
4,608
Downloads last month:
21,915