PyPI page
Author:
Amit Moryossef
Summary:
True UTF-8 tokenizer for byte level models
Latest version:
0.8.5
Required dependencies:
torch
|
transformers
Optional dependencies:
datasets
|
evaluate
|
numba
|
pytest
|
pytest-xdist
|
ruff
|
scikit-learn
|
wandb
Downloads last day:
4
Downloads last week:
572
Downloads last month:
209
7-day smoothing