PyPI page
Home page
Author:
None
Summary:
Datamodels for HF tokenizers
Latest version:
0.4.0
Required dependencies:
protobuf
|
pydantic
|
regex
|
tokenizers
|
transformers
Optional dependencies:
ipython
|
model2vec
|
mypy
|
pre-commit
|
pytest
|
pytest-coverage
|
ruff
|
ty
Downloads last day:
162
Downloads last week:
738
Downloads last month:
3,526