PyPI page
Home page
Author:
ModelCloud
Summary:
A (nicer) tokenizer you want to use for model `inference` and `training`: with all known peventable `gotchas` normalized or auto-fixed.
Latest version:
0.0.6
Required dependencies:
transformers
Downloads last day:
453
Downloads last week:
3,390
Downloads last month:
13,041