PyPI page
Home page
Author:
DatologyAI Team
Summary:
Fast Rust tokenization without Python garbage collection slowdowns
Latest version:
1.0.2
Required dependencies:
pyarrow
|
tokenizers
Downloads last day:
27
Downloads last week:
362
Downloads last month:
958