PyPI page
Home page
Author:
DatologyAI Team
Summary:
Fast Rust tokenization without Python garbage collection slowdowns
Latest version:
1.0.2
Required dependencies:
pyarrow
|
tokenizers
Downloads last day:
11
Downloads last week:
78
Downloads last month:
142