faster-tokenizers

PyPI page
Home page
Author: PaddlePaddle Speech and Language Team
License: Apache 2.0
Summary: PaddleNLP Faster Tokenizer Library written in C++
Latest version: 0.1.1

Optional dependencies: pytest

Downloads last day: 36
Downloads last week: 92
Downloads last month: 111