qwen-tokenizer

PyPI page
Home page
Author: None
License: MIT
Summary: Lightweight tokenizer for qwen.
Latest version: 0.2.0
Required dependencies: tiktoken

Downloads last day: 219
Downloads last week: 1,436
Downloads last month: 4,507