PyPI page
Home page
Author:
Knitli Inc.
Summary:
Ready-to-use tokenizers for CodeWeaver — tiktoken and HuggingFace tokenizers with a unified interface
Latest version:
0.1.0
Required dependencies:
tiktoken
|
tokenizers
|
typing-extensions
Optional dependencies:
pytest
|
pytest-cov
Downloads last day:
12
Downloads last week:
21
Downloads last month:
184