PyPI page
Home page
Author:
None
License:
GNU GENERAL PUBLIC LICENSE
Version 3, 29 June 2007
Copyright (C) 2007 Free Software Foundation, Inc. <https://fsf.org/>
Everyone is permitted ...
Summary:
A Python library for tokenizing text and counting tokens using various encoding schemes.
Latest version:
1.9.0
Required dependencies:
chardet
|
colorlog
|
flake8
|
pytest
|
rich
|
tiktoken
Optional dependencies:
flake8
|
pytest
Downloads last day:
5
Downloads last week:
14
Downloads last month:
92