PyPI page
Home page
Author:
None
License:
MIT License
Copyright (c) 2023 Krystian Safjan
Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated do...
Summary:
Count number of tokens in text files using tiktoken tokenizer from OpenAI
Latest version:
0.8.3
Required dependencies:
tiktoken
Downloads last day:
1,286
Downloads last week:
10,172
Downloads last month:
45,090