PyPI page
Home page
Author:
None
License:
MIT License
Copyright (c) 2023 Krystian Safjan
Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated do...
Summary:
Count number of tokens in text files using tiktoken tokenizer from OpenAI
Latest version:
0.8.2
Required dependencies:
tiktoken
Downloads last day:
1,432
Downloads last week:
10,135
Downloads last month:
44,554