PyPI page
Home page
Author:
Krystian Safjan
License:
MIT License
Copyright (c) 2023 Krystian Safjan
Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated do...
Summary:
Count number of tokens in text files using tiktoken tokenizer from OpenAI
Latest version:
0.8.3
Required dependencies:
tiktoken
Downloads last day:
683
Downloads last week:
5,038
Downloads last month:
20,707
7-day smoothing