PyPI page
Home page
Author:
Shantanu Jain
License:
MIT License
Copyright (c) 2022 OpenAI, Shantanu Jain
Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associa...
Summary:
tiktoken is a fast BPE tokeniser for use with OpenAI's models
Latest version:
0.12.0
Required dependencies:
regex
|
requests
Optional dependencies:
blobfile
Downloads last day:
1,465,036
Downloads last week:
16,769,767
Downloads last month:
70,096,444