PyPI page
Home page
Author:
Shantanu Jain
License:
MIT License Copyright (c) 2022 OpenAI, Shantanu Jain Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software")...
Summary:
tiktoken-async is a fast BPE tokeniser for use with OpenAI's models, with added support for asynchronous processing.
Latest version:
0.3.2
Required dependencies:
httpx
|
regex
Optional dependencies:
blobfile
Downloads last day:
109
Downloads last week:
453
Downloads last month:
1,509