bigcode-tokenizer
PyPI page
Home page
Author:
Daniel Perez
License:
Summary:
Tool to tokenize source code
Latest version:
0.1.0
Required dependencies:
pygments
Optional dependencies:
nose
Downloads last day:
0
Downloads last week:
5
Downloads last month:
16