bigcode-tokenizer

PyPI page
Home page
Author: Daniel Perez
License:
Summary: Tool to tokenize source code
Latest version: 0.1.0
Required dependencies: pygments
Optional dependencies: nose

Downloads last day: 2
Downloads last week: 10
Downloads last month: 27