bigcode-tokenizer

PyPI page
Home page
Author: Daniel Perez
License:
Summary: Tool to tokenize source code
Latest version: 0.1.0
Required dependencies: pygments
Optional dependencies: nose

Downloads last day: 0
Downloads last week: 5
Downloads last month: 16