PyPI page
Author:
Pavel Chizhov
Summary:
BPE modification that removes sparsely used intermediate tokens during vocabularisation.
Latest version:
1.3.1
Required dependencies:
heapdict
|
numpy
Downloads last day:
0
Downloads last week:
68
Downloads last month:
30
7-day smoothing