PyPI page
Home page
Author:
None
License:
MIT
Summary:
Flexible Wikipedia dataset builder with sampling and pretraining support
Latest version:
0.1.3
Required dependencies:
datasets
|
numpy
|
tokenizers
|
tqdm
|
transformers
Optional dependencies:
mypy
|
pytest
|
pytest-cov
|
ruff
Downloads last day:
12
Downloads last week:
90
Downloads last month:
125