PyPI page
Home page
Author:
ziqi-wlb
License:
MIT
Summary:
A comprehensive dataset conversion toolkit for transforming between different dataset formats
Latest version:
0.1.1
Required dependencies:
click
|
megatron-core
|
numpy
|
rich
|
torch
|
tqdm
|
transformers
|
webdataset
Optional dependencies:
black
|
flake8
|
isort
|
mypy
|
pytest
|
pytest-cov
Downloads last day:
8
Downloads last week:
24
Downloads last month:
34