PyPI page
Home page
Author:
Peter Schneider-Kamp
Summary:
swiss army knife of scripts for transforming and processing datasets for machine learning.
Latest version:
0.6.10
Required dependencies:
click
|
datasets
|
isal
|
lz4
|
mosaicml-streaming
|
msgpack
|
orjson
|
python-snappy
|
torch
|
zstandard
Optional dependencies:
build
|
pytest
|
pytest-dependency
|
transformers
|
twine
Downloads last day:
52
Downloads last week:
137
Downloads last month:
166