PyPI page
Summary:
Data mixtures for LLM pretraining that you can reproduce and trace
Latest version:
0.1.3
Required dependencies:
blake3
|
datasets
|
datatrove
|
einops
|
fasteners
|
fasttext-numpy2-wheel
|
fasttext-wheel
|
fsspec
|
ipython
|
marin-dupekit
|
numpy
|
packaging
|
protobuf
|
pyarrow
|
pyroaring
|
regex
|
sentence-transformers
|
spacy
|
tldextract
|
tokenizers
|
torch
|
transformers
Downloads last day:
2
Downloads last week:
27
Downloads last month:
328
7-day smoothing