PyPI page
Home page
Author:
Takuya Akiba
License:
MIT License Copyright (c) 2023 Takuya Akiba Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal...
Summary:
Supercharge Your LLM Training with Checkpointable Data Loading
Latest version:
0.1.0.dev20231107
Required dependencies:
braceexpand
|
numpy
|
smart-open
|
torch
Optional dependencies:
black
|
blackdoc
|
cbor2
|
flake8
|
isort
|
mosaicml-streaming
|
mypy
|
pytest
|
sentencepiece
|
transformers
Downloads last day:
0
Downloads last week:
10
Downloads last month:
32