PyPI page
Home page
Author:
None
Summary:
DTensor-native pretraining and fine-tuning for LLMs/VLMs with day-0 Hugging Face support, GPU-acceleration, and memory efficiency.
Latest version:
0.4.0
Required dependencies:
datasets
|
flashoptim
|
megatron-fsdp
|
mistral-common
|
mlflow
|
opencv-python-headless
|
pybind11
|
pyyaml
|
qwen-vl-utils
|
tiktoken
|
torch
|
torchao
|
torchcodec
|
torchdata
|
transformers
|
wandb
Optional dependencies:
albumentations
|
backoff
|
bitsandbytes
|
causal-conv1d
|
databricks-sql-connector
|
deep_ep
|
deltalake
|
diffusers
|
flash-attn
|
ftfy
|
imageio
|
imageio-ffmpeg
|
kernels
|
mamba-ssm
|
mistral_common
|
nemo_automodel
|
numba
|
numpy
|
nv-grouped-gemm
|
onnxscript
|
open-clip-torch
|
opencv-python-headless
|
perceptron
|
pillow
|
pyyaml
|
qwen-omni-utils
|
sentencepiece
|
timm
|
torchvision
|
transformer-engine
Downloads last day:
367
Downloads last week:
2,918
Downloads last month:
4,019