PyPI page
Home page
Author:
None
Summary:
DTensor-native pretraining and fine-tuning for LLMs/VLMs with day-0 Hugging Face support, GPU-acceleration, and memory efficiency.
Latest version:
0.5.0
Required dependencies:
datasets
|
decord
|
flashoptim
|
megatron-fsdp
|
mistral-common
|
mlflow
|
pybind11
|
pyyaml
|
tiktoken
|
torch
|
torchao
|
torchdata
|
transformers
|
wandb
Optional dependencies:
apache-tvm-ffi
|
backoff
|
bitsandbytes
|
boto3
|
causal-conv1d
|
databricks-sql-connector
|
deep_ep
|
deltalake
|
diffusers
|
flash-attn
|
flash-linear-attention
|
ftfy
|
imageio
|
imageio-ffmpeg
|
kernels
|
mamba-ssm
|
mistral_common
|
multi-storage-client
|
nemo-run
|
nemo_automodel
|
numba
|
numpy
|
nv-grouped-gemm
|
onnxscript
|
open-clip-torch
|
opencv-python-headless
|
perceptron
|
pillow
|
pyyaml
|
qwen-omni-utils
|
qwen-vl-utils
|
sentencepiece
|
soundfile
|
tile-kernels
|
tilelang
|
timm
|
torchvision
|
transformer-engine
Downloads last day:
704
Downloads last week:
3,954
Downloads last month:
20,523