PyPI page
Home page
Author:
None
License:
Apache 2.0
Summary:
NeMo Export and Deploy - a library to export and deploy LLMs and MMs
Latest version:
0.6.0
Required dependencies:
accelerate
|
cloudpickle
|
decord
|
einops
|
fastapi
|
fiddle
|
flashinfer-python
|
hydra-core
|
ijson
|
lightning
|
megatron-bridge
|
megatron-core
|
nvidia-modelopt
|
nvidia-pytriton
|
nvidia-resiliency-ext
|
omegaconf
|
peft
|
pillow
|
pyarrow
|
pydantic-settings
|
pyparsing
|
ray
|
sentencepiece
|
tensorstore
|
tiktoken
|
torch
|
torchmetrics
|
torchvision
|
transformer-engine
|
uvicorn
|
wandb
|
webdataset
|
zarr
Optional dependencies:
onnx
|
onnxscript
|
pandas
|
tensorrt
|
timm
|
transformers
|
vllm
Downloads last day:
21
Downloads last week:
87
Downloads last month:
359