PyPI page
Author:
NVIDIA Inc.
License:
Apache-2.0
Summary:
Distributed Inference Framework
Latest version:
1.5.1
Required dependencies:
ai-dynamo-runtime
|
aiohttp
|
aisimulate
|
kubernetes
|
msgspec
|
prometheus-client
|
pyzmq
|
tqdm
|
transformers
|
typing-extensions
|
zstandard
Optional dependencies:
accelerate
|
blake3
|
cupy-cuda13x
|
librosa
|
mpmath
|
nixl
|
ray
|
sglang
|
soundfile
|
tensorrt-llm
|
uvloop
|
vllm
Downloads last day:
2,533
Downloads last week:
13,425
Downloads last month:
41,035
7-day smoothing