PyPI page
Home page
Author:
None
License:
Apache-2.0
Summary:
Distributed Inference Framework
Latest version:
1.1.0
Required dependencies:
ai-dynamo-runtime
|
kubernetes
|
msgpack
|
msgspec
|
prometheus-client
|
pyzmq
|
transformers
Optional dependencies:
aiconfigurator
|
blake3
|
cupy-cuda12x
|
librosa
|
nixl
|
ray
|
sglang
|
soundfile
|
tensorrt-llm
|
uvloop
|
vllm
Downloads last day:
414
Downloads last week:
4,066
Downloads last month:
57,430