PyPI page
Home page
Author:
None
License:
Apache-2.0
Summary:
Distributed Inference Framework
Latest version:
1.2.1
Required dependencies:
ai-dynamo-runtime
|
aiohttp
|
kubernetes
|
msgpack
|
msgspec
|
prometheus-client
|
pyzmq
|
transformers
|
typing-extensions
Optional dependencies:
aiconfigurator
|
blake3
|
cupy-cuda12x
|
librosa
|
nixl
|
ray
|
sglang
|
soundfile
|
tensorrt-llm
|
uvloop
|
vllm
Downloads last day:
1,267
Downloads last week:
7,682
Downloads last month:
33,448