PyPI page
Home page
Author:
None
License:
Apache-2.0
Summary:
Distributed Inference Framework
Latest version:
1.4.0
Required dependencies:
ai-dynamo-runtime
|
aiohttp
|
kubernetes
|
msgspec
|
prometheus-client
|
pyzmq
|
transformers
|
typing-extensions
|
zstandard
Optional dependencies:
accelerate
|
aiconfigurator-core
|
blake3
|
cupy-cuda12x
|
librosa
|
mpmath
|
nixl
|
ray
|
sglang
|
soundfile
|
tensorrt-llm
|
uvloop
|
vllm
Downloads last day:
980
Downloads last week:
18,341
Downloads last month:
48,402