PyPI page
Home page
Author:
Paweł Rubach
Summary:
The Kafka Slurm Agent is a distributed computing and stream processing engine that can be used to run python code acrossmultiple SLURM managed HPC clusters or individual workstations.It uses Kafka to asynchronously communicate with agents installed on clusters and workstations.It contains a monitoring tool with a Web JSON API and a job submitter.It is a pure Python implementation using faust stream processing
Latest version:
1.4.7
Required dependencies:
faust-streaming
|
kafka-python-ng
|
psutil
|
python-math
|
simple-slurm
|
werkzeug
|
wrapt-timeout-decorator
Downloads last day:
2
Downloads last week:
373
Downloads last month:
705