Name: Training: Process Mining and Scientific Workflows running on the HPC cluster

Event type: Workshop

Date: October 18, 2022

Time:  9am – 1pm

Format: Online

Target Audience: HPC users

Contact Person: Zahra Sadeghibogar

*More information* 

Desciption  

The goal of process mining is to turn event data into insights and actions. On the other side, there exist scientific workflows running on HPC clusters.

Now, how can we combine process mining and scientific workflows running on HPC clusters? The first idea is „Process mining on logs of execution of scientific workflows on HPC“. Process mining on previous executions of a workflow on an HPC system can be used to deduce certain parallel execution parameters such as the number of tasks, number of cores, dedicated memory, etc. So, here we can provide valuable insights and offer optimization ideas for running the tasks on the HPC cluster.

Currently, based on the analysis of the extracted event log, there is limited usage of SLURM as the workflow management system, which means that only a small fraction of accounts declare interdependencies between tasks. So here comes the second idea, which is implementing a workflow engine that runs workflow steps (jobs) on SLURM with correct interdependencies. The third idea could be enabling efficient and distributed execution of process mining operators on HPC clusters. That is to allow users to run process mining workflows on an HPC cluster.

Agenda 

8:45 – 9:00
Welcome

9:00 – 9:30
Talk 1: Introduction to Process Mining

9:30 – 10:00
Talk 2: Introduction to HPC challenges to process mining

10:00 – 10:30
Talk 3: Introduction to scientific workflows and workflow management systems

10:30 – 11:00
Break

11:00 – 11:30
Talk 3: The first idea: Process mining on logs of execution of scientific workflows on HPC

11:30 – 12:00
Talk 4: The second idea: Building a workflow engine to run workflow steps on the HPC cluster with correct interdependencies

12:00 – 12:30
Discussion

12:30 – 12:45
Conclusion