{"id":7192,"date":"2024-09-06T11:06:58","date_gmt":"2024-09-06T09:06:58","guid":{"rendered":"https:\/\/blog.rwth-aachen.de\/itc-events\/?post_type=tribe_events&p=7192"},"modified":"2025-02-18T11:13:14","modified_gmt":"2025-02-18T10:13:14","slug":"aixcelerate-2024","status":"publish","type":"tribe_events","link":"https:\/\/blog.rwth-aachen.de\/itc-events\/en\/event\/aixcelerate-2024\/","title":{"rendered":"aiXcelerate 2024"},"content":{"rendered":"

in cooperation with<\/p>\n\n\n\n
\"HPC.NRW<\/a><\/th>\n\"European<\/a><\/th>\n\"KI-Servicezentrum<\/a><\/th>\n<\/tr>\n<\/tbody>\n<\/table>\n

 <\/p>\n

\"\"<\/h2>\n

Topic: Machine Learning on NVIDIA GPUs<\/h1>\n

<\/h2>\n

Description<\/h2>\n

The annual event aiXcelerate at RWTH Aachen University (NHR4CES@RWTH) is a tuning workshop for HPC users. It comprises lectures that are open to everyone, and hands-on parts where (invited) groups apply the learned concepts to their own codes. This year, aiXcelerate covers the topic “Machine Learning (ML) on NVIDIA GPUs” and focuses on using the GPUs of RWTH’s HPC cluster “CLAIX” with frameworks such as PyTorch or Tensorflow. This workshop provides insights to performance analysis and performance tuning of ML codes (and is not<\/em> an introduction to ML). aiXcelerate will take place with the support of NVIDIA from December 9th to 11th, 2024. Catering is sponsored by NEC and NVIDIA.<\/p>\n

Presentations (open to everyone)<\/h3>\n

The talks are distributed across the morning sessions of the three days of aiXcelerate. The topic of the first day is “Analyzing Performance of ML Codes” and covers the usage of the automatically-running RWTH performance monitoring system, as well as the usage of NVIDIA’s Nsight tool and how to find bottlenecks with it. The second day focuses on “Scaling ML Codes across Multiple GPUs\/ Nodes”. Here, approaches with PyTorch (Distributed) and Tensorflow + Horovod are presented to speedup ML codes by using more hardware in parallel. On the third day, we will look at “Handling Datasets of ML Codes”. We will present the different options for storing and using ML data during runtime (on CLAIX). Furthermore, the usage of check pointing in ML codes will be introduced to save the application’s state in certain intervals to provide fault tolerance.<\/p>\n

Talks are offered in a hybrid<\/strong> form: The presenters will do their talks in-person<\/strong> on the premises of the IT Center at RWTH Aachen University. Thus, participants are very welcome to attend the presentations in-person, too. Additionally, presentations will be streamed live in online<\/strong> form. Hence, participants can also attend remotely. Participants need to choose their setup (on-premise or online) during the registration process.<\/p>\n

Code & Tuning Activities (limited seats)<\/h3>\n

The sessions on “Code and Tuning Activities” (see agenda) target at users with their own ML codes (e.g., using PyTorch or Tensorflow) and follow the principle of bring-your-own (BYO) code. Participants of these sessions will closely work together with and get support by our HPC\/ML experts to, e.g., analyze the performance of their codes, to tune the performance of their codes, to scale their codes across multiple GPUs, or to improve data handling of their codes.<\/p>\n

Code and tuning activities are scheduled for all three days of the aiXcelerate workshop to have sufficient time to work on the BYO codes. They start after the presentations in the late morning session and continue throughout the remainder of the day. Since participants will work together with our experts, this part can only be attended in-person <\/strong>and on-premise<\/strong>.<\/p>\n

This part focuses on ML users working on the RWTH HPC cluster CLAIX. We (will) invite ML users with suitable compute time projects on CLAIX. Nevertheless, other interested people are also welcome to register for this part of the workshop. However, since seats are limited, we reserve the right to only accept certain projects\/ users for this workshop part.<\/p>\n

Requirements<\/h4>\n

To make good use of the time with our HPC\/ML experts, it is necessary that…<\/p>\n