Introduction to parallel programming with MPI and OpenMP

18 Mar 2024, 09:00 → 20 Mar 2024, 17:00 Europe/Berlin

Jülich Supercomputing Centre, building 16.3, room 213a (Ausbildungsraum 1)

This course will take place as an on-site and in-person event. It is not possible to attend online.

An introduction to the parallel programming of supercomputers is given. The focus is on the usage of the Message Passing Interface (MPI), the most often used programming model for systems with distributed memory. Furthermore, OpenMP will be presented, which is often used on shared-memory architectures.

The three day course consist of lectures as well as practical tutorials on implementing the techniques presented in the course.

Topics covered will include

• Fundamentals of Parallel Computing (incl. HPC system architectures, shared and distributed memory concepts)
• MPI (basics, point-to-point communication, collective communication, blocking and non-blocking)
• OpenMP (basics, parallel construct, data sharing, loop work sharing, task work sharing)

Prerequisites

knowledge about Linux (e.g. make, command line editor, Linux shell), experience in one of the following programming languages C/C++/Fortran/Python

Language:

This course is given in English.

Date:

18 - 20 March 2024, 09:00-17:00 each day

Instructors

Chew Junxian, Ilya Zhukov, Jolanta Zjupa (JSC)

Registration deadline

Monday 11.March 12.00 AM.

After registration deadline please get in touch with the course organisers if you are interested to join the course.

Contact 

For any questions concerning the course, please send an e-mail to i.zhukov@fz-juelich.de and j.zjupa@fz-juelich.de
 

Monday, 18 March

09:00 → 09:30 Welcome & Technical Setup

Speaker: Jolanta Zjupa (JSC/FZJ)

09:30 → 10:30 Fundamentals of Parallel Computing

Speaker: Jolanta Zjupa (JSC/FZJ)

fundamentals.pdf

10:30 → 11:00 Break

11:00 → 12:30 Introduction to OpenMP

Speaker: Ilya Zhukov (JSC)

openmp.pdf

12:30 → 13:30 Lunch

13:30 → 15:00 Introduction to OpenMP

Speaker: Ilya Zhukov (JSC)

15:00 → 15:30 Break

15:30 → 17:00 Hands-On

Tuesday, 19 March

09:00 → 10:30 Introduction to MPI & Blocking P2P Communication

Speaker: Jolanta Zjupa (JSC/FZJ)

mpi_p2p.pdf

10:30 → 11:00 Break

11:00 → 12:30 Nonblocking P2P Communication

Speaker: Jolanta Zjupa (JSC/FZJ)

12:30 → 13:30 Lunch

13:30 → 15:00 Hands-on

15:00 → 15:30 Break

15:30 → 17:00 Hands-On

Wednesday, 20 March

09:00 → 10:30 Blocking Collective Communication

Speaker: Junxian Chew (Jülich Supercomputer Centre, Forschungszentrum Jülich)

mpi_collectives.pdf

10:30 → 11:00 Break

11:00 → 12:30 Nonblocking Collective Communication

Speaker: Junxian Chew (Jülich Supercomputer Centre, Forschungszentrum Jülich)

12:30 → 13:30 Lunch

13:30 → 15:00 Hands-On

15:00 → 15:30 Break

15:30 → 17:00 MUST (incl Hands-On)

Speaker: Michael Knobloch (Forschungszentrum Jülich GmbH)

tools.pdf