Introduction to parallel programming with MPI and OpenMP

14 Aug 2023, 09:00 → 18 Aug 2023, 16:30 Europe/Berlin

Jülich Supercomputing Centre, building 16.3, room 213a (Ausbildungsraum 1)

This course will take place as an on-site and in-person event. It is not possible to attend online.

An introduction to the parallel programming of supercomputers is given. The focus is on the usage of the Message Passing Interface (MPI), the most often used programming model for systems with distributed memory. Furthermore, OpenMP will be presented, which is often used on shared-memory architectures.

The first four days of the course consist of lectures and short exercises. A fifth day is devoted to demonstrating the use of MPI and OpenMP in a larger context. To this end, starting from a simple but representative serial algorithm, a parallel version will be designed and implemented using the techniques presented in the course.

Topics covered will include

• Fundamentals of Parallel Computing
• MPI (basics, point-to-point communication, collective communication, derived data types, I/O, communicators, thread compliance)
• OpenMP (parallel construct, data sharing, loop work sharing, task work sharing)

Prerequisites

knowledge about Linux (e.g. make, command line editor, Linux shell), experience in one of the following programming languages C/C++/Fortran/Python

Language:

This course is given in English.

Date:

14 - 18 August 2023, 09:00-16:30 each day

Instructors

Chew Junxian, Ilya Zhukov, Jolanta Zjupa (JSC)

Contact 

For any questions concerning the course, please send an e-mail to i.zhukov@fz-juelich.de and j.zjupa@fz-juelich.de
 

Monday, 14 August

09:00 → 10:00 Welcome & Technical Setup

10:00 → 10:30 Break

10:30 → 12:00 Fundamentals of Parallel Computing

Speaker: Mr Ilya Zhukov (JSC)

12:00 → 13:00 Lunch

13:00 → 14:30 Introduction to OpenMP

Speaker: Jolanta Zjupa (JSC/FZJ)

14:30 → 15:00 Break

15:00 → 16:30 OpenMP

Speaker: Jolanta Zjupa (JSC/FZJ)

Tuesday, 15 August

09:00 → 09:30 Introduction to MPI

Speaker: Mr Ilya Zhukov (JSC)

09:30 → 10:30 Blocking P2P Communication

Speaker: Mr Ilya Zhukov (JSC)

10:30 → 11:00 Break

11:00 → 12:30 Nonblocking P2P Communication

Speaker: Mr Ilya Zhukov (JSC)

12:30 → 13:30 Lunch

13:30 → 14:30 Blocking Collective Communication

Speaker: Jolanta Zjupa (JSC/FZJ)

14:30 → 15:00 Break

15:00 → 16:30 Nonblocking Collective Communication

Speaker: Jolanta Zjupa (JSC/FZJ)

Wednesday, 16 August

09:00 → 10:30 Derived Datatypes

Speaker: Junxian Chew (Jülich Supercomputer Centre, Forschungszentrum Jülich)

10:30 → 11:00 Break

11:00 → 12:30 Derived Datatypes

Speaker: Junxian Chew (Jülich Supercomputer Centre, Forschungszentrum Jülich)

12:30 → 13:30 Lunch

13:30 → 14:30 I/O

Speaker: Junxian Chew (Jülich Supercomputer Centre, Forschungszentrum Jülich)

14:30 → 15:00 Break

15:00 → 16:30 I/O

Speaker: Junxian Chew (Jülich Supercomputer Centre, Forschungszentrum Jülich)

Thursday, 17 August

09:00 → 10:30 Communicators

Speaker: Mr Ilya Zhukov (JSC)

10:30 → 11:00 Break

11:00 → 12:30 Thread Compliance

Speaker: Mr Ilya Zhukov (JSC)

12:30 → 13:30 Lunch

13:30 → 14:30 Tools / MUST

Speaker: Michael Knobloch (Forschungszentrum Jülich GmbH)

14:30 → 15:00 Break

15:00 → 16:30 Tools / MUST

Speaker: Michael Knobloch (Forschungszentrum Jülich GmbH)

Friday, 18 August

09:00 → 10:30 Hands-On Tutorial

10:30 → 11:00 Break

11:00 → 12:30 Hands-On Tutorial

12:30 → 13:30 Lunch

13:30 → 14:30 Hands-On Tutorial

14:30 → 15:00 Break

15:00 → 16:30 Hands-On Tutorial