Unreal Engine for Remote Visualization and Machine Learning

6 Jun 2023, 09:00 → 7 Jun 2023, 16:00 Europe/Berlin

TBA (JSC)

Dirk Helmrich (Jülich Supercomputing Centre)

The Unreal Engine is one of the state-of-the-art 3D rendering engines, mainly used for game development. In recent years, however, its use in industry and science has been steadily increasing, which is further supported by new features from the producer Epic Games Inc. This course gives an in-depth training to using Unreal Engine as a data generator – by gaining measurements from virtual worlds. Using the ground truth data generated with this realistic rendering engine, projects gain more robust AI pipelines, insight into AI performance on quantifiable data, as well as measurements from virtual scenes with environmental conditions that can be manipulated. At the end of the course, participants have setup their own pipeline with Unreal Engine and a simple AI workflow in one of the leading supercomputing centres.

 

This is a hybrid course. We aim to provide all participants with a valuable experience, be it in-person or online.
 

This course is part of the JSC training courses as well as the Phenorob Graduate Program.

Machine Learning Material

• Machine Learning course and Deep Learning specialization by Andrew Ng et al.
• MIT "introduction to Deep Learning" Course
• Notebook-based course by Université Paris-Saclay

Tuesday, 6 June

1 Visualization Pipelines with Unreal Engine

Scalability, Generalization, Domain Visualization

Speaker: Dirk Helmrich (Jülich Supercomputing Centre)

12:00 Lunch at the Seecasino

2 PixelStreaming with Unreal Engine

Introduction into WebRTC concepts, connectivity, and HPC usability

Speaker: Dirk Helmrich (Jülich Supercomputing Centre)

Wednesday, 7 June

3 WebRTC for Computer Vision Pipelines

Encoding properties, setting up communication, including simulations, using data streams

Speaker: Dirk Helmrich (Jülich Supercomputing Centre)

12:00 Lunch at the Seecasino

4 Hands on: Building ML/AI Pipelines with Unreal Engine

Preparing the frameworks
Parsing and using data
Best practices

Speaker: Dirk Helmrich (Jülich Supercomputing Centre)