May 21 – 22, 2024
Europe/Berlin timezone

This course will take place as an online event. The link to the streaming platform will be provided to the registrants only.

The Unreal Engine is one of the state-of-the-art 3D rendering engines, mainly used for game development. In recent years, however, its use in industry and science has been steadily increasing, which is further supported by new features from the producer Epic Games Inc.

This course explores the visualization of models, particularly Functional-Structural Plant Models, to improve experimental pipelines as well as the scalability of Deep Neural Networks. Synthetic data has already proven to be successful in overcoming certain aspects of data scarcity. This course will primarily shed light onto the use of the Synavis Framework for plant sciences, the use of synthetic data as well as the combination of modeling virtual worlds with experimental data acquisition. Participants will learn what synthetic data is, what it might be used for, and how it affects the training of neural networks. The course will also give an overview of research projects using synthetic data as well as technical aspects of generation. Moreover, the course will touch on digital twin modelling and best-practices on how realistic synthetic data must be to be of use.


  • Visualization pipelines with Unreal Engine
    • Scalability, Generalization, Domain Visualization
  • Using Pixel Streaming for Remote Visualization
    • Introduction into WebRTC concepts, connectivity, and HPC usability
  • Building an AI/ML pipeline from WebRTC
    • Preparing the frameworks
    • Parsing and using data
    • Best practices


  • Basic knowledge of Machine Learning
  • This course should be visited with previous knowledge of Unreal Engine. While it provides some insight into how Unreal Engine work, it is not to be understood as an introduction. We refer to our in-house course “Introduction to Unreal Engine”, which typically takes place in March each year.



This course is given in English.


21-22 May 2024, 09:00-12:00, 13:00-16:00

!! Course dates changes !!


Online: via Zoom.


To be well prepared, we ask you to install the Unreal Engine 5.2.* and a C++ Development IDE such as Visual Studio 2022 upfront. Details are available on, where we are updating information as problems and questions arise.

Further information:

please visit the the document


Dirk Helmrich, JSC

Registration for this event is currently open.