Javascript must be enabled to continue!
Docker container in DWD's Seamless INtegrated FOrecastiNg sYstem (SINFONY)
View through CrossRef
At Deutscher Wetterdienst (DWD) the SINFONY project has been set up to develop a seamless ensemble prediction system for convective-scale forecasting with forecast ranges of up to 12 hours. It combines Nowcasting (NWC) techniques with numerical weather prediction (NWP) in a seamless way for a number of applications. Historically the operational NWC and NWP forecasts are generated on separate IT-Infrastructures. To reduce data transfer between both infrastructures and to reduce the complexity of SINFONY those NWC components, which solely rely on NWP pre-products, are ported to the NWP infrastructure using software container.With this aim in view a container image containing all relevant NWC components is created in a CICD oriented procedure. The respective containers are integrated into DWD’s development and operational code bases and executed on DWD’s HPC using apptainer. The integration into DWD’s development code base is completed already and currently used for further development of the data assimilation procedure.A major innovation of SINFONY is the rapid update cycle (RUC), an hourly refreshing NWP procedure with a forecast range of 12 hours. Currently RUC is in a preoperational stage and subsequent calculations using NWC components together with the subsequent combination of RUC forecasts with NWC forecasts is still executed on the NWC infrastructure. The RUC will be implemented to the operational forecasting system at the end of 2024 and together with that our aim is to implement the containers to the RUC for two applications. At this step the containers have to meet even harder performance requirements and above that a reliable update and support workflow must be established, since it will then be part of Germanys national critical infrastructure.
Copernicus GmbH
Title: Docker container in DWD's Seamless INtegrated FOrecastiNg sYstem (SINFONY)
Description:
At Deutscher Wetterdienst (DWD) the SINFONY project has been set up to develop a seamless ensemble prediction system for convective-scale forecasting with forecast ranges of up to 12 hours.
It combines Nowcasting (NWC) techniques with numerical weather prediction (NWP) in a seamless way for a number of applications.
Historically the operational NWC and NWP forecasts are generated on separate IT-Infrastructures.
To reduce data transfer between both infrastructures and to reduce the complexity of SINFONY those NWC components, which solely rely on NWP pre-products, are ported to the NWP infrastructure using software container.
With this aim in view a container image containing all relevant NWC components is created in a CICD oriented procedure.
The respective containers are integrated into DWD’s development and operational code bases and executed on DWD’s HPC using apptainer.
The integration into DWD’s development code base is completed already and currently used for further development of the data assimilation procedure.
A major innovation of SINFONY is the rapid update cycle (RUC), an hourly refreshing NWP procedure with a forecast range of 12 hours.
Currently RUC is in a preoperational stage and subsequent calculations using NWC components together with the subsequent combination of RUC forecasts with NWC forecasts is still executed on the NWC infrastructure.
The RUC will be implemented to the operational forecasting system at the end of 2024 and together with that our aim is to implement the containers to the RUC for two applications.
At this step the containers have to meet even harder performance requirements and above that a reliable update and support workflow must be established, since it will then be part of Germanys national critical infrastructure.
Related Results
Comparative Analysis of Apache 2 Performance in Docker Containers vs Native Environment
Comparative Analysis of Apache 2 Performance in Docker Containers vs Native Environment
Web servers have become crucial to facilitate access to and distribute such content on the internet. In this case, Docker containerization technology offers a solution. Docker allo...
Analyse und Kommunikation der beobachteten Klimatrends in Deutschland
Analyse und Kommunikation der beobachteten Klimatrends in Deutschland
<p>Eine der Aufgaben des Deutschen Wetterdienstes ist die Klima&#252;berwachung f&#252;r Deutschland. Dazu verwendet der DWD die Daten der Wetterstati...
BGDMdocker: a Docker workflow for analysis and visualization pan-genome and biosynthetic gene clusters of bacterial
BGDMdocker: a Docker workflow for analysis and visualization pan-genome and biosynthetic gene clusters of bacterial
ABSTRACT
Motivation
At present Docker technology has received increasing level of attention throughout the bioinformatics commu...
Kommunikation des beobachteten Klimawandels in Deutschland
Kommunikation des beobachteten Klimawandels in Deutschland
<p>Eine der Aufgaben des Deutschen Wetterdienstes ist die Klima&#252;berwachung f&#252;r Deutschland. Dazu verwendet der DWD die Daten der Wetterstati...
Seamless Combination of Convective Cells from Nowcasting and NWP with KONRAD3D-SINFONY – Part 2: Verification and Visualization
Seamless Combination of Convective Cells from Nowcasting and NWP with KONRAD3D-SINFONY – Part 2: Verification and Visualization
KONRAD3D-SINFONY aims to improve the prediction of convective thunderstorms by integrating object-based nowcasting with ensemble forecasts from the high-resolution ICON-RUC model. ...
Progress in regional reanalyses of DWD and their use in energy applications
Progress in regional reanalyses of DWD and their use in energy applications
Germany’s national meteorological service (Deutscher Wetterdienst, DWD) has initiated the development of a regional reanalysis more than a decade ago by establishing the ...
Container Inventory Management: Factors Influencing Container Interchange
Container Inventory Management: Factors Influencing Container Interchange
Efficient and effective management of empty containers and empty container repositioning is an important issue in the liner shipping industry. Many alliance agreements of carriers ...
Coupling the Data-driven Weather Forecasting Model with 4D Variational Assimilation
Coupling the Data-driven Weather Forecasting Model with 4D Variational Assimilation
In recent years, the development of artificial intelligence has led to rapid advances in data-driven weather forecasting models, some of which rival or even surpass traditional met...

