Preprints
https://doi.org/10.5194/npg-2020-38
https://doi.org/10.5194/npg-2020-38

  25 Sep 2020

25 Sep 2020

Review status: a revised version of this preprint was accepted for the journal NPG and is expected to appear here in due course.

Training a convolutional neural network to conserve mass in data assimilation

Yvonne Ruckstuhl1, Tijana Janjić1, and Stephan Rasp2 Yvonne Ruckstuhl et al.
  • 1Meteorological Institute Munich, Ludwig-Maximilians-Universität München, Germany
  • 2ClimateAi, San Francisco, USA

Abstract. In previous work, it was shown that preservation of physical properties in the data assimilation framework can significantly reduce forecasting errors. Proposed data assimilation methods, such as the quadratic programming ensemble (QPEns) that can impose such constraints on the calculation of the analysis, are computationally more expensive, severely limiting their application to high dimensional prediction systems as found in earth sciences. In order to produce from a less computationally expensive, unconstrained analysis, a solution that is closer to the constrained analysis, we propose to use a convolutional neural network (CNN) trained on analyses produced by the QPEns. In this paper, we focus on conservation of mass and show in an idealized setup that the hybrid of a CNN and the ensemble Kalman filter is capable of reducing analysis and background errors to the same level as the QPEns. To obtain these positive results, it was in one case necessary to add a penalty term to the loss function of the CNN training process.

Yvonne Ruckstuhl et al.

Yvonne Ruckstuhl et al.

Yvonne Ruckstuhl et al.

Viewed

Total article views: 796 (including HTML, PDF, and XML)
HTML PDF XML Total BibTeX EndNote
690 102 4 796 10 9
  • HTML: 690
  • PDF: 102
  • XML: 4
  • Total: 796
  • BibTeX: 10
  • EndNote: 9
Views and downloads (calculated since 25 Sep 2020)
Cumulative views and downloads (calculated since 25 Sep 2020)

Viewed (geographical distribution)

Total article views: 626 (including HTML, PDF, and XML) Thereof 622 with geography defined and 4 with unknown origin.
Country # Views %
  • 1
1
 
 
 
 
Latest update: 25 Jan 2021
Download
Short summary
The assimilation of observations using standard algorithms can lead to violation of physical laws such as mass conservation, which has been shown to have detrimental impact on the system's forecast. We use a neural network (NN) to correct for this mass violation, using training data generated from expensive algorithms that can constrain such physical properties. We found in idealized setup that the NN can match the performance of these expensive algorithms, at neglectable computational costs.