Articles | Volume 27, issue 4
https://doi.org/10.5194/npg-27-519-2020
© Author(s) 2020. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Special issue:
https://doi.org/10.5194/npg-27-519-2020
© Author(s) 2020. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Preface: Advances in post-processing and blending of deterministic and ensemble forecasts
Stephan Hemri
Federal Office of Meteorology and Climatology, MeteoSwiss, Operation Center 1, 8058 Zurich Airport, Switzerland
Institute of Mathematics, University of Zurich, Winterthurerstrasse 190, 8057 Zurich, Switzerland
Sebastian Lerch
Institute for Stochastics, Karlsruhe Institute of Technology, Englerstr. 2, 76131 Karlsruhe, Germany
Maxime Taillardat
Météo-France, CNRM UMR 3589, Toulouse, France
Royal Meteorological Institute of Belgium, Avenue Circulaire 3, 1180 Brussels, Belgium
European Meteorological Network (EUMETNET), Avenue Circulaire 3, 1180 Brussels, Belgium
Daniel S. Wilks
Earth and Atmospheric Sciences, Cornell University, Ithaca, NY, USA
Related authors
Sebastian Lerch, Sándor Baran, Annette Möller, Jürgen Groß, Roman Schefzik, Stephan Hemri, and Maximiliane Graeter
Nonlin. Processes Geophys., 27, 349–371, https://doi.org/10.5194/npg-27-349-2020, https://doi.org/10.5194/npg-27-349-2020, 2020
Short summary
Short summary
Accurate models of spatial, temporal, and inter-variable dependencies are of crucial importance for many practical applications. We review and compare several methods for multivariate ensemble post-processing, where such dependencies are imposed via copula functions. Our investigations utilize simulation studies that mimic challenges occurring in practical applications and allow ready interpretation of the effects of different misspecifications of the numerical weather prediction ensemble.
Stéphane Vannitsem, X. San Liang, and Carlos A. Pires
EGUsphere, https://doi.org/10.5194/egusphere-2024-3308, https://doi.org/10.5194/egusphere-2024-3308, 2024
Short summary
Short summary
Large-scale modes of variability are present in the climate system. These modes are known to have influences on each other, but usually viewed as linear influences. The nonlinear connections among a set of key climate indices are here explored using tools from information theory, which allow for characterizing the causality between indices. It is found that quadratic nonlinear dependencies between climate indices are present at low-frequencies, reflecting the complex nature of its dynamics.
Selina M. Kiefer, Patrick Ludwig, Sebastian Lerch, Peter Knippertz, and Joaquim G. Pinto
EGUsphere, https://doi.org/10.5194/egusphere-2024-2955, https://doi.org/10.5194/egusphere-2024-2955, 2024
This preprint is open for discussion and under review for Weather and Climate Dynamics (WCD).
Short summary
Short summary
Weather forecasts 14 days in advance generally have a low skill but not always. We identify reasons thereof depending on the atmospheric flow, shown by Weather Regimes (WRs). If the WRs during the forecasts follow climatological patterns, forecast skill is increased. The forecast of a cold-wave day is better when the European Blocking WR (high pressure around the British Isles) is present a few days before a cold-wave day. These results can be used to assess the reliability of predictions.
Anupama K. Xavier, Jonathan Demaeyer, and Stéphane Vannitsem
Earth Syst. Dynam., 15, 893–912, https://doi.org/10.5194/esd-15-893-2024, https://doi.org/10.5194/esd-15-893-2024, 2024
Short summary
Short summary
This research focuses on understanding different atmospheric patterns like blocking, zonal, and transition regimes and analyzing their predictability. We used an idealized land–atmosphere coupled model to simulate Earth's atmosphere. Then we identified these blocking, zonal, and transition regimes using Gaussian mixture clustering and studied their predictability using Lyapunov exponents.
David Docquier, Giorgia Di Capua, Reik V. Donner, Carlos A. L. Pires, Amélie Simon, and Stéphane Vannitsem
Nonlin. Processes Geophys., 31, 115–136, https://doi.org/10.5194/npg-31-115-2024, https://doi.org/10.5194/npg-31-115-2024, 2024
Short summary
Short summary
Identifying causes of specific processes is crucial in order to better understand our climate system. Traditionally, correlation analyses have been used to identify cause–effect relationships in climate studies. However, correlation does not imply causation, which justifies the need to use causal methods. We compare two independent causal methods and show that these are superior to classical correlation analyses. We also find some interesting differences between the two methods.
Michel Journée, Edouard Goudenhoofdt, Stéphane Vannitsem, and Laurent Delobbe
Hydrol. Earth Syst. Sci., 27, 3169–3189, https://doi.org/10.5194/hess-27-3169-2023, https://doi.org/10.5194/hess-27-3169-2023, 2023
Short summary
Short summary
The exceptional flood of July 2021 in central Europe impacted Belgium severely. This study aims to characterize rainfall amounts in Belgium from 13 to 16 July 2021 based on observational data (i.e., rain gauge data and a radar-based rainfall product). The spatial and temporal distributions of rainfall during the event aredescribed. In order to document such a record-breaking event as much as possible, the rainfall data are shared with the scientific community on Zenodo for further studies.
Jonathan Demaeyer, Jonas Bhend, Sebastian Lerch, Cristina Primo, Bert Van Schaeybroeck, Aitor Atencia, Zied Ben Bouallègue, Jieyu Chen, Markus Dabernig, Gavin Evans, Jana Faganeli Pucer, Ben Hooper, Nina Horat, David Jobst, Janko Merše, Peter Mlakar, Annette Möller, Olivier Mestre, Maxime Taillardat, and Stéphane Vannitsem
Earth Syst. Sci. Data, 15, 2635–2653, https://doi.org/10.5194/essd-15-2635-2023, https://doi.org/10.5194/essd-15-2635-2023, 2023
Short summary
Short summary
A benchmark dataset is proposed to compare different statistical postprocessing methods used in forecasting centers to properly calibrate ensemble weather forecasts. This dataset is based on ensemble forecasts covering a portion of central Europe and includes the corresponding observations. Examples on how to download and use the data are provided, a set of evaluation methods is proposed, and a first benchmark of several methods for the correction of 2 m temperature forecasts is performed.
David Docquier, Stéphane Vannitsem, and Alessio Bellucci
Earth Syst. Dynam., 14, 577–591, https://doi.org/10.5194/esd-14-577-2023, https://doi.org/10.5194/esd-14-577-2023, 2023
Short summary
Short summary
The climate system is strongly regulated by interactions between the ocean and atmosphere. However, many uncertainties remain in the understanding of these interactions. Our analysis uses a relatively novel approach to quantify causal links between the ocean surface and lower atmosphere based on satellite observations. We find that both the ocean and atmosphere influence each other but with varying intensity depending on the region, demonstrating the power of causal methods.
Stéphane Vannitsem
Nonlin. Processes Geophys., 30, 1–12, https://doi.org/10.5194/npg-30-1-2023, https://doi.org/10.5194/npg-30-1-2023, 2023
Short summary
Short summary
The impact of climate change on weather pattern dynamics over the North Atlantic is explored through the lens of information theory. These tools allow the predictability of the succession of weather patterns and the irreversible nature of the dynamics to be clarified. It is shown that the predictability is increasing in the observations, while the opposite trend is found in model projections. The irreversibility displays an overall increase in time in both the observations and the model runs.
David Docquier, Stéphane Vannitsem, Alessio Bellucci, and Claude Frankignoul
EGUsphere, https://doi.org/10.5194/egusphere-2022-1340, https://doi.org/10.5194/egusphere-2022-1340, 2022
Preprint withdrawn
Short summary
Short summary
Understanding whether variations in ocean heat content are driven by air-sea heat fluxes or by ocean dynamics is of crucial importance to enhance climate projections. We use a relatively novel causal method to quantify interactions between ocean heat budget terms based on climate models. We find that low-resolution models overestimate the influence of ocean dynamics in the upper ocean, and that changes in ocean heat content are dominated by air-sea fluxes at high resolution.
Riccardo Silini, Sebastian Lerch, Nikolaos Mastrantonas, Holger Kantz, Marcelo Barreiro, and Cristina Masoller
Earth Syst. Dynam., 13, 1157–1165, https://doi.org/10.5194/esd-13-1157-2022, https://doi.org/10.5194/esd-13-1157-2022, 2022
Short summary
Short summary
The Madden–Julian Oscillation (MJO) has important socioeconomic impacts due to its influence on both tropical and extratropical weather extremes. In this study, we use machine learning (ML) to correct the predictions of the weather model holding the best performance, developed by the European Centre for Medium-Range Weather Forecasts (ECMWF). We show that the ML post-processing leads to an improved prediction of the MJO geographical location and intensity.
Nicolas Ghilain, Stéphane Vannitsem, Quentin Dalaiden, Hugues Goosse, Lesley De Cruz, and Wenguang Wei
Earth Syst. Sci. Data, 14, 1901–1916, https://doi.org/10.5194/essd-14-1901-2022, https://doi.org/10.5194/essd-14-1901-2022, 2022
Short summary
Short summary
Modeling the climate at high resolution is crucial to represent the snowfall accumulation over the complex orography of the Antarctic coast. While ice cores provide a view constrained spatially but over centuries, climate models can give insight into its spatial distribution, either at high resolution over a short period or vice versa. We downscaled snowfall accumulation from climate model historical simulations (1850–present day) over Dronning Maud Land at 5.5 km using a statistical method.
Guillaume Evin, Matthieu Lafaysse, Maxime Taillardat, and Michaël Zamo
Nonlin. Processes Geophys., 28, 467–480, https://doi.org/10.5194/npg-28-467-2021, https://doi.org/10.5194/npg-28-467-2021, 2021
Short summary
Short summary
Forecasting the height of new snow is essential for avalanche hazard surveys, road and ski resort management, tourism attractiveness, etc. Météo-France operates a probabilistic forecasting system using a numerical weather prediction system and a snowpack model. It provides better forecasts than direct diagnostics but exhibits significant biases. Post-processing methods can be applied to provide automatic forecasting products from this system.
Tommaso Alberti, Reik V. Donner, and Stéphane Vannitsem
Earth Syst. Dynam., 12, 837–855, https://doi.org/10.5194/esd-12-837-2021, https://doi.org/10.5194/esd-12-837-2021, 2021
Short summary
Short summary
We provide a novel approach to diagnose the strength of the ocean–atmosphere coupling by using both a reduced order model and reanalysis data. Our findings suggest the ocean–atmosphere dynamics presents a rich variety of features, moving from a chaotic to a coherent coupled dynamics, mainly attributed to the atmosphere and only marginally to the ocean. Our observations suggest further investigations in characterizing the occurrence and spatial dependency of the ocean–atmosphere coupling.
Sebastian Lerch, Sándor Baran, Annette Möller, Jürgen Groß, Roman Schefzik, Stephan Hemri, and Maximiliane Graeter
Nonlin. Processes Geophys., 27, 349–371, https://doi.org/10.5194/npg-27-349-2020, https://doi.org/10.5194/npg-27-349-2020, 2020
Short summary
Short summary
Accurate models of spatial, temporal, and inter-variable dependencies are of crucial importance for many practical applications. We review and compare several methods for multivariate ensemble post-processing, where such dependencies are imposed via copula functions. Our investigations utilize simulation studies that mimic challenges occurring in practical applications and allow ready interpretation of the effects of different misspecifications of the numerical weather prediction ensemble.
Maxime Taillardat and Olivier Mestre
Nonlin. Processes Geophys., 27, 329–347, https://doi.org/10.5194/npg-27-329-2020, https://doi.org/10.5194/npg-27-329-2020, 2020
Short summary
Short summary
Statistical post-processing of ensemble forecasts is now a well-known procedure in order to correct biased and misdispersed ensemble weather predictions. But practical application in European national weather services is in its infancy. Different applications of ensemble post-processing using machine learning at an industrial scale are presented. Forecast quality and value are improved compared to the raw ensemble, but several facilities have to be made to adjust to operational constraints.
Jonathan Demaeyer and Stéphane Vannitsem
Nonlin. Processes Geophys., 27, 307–327, https://doi.org/10.5194/npg-27-307-2020, https://doi.org/10.5194/npg-27-307-2020, 2020
Short summary
Short summary
Postprocessing schemes used to correct weather forecasts are no longer efficient when the model generating the forecasts changes. An approach based on response theory to take the change into account without having to recompute the parameters based on past forecasts is presented. It is tested on an analytical model and a simple model of atmospheric variability. We show that this approach is effective and discuss its potential application for an operational environment.
Michiel Van Ginderachter, Daan Degrauwe, Stéphane Vannitsem, and Piet Termonia
Nonlin. Processes Geophys., 27, 187–207, https://doi.org/10.5194/npg-27-187-2020, https://doi.org/10.5194/npg-27-187-2020, 2020
Short summary
Short summary
A generic methodology is developed to estimate the model error and simulate the model uncertainty related to a specific physical process. The method estimates the model error by comparing two different representations of the physical process in otherwise identical models. The found model error can then be used to perturb the model and simulate the model uncertainty. When applying this methodology to deep convection an improvement in the probabilistic skill of the ensemble forecast is found.
Moritz N. Lang, Sebastian Lerch, Georg J. Mayr, Thorsten Simon, Reto Stauffer, and Achim Zeileis
Nonlin. Processes Geophys., 27, 23–34, https://doi.org/10.5194/npg-27-23-2020, https://doi.org/10.5194/npg-27-23-2020, 2020
Short summary
Short summary
Statistical post-processing aims to increase the predictive skill of probabilistic ensemble weather forecasts by learning the statistical relation between historical pairs of observations and ensemble forecasts within a given training data set. This study compares four different training schemes and shows that including multiple years of data in the training set typically yields a more stable post-processing while it loses the ability to quickly adjust to temporal changes in the underlying data.
Emmanuel Roulin and Stéphane Vannitsem
Nonlin. Processes Geophys. Discuss., https://doi.org/10.5194/npg-2019-45, https://doi.org/10.5194/npg-2019-45, 2019
Preprint withdrawn
Short summary
Short summary
We need seasonal predictions of temperature and precipitation to prepare hydrological outlooks. Since the skill is limited, statistical correction and combination of outputs from multiple models are necessary. We use the forecasts of past situations from the EUROSIP multi-model system for 6 case studies in Western Europe and the Mediterranean Region. We identify skill for spring temperature in most areas and winter precipitation in Sweden and Greece. Sample size for training appears crucial.
Jonathan Demaeyer and Stéphane Vannitsem
Nonlin. Processes Geophys., 25, 605–631, https://doi.org/10.5194/npg-25-605-2018, https://doi.org/10.5194/npg-25-605-2018, 2018
Short summary
Short summary
We investigate the modeling of the effects of the unresolved scales on the large scales of the coupled ocean–atmosphere model MAOOAM. Two different physically based stochastic methods are considered and compared, in various configurations of the model. Both methods show remarkable performances and are able to model fundamental changes in the model dynamics. Ways to improve the parameterizations' implementation are also proposed.
Stéphane Vannitsem and Pierre Ekelmans
Earth Syst. Dynam., 9, 1063–1083, https://doi.org/10.5194/esd-9-1063-2018, https://doi.org/10.5194/esd-9-1063-2018, 2018
Short summary
Short summary
The El Niño–Southern Oscillation phenomenon is a slow dynamics present in the coupled ocean–atmosphere tropical Pacific system which has important teleconnections with the northern extratropics. These teleconnections are usually believed to be the source of an enhanced predictability in the northern extratropics at seasonal to decadal timescales. This question is challenged by investigating the causality between these regions using an advanced technique known as convergent cross mapping.
Lesley De Cruz, Sebastian Schubert, Jonathan Demaeyer, Valerio Lucarini, and Stéphane Vannitsem
Nonlin. Processes Geophys., 25, 387–412, https://doi.org/10.5194/npg-25-387-2018, https://doi.org/10.5194/npg-25-387-2018, 2018
Short summary
Short summary
The predictability of weather models is limited largely by the initial state error growth or decay rates. We have computed these rates for PUMA, a global model for the atmosphere, and MAOOAM, a more simplified, coupled model which includes the ocean. MAOOAM has processes at distinct timescales, whereas PUMA surprisingly does not. We propose a new programme to compute the natural directions along the flow that correspond to the growth or decay rates, to learn which components play a role.
Lesley De Cruz, Jonathan Demaeyer, and Stéphane Vannitsem
Geosci. Model Dev., 9, 2793–2808, https://doi.org/10.5194/gmd-9-2793-2016, https://doi.org/10.5194/gmd-9-2793-2016, 2016
Short summary
Short summary
Large-scale weather patterns such as the North Atlantic Oscillation, which dictates the harshness of European winters, vary over the course of years. By recreating it in a simple ocean-atmosphere model, we hope to understand what drives this slow, hard-to-predict variability. MAOOAM is such a model, in which the resolution and included physical processes can easily be modified. The modular system allowed us to show the robustness of the slow variability against changes in model resolution.
S. Vannitsem and L. De Cruz
Geosci. Model Dev., 7, 649–662, https://doi.org/10.5194/gmd-7-649-2014, https://doi.org/10.5194/gmd-7-649-2014, 2014
Cited articles
Buizza, R.: Ensemble forecasting and the need for calibration, in:
Statistical postprocessing of ensemble forecasts, edited by: Vannitsem, S.,
Wilks, D. S., and Messner, J. W., chap. 2, 15–48, Elsevier, Amsterdam,
the Netherlands, https://doi.org/10.1016/B978-0-12-812372-0.00002-9, 2018.
Demaeyer, J. and Vannitsem, S.: Correcting for model changes in statistical postprocessing – an approach based on response theory, Nonlin. Processes Geophys., 27, 307–327, https://doi.org/10.5194/npg-27-307-2020, 2020.
Düsterhus, A.: Seasonal statistical–dynamical prediction of the North Atlantic Oscillation by probabilistic post-processing and its evaluation, Nonlin. Processes Geophys., 27, 121–131, https://doi.org/10.5194/npg-27-121-2020, 2020.
Glahn, H. R. and Lowry, D. A.: The Use of Model Output Statistics (MOS) in
Objective Weather Forecasting, J. Appl. Meteorol., 11, 1203–1211, 1972.
Hess, R.: Statistical postprocessing of ensemble forecasts for severe weather at Deutscher Wetterdienst, Nonlin. Processes Geophys., 27, 473–487, https://doi.org/10.5194/npg-27-473-2020, 2020.
Jacobson, J., Kleiber, W., Scheuerer, M., and Bellier, J.: Beyond univariate calibration: verifying spatial structure in ensembles of forecast fields, Nonlin. Processes Geophys., 27, 411–427, https://doi.org/10.5194/npg-27-411-2020, 2020.
Lang, M. N., Lerch, S., Mayr, G. J., Simon, T., Stauffer, R., and Zeileis, A.: Remember the past: a comparison of time-adaptive training schemes for non-homogeneous regression, Nonlin. Processes Geophys., 27, 23–34, https://doi.org/10.5194/npg-27-23-2020, 2020.
Lerch, S., Baran, S., Möller, A., Groß, J., Schefzik, R., Hemri, S., and Graeter, M.: Simulation-based comparison of multivariate ensemble post-processing methods, Nonlin. Processes Geophys., 27, 349–371, https://doi.org/10.5194/npg-27-349-2020, 2020.
Nousu, J.-P., Lafaysse, M., Vernay, M., Bellier, J., Evin, G., and Joly, B.: Statistical post-processing of ensemble forecasts of the height of new snow, Nonlin. Processes Geophys., 26, 339–357, https://doi.org/10.5194/npg-26-339-2019, 2019.
Schuhen, N.: Order of operation for multi-stage post-processing of ensemble wind forecast trajectories, Nonlin. Processes Geophys., 27, 35–49, https://doi.org/10.5194/npg-27-35-2020, 2020.
Steinheuer, J. and Friederichs, P.: Vertical profiles of wind gust statistics from a regional reanalysis using multivariate extreme value theory, Nonlin. Processes Geophys., 27, 239–252, https://doi.org/10.5194/npg-27-239-2020, 2020.
Taillardat, M. and Mestre, O.: From research to applications – examples of operational ensemble post-processing in France using machine learning, Nonlin. Processes Geophys., 27, 329–347, https://doi.org/10.5194/npg-27-329-2020, 2020.
Thorarinsdottir, T. L. and Schuhen, N.: Verification: assessment of
calibration and accuracy, in: Statistical postprocessing of ensemble
forecasts, edited by: Vannitsem, S., Wilks, D. S., and Messner, J. W.,
chap. 6, 155–186, Elsevier, Amsterdam,
the Netherlands, https://doi.org/10.1016/b978-0-12-812372-0.00006-6, 2018.
Vannitsem, S., Wilks, D. S., and Messner, J. (Eds): Statistical
Postprocessing of Ensemble Forecasts, Elsevier, Amsterdam, the Netherlands, 2018.
Vannitsem, S., Bremnes, J. B., Demaeyer , J., Evans, G. R., Flowerdew, J., Hemri, S., Lerch, S., Roberts, N., Theis, S., Atencia, A., Ben Bouallègue, Z., Bhend, J., Dabernig, M., De Cruz, L., Hieta, L., Mestre, O., Moret, L., Odak Plenković, I., Schmeits, M., Taillardat, M., Van den Bergh, J., Van Schaeybroeck, B., Whan, K., and Ylhaisi, J.: Statistical Postprocessing for Weather Forecasts –
Review, Challenges and Avenues in a Big Data World, Bulletin of the American
Meteorological Society, in press, 2020.
Wilks, D. S.: Statistical Methods in the Atmospheric Sciences, 4th edn.,
Academic Press, Amsterdam, the Netherlands, 2019.