Articles | Volume 26, issue 3
https://doi.org/10.5194/npg-26-143-2019
© Author(s) 2019. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/npg-26-143-2019
© Author(s) 2019. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Research article
| 
10 Jul 2019
Research article |
| 10 Jul 2019
| 10 Jul 2019
Data assimilation as a learning tool to infer ordinary differential equation representations of dynamical models
CEREA, joint laboratory École des Ponts ParisTech and EDF R&D, Université Paris-Est, Champs-sur-Marne, France
Julien Brajard
Sorbonne University, CNRS-IRD-MNHN, LOCEAN, Paris, France
Nansen Environmental and Remote Sensing Center, Bergen, Norway
Alberto Carrassi
Nansen Environmental and Remote Sensing Center, Bergen, Norway
Geophysical Institute, University of Bergen, Bergen, Norway
Laurent Bertino
Nansen Environmental and Remote Sensing Center, Bergen, Norway
Related authors
Charlotte Durand, Tobias Sebastian Finn, Alban Farchi, Marc Bocquet, Julien Brajard, and Laurent Bertino
EGUsphere, https://doi.org/10.5194/egusphere-2024-4028, https://doi.org/10.5194/egusphere-2024-4028, 2025
Short summary
Short summary
This paper presents a four-dimensional variational data assimilation system based on a neural network emulator for sea-ice thickness, learned from neXtSIM simulation outputs. Testing with simulated and real observation retrievals, the system improves forecasts and bias error, performing comparably to operational methods, demonstrating the promise of sea-ice data-driven data assimilation systems.
Simon Driscoll, Alberto Carrassi, Julien Brajard, Laurent Bertino, Einar Ólason, Marc Bocquet, and Amos Lawless
EGUsphere, https://doi.org/10.5194/egusphere-2024-2476, https://doi.org/10.5194/egusphere-2024-2476, 2024
Short summary
Short summary
The formation and evolution of sea ice melt ponds (ponds of melted water) are complex, insufficiently understood and represented in models with considerable uncertainty. These uncertain representations are not traditionally included in climate models potentially causing the known underestimation of sea ice loss in climate models. Our work creates the first observationally based machine learning model of melt ponds that is also a ready and viable candidate to be included in climate models.
Joffrey Dumont Le Brazidec, Pierre Vanderbecken, Alban Farchi, Grégoire Broquet, Gerrit Kuhlmann, and Marc Bocquet
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2024-156, https://doi.org/10.5194/gmd-2024-156, 2024
Revised manuscript accepted for GMD
Short summary
Short summary
We developed a deep learning method to estimate CO2 emissions from power plants using satellite images. Trained and validated on simulated data, our model accurately predicts emissions despite challenges like cloud cover. When applied to real OCO3 satellite image, the results closely match reported emissions. This study shows that neural networks trained on simulations can effectively analyse real satellite data, offering a new way to monitor CO2 emissions from space.
Tobias Sebastian Finn, Lucas Disson, Alban Farchi, Marc Bocquet, and Charlotte Durand
Nonlin. Processes Geophys., 31, 409–431, https://doi.org/10.5194/npg-31-409-2024, https://doi.org/10.5194/npg-31-409-2024, 2024
Short summary
Short summary
We train neural networks as denoising diffusion models for state generation in the Lorenz 1963 system and demonstrate that they learn an internal representation of the system. We make use of this learned representation and the pre-trained model in two downstream tasks: surrogate modelling and ensemble generation. For both tasks, the diffusion model can outperform other more common approaches. Thus, we see a potential of representation learning with diffusion models for dynamical systems.
Marc Bocquet, Pierre J. Vanderbecken, Alban Farchi, Joffrey Dumont Le Brazidec, and Yelva Roustan
Nonlin. Processes Geophys., 31, 335–357, https://doi.org/10.5194/npg-31-335-2024, https://doi.org/10.5194/npg-31-335-2024, 2024
Short summary
Short summary
A novel approach, optimal transport data assimilation (OTDA), is introduced to merge DA and OT concepts. By leveraging OT's displacement interpolation in space, it minimises mislocation errors within DA applied to physical fields, such as water vapour, hydrometeors, and chemical species. Its richness and flexibility are showcased through one- and two-dimensional illustrations.
Yumeng Chen, Polly Smith, Alberto Carrassi, Ivo Pasmans, Laurent Bertino, Marc Bocquet, Tobias Sebastian Finn, Pierre Rampal, and Véronique Dansereau
The Cryosphere, 18, 2381–2406, https://doi.org/10.5194/tc-18-2381-2024, https://doi.org/10.5194/tc-18-2381-2024, 2024
Short summary
Short summary
We explore multivariate state and parameter estimation using a data assimilation approach through idealised simulations in a dynamics-only sea-ice model based on novel rheology. We identify various potential issues that can arise in complex operational sea-ice models when model parameters are estimated. Even though further investigation will be needed for such complex sea-ice models, we show possibilities of improving the observed and the unobserved model state forecast and parameter accuracy.
Charlotte Durand, Tobias Sebastian Finn, Alban Farchi, Marc Bocquet, Guillaume Boutin, and Einar Ólason
The Cryosphere, 18, 1791–1815, https://doi.org/10.5194/tc-18-1791-2024, https://doi.org/10.5194/tc-18-1791-2024, 2024
Short summary
Short summary
This paper focuses on predicting Arctic-wide sea-ice thickness using surrogate modeling with deep learning. The model has a predictive power of 12 h up to 6 months. For this forecast horizon, persistence and daily climatology are systematically outperformed, a result of learned thermodynamics and advection. Consequently, surrogate modeling with deep learning proves to be effective at capturing the complex behavior of sea ice.
Joffrey Dumont Le Brazidec, Pierre Vanderbecken, Alban Farchi, Grégoire Broquet, Gerrit Kuhlmann, and Marc Bocquet
Geosci. Model Dev., 17, 1995–2014, https://doi.org/10.5194/gmd-17-1995-2024, https://doi.org/10.5194/gmd-17-1995-2024, 2024
Short summary
Short summary
Our research presents an innovative approach to estimating power plant CO2 emissions from satellite images of the corresponding plumes such as those from the forthcoming CO2M satellite constellation. The exploitation of these images is challenging due to noise and meteorological uncertainties. To overcome these obstacles, we use a deep learning neural network trained on simulated CO2 images. Our method outperforms alternatives, providing a positive perspective for the analysis of CO2M images.
Tobias Sebastian Finn, Charlotte Durand, Alban Farchi, Marc Bocquet, Yumeng Chen, Alberto Carrassi, and Véronique Dansereau
The Cryosphere, 17, 2965–2991, https://doi.org/10.5194/tc-17-2965-2023, https://doi.org/10.5194/tc-17-2965-2023, 2023
Short summary
Short summary
We combine deep learning with a regional sea-ice model to correct model errors in the sea-ice dynamics of low-resolution forecasts towards high-resolution simulations. The combined model improves the forecast by up to 75 % and thereby surpasses the performance of persistence. As the error connection can additionally be used to analyse the shortcomings of the forecasts, this study highlights the potential of combined modelling for short-term sea-ice forecasting.
Joffrey Dumont Le Brazidec, Pierre Vanderbecken, Alban Farchi, Marc Bocquet, Jinghui Lian, Grégoire Broquet, Gerrit Kuhlmann, Alexandre Danjou, and Thomas Lauvaux
Geosci. Model Dev., 16, 3997–4016, https://doi.org/10.5194/gmd-16-3997-2023, https://doi.org/10.5194/gmd-16-3997-2023, 2023
Short summary
Short summary
Monitoring of CO2 emissions is key to the development of reduction policies. Local emissions, from cities or power plants, may be estimated from CO2 plumes detected in satellite images. CO2 plumes generally have a weak signal and are partially concealed by highly variable background concentrations and instrument errors, which hampers their detection. To address this problem, we propose and apply deep learning methods to detect the contour of a plume in simulated CO2 satellite images.
Pierre J. Vanderbecken, Joffrey Dumont Le Brazidec, Alban Farchi, Marc Bocquet, Yelva Roustan, Élise Potier, and Grégoire Broquet
Atmos. Meas. Tech., 16, 1745–1766, https://doi.org/10.5194/amt-16-1745-2023, https://doi.org/10.5194/amt-16-1745-2023, 2023
Short summary
Short summary
Instruments dedicated to monitoring atmospheric gaseous compounds from space will provide images of urban-scale plumes. We discuss here the use of new metrics to compare observed plumes with model predictions that will be less sensitive to meteorology uncertainties. We have evaluated our metrics on diverse plumes and shown that by eliminating some aspects of the discrepancies, they are indeed less sensitive to meteorological variations.
Joffrey Dumont Le Brazidec, Marc Bocquet, Olivier Saunier, and Yelva Roustan
Geosci. Model Dev., 16, 1039–1052, https://doi.org/10.5194/gmd-16-1039-2023, https://doi.org/10.5194/gmd-16-1039-2023, 2023
Short summary
Short summary
When radionuclides are released into the atmosphere, the assessment of the consequences depends on the evaluation of the magnitude and temporal evolution of the release, which can be highly variable as in the case of Fukushima Daiichi.
Here, we propose Bayesian inverse modelling methods and the reversible-jump Markov chain Monte Carlo technique, which allows one to evaluate the temporal variability of the release and to integrate different types of information in the source reconstruction.
Colin Grudzien and Marc Bocquet
Geosci. Model Dev., 15, 7641–7681, https://doi.org/10.5194/gmd-15-7641-2022, https://doi.org/10.5194/gmd-15-7641-2022, 2022
Short summary
Short summary
Iterative optimization techniques, the state of the art in data assimilation, have largely focused on extending forecast accuracy to moderate- to long-range forecast systems. However, current methodology may not be cost-effective in reducing forecast errors in online, short-range forecast systems. We propose a novel optimization of these techniques for online, short-range forecast cycles, simultaneously providing an improvement in forecast accuracy and a reduction in the computational cost.
Joffrey Dumont Le Brazidec, Marc Bocquet, Olivier Saunier, and Yelva Roustan
Atmos. Chem. Phys., 21, 13247–13267, https://doi.org/10.5194/acp-21-13247-2021, https://doi.org/10.5194/acp-21-13247-2021, 2021
Short summary
Short summary
The assessment of the environmental consequences of a radionuclide release depends on the estimation of its source. This paper aims to develop inverse Bayesian methods which combine transport models with measurements, in order to reconstruct the ensemble of possible sources.
Three methods to quantify uncertainties based on the definition of probability distributions and the physical models are proposed and evaluated for the case of 106Ru releases over Europe in 2017.
Colin Grudzien, Marc Bocquet, and Alberto Carrassi
Geosci. Model Dev., 13, 1903–1924, https://doi.org/10.5194/gmd-13-1903-2020, https://doi.org/10.5194/gmd-13-1903-2020, 2020
Short summary
Short summary
All scales of a dynamical physical process cannot be resolved accurately in a multiscale, geophysical model. The behavior of unresolved scales of motion are often parametrized by a random process to emulate their effects on the dynamically resolved variables, and this results in a random–dynamical model. We study how the choice of a numerical discretization of such a system affects the model forecast and estimation statistics, when the random–dynamical model is unbiased in its parametrization.
Thomas Lauvaux, Liza I. Díaz-Isaac, Marc Bocquet, and Nicolas Bousserez
Atmos. Chem. Phys., 19, 12007–12024, https://doi.org/10.5194/acp-19-12007-2019, https://doi.org/10.5194/acp-19-12007-2019, 2019
Short summary
Short summary
A small-size ensemble of mesoscale simulations has been filtered to characterize the spatial structures of transport errors in atmospheric CO2 mixing ratios. The extracted error structures in in situ and column CO2 show similar length scales compared to other meteorological variables, including seasonality, which could be used as proxies in regional inversion systems.
Julien Brajard, Alberto Carrassi, Marc Bocquet, and Laurent Bertino
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2019-136, https://doi.org/10.5194/gmd-2019-136, 2019
Revised manuscript not accepted
Short summary
Short summary
We explore the possibility of combining data assimilation with machine learning. We introduce a new hybrid method for a two-fold scope: (i) emulating hidden, possibly chaotic, dynamics and (ii) predicting its future states. Numerical experiments have been carried out using the chaotic Lorenz 96 model, proving both the convergence of the hybrid method and its statistical skills including short-term forecasting and emulation of the long-term dynamics.
Liza I. Díaz-Isaac, Thomas Lauvaux, Marc Bocquet, and Kenneth J. Davis
Atmos. Chem. Phys., 19, 5695–5718, https://doi.org/10.5194/acp-19-5695-2019, https://doi.org/10.5194/acp-19-5695-2019, 2019
Short summary
Short summary
We demonstrate that transport model errors, one of the main contributors to the uncertainty in regional CO2 inversions, can be represented by a small-size ensemble carefully calibrated with meteorological data. Our results also confirm transport model errors represent a significant fraction of the model–data mismatch in CO2 mole fractions and hence in regional inverse CO2 fluxes.
Alban Farchi and Marc Bocquet
Nonlin. Processes Geophys., 25, 765–807, https://doi.org/10.5194/npg-25-765-2018, https://doi.org/10.5194/npg-25-765-2018, 2018
Short summary
Short summary
Data assimilation looks for an optimal way to learn from observations of a dynamical system to improve the quality of its predictions. The goal is to filter out the noise (both observation and model noise) to retrieve the true signal. Among all possible methods, particle filters are promising; the method is fast and elegant, and it allows for a Bayesian analysis. In this review paper, we discuss implementation techniques for (local) particle filters in high-dimensional systems.
Colin Grudzien, Alberto Carrassi, and Marc Bocquet
Nonlin. Processes Geophys., 25, 633–648, https://doi.org/10.5194/npg-25-633-2018, https://doi.org/10.5194/npg-25-633-2018, 2018
Short summary
Short summary
Using the framework Lyapunov vectors, we analyze the asymptotic properties of ensemble based Kalman filters and how these are influenced by dynamical chaos, especially in the context of random model errors and small ensemble sizes. Particularly, we show a novel derivation of the evolution of forecast uncertainty for ensemble-based Kalman filters with weakly-nonlinear error growth, and discuss its impact for filter design in geophysical models.
Olivier Pannekoucke, Marc Bocquet, and Richard Ménard
Nonlin. Processes Geophys., 25, 481–495, https://doi.org/10.5194/npg-25-481-2018, https://doi.org/10.5194/npg-25-481-2018, 2018
Short summary
Short summary
The forecast of weather prediction uncertainty is a real challenge and is crucial for risk management. However, uncertainty prediction is beyond the capacity of supercomputers, and improvements of the technology may not solve this issue. A new uncertainty prediction method is introduced which takes advantage of fluid equations to predict simple quantities which approximate real uncertainty but at a low numerical cost. A proof of concept is shown by an academic model derived from fluid dynamics.
Anthony Fillion, Marc Bocquet, and Serge Gratton
Nonlin. Processes Geophys., 25, 315–334, https://doi.org/10.5194/npg-25-315-2018, https://doi.org/10.5194/npg-25-315-2018, 2018
Short summary
Short summary
This study generalizes a paper by Pires et al. (1996) to state-of-the-art data assimilation techniques, such as the iterative ensemble Kalman smoother (IEnKS). We show that the longer the time window over which observations are assimilated, the better the accuracy of the IEnKS. Beyond a critical time length that we estimate, we show that this accuracy finally degrades. We show that the use of the quasi-static minimizations but generalized to the IEnKS yields a significantly improved accuracy.
J.-M. Haussaire and M. Bocquet
Geosci. Model Dev., 9, 393–412, https://doi.org/10.5194/gmd-9-393-2016, https://doi.org/10.5194/gmd-9-393-2016, 2016
Short summary
Short summary
The focus is on the development of low-order models of atmospheric transport and chemistry and their use for data assimilation purposes. A new low-order coupled chemistry meteorology model is developed. It consists of the Lorenz40-variable model used as a wind field coupled with a simple ozone photochemistry module. Advanced ensemble variational methods are applied to this model to obtain insights on the use of data assimilation with coupled models, in an offline mode or in an online mode.
M. Bocquet, P. N. Raanes, and A. Hannart
Nonlin. Processes Geophys., 22, 645–662, https://doi.org/10.5194/npg-22-645-2015, https://doi.org/10.5194/npg-22-645-2015, 2015
Short summary
Short summary
The popular data assimilation technique known as the ensemble Kalman filter (EnKF) suffers from sampling errors due to the limited size of the ensemble. This deficiency is usually cured by inflating the sampled error covariances and by using localization. This paper further develops and discusses the finite-size EnKF, or EnKF-N, a variant of the EnKF that does not require inflation. It expands the use of the EnKF-N to a wider range of dynamical regimes.
M. Bocquet, H. Elbern, H. Eskes, M. Hirtl, R. Žabkar, G. R. Carmichael, J. Flemming, A. Inness, M. Pagowski, J. L. Pérez Camaño, P. E. Saide, R. San Jose, M. Sofiev, J. Vira, A. Baklanov, C. Carnevale, G. Grell, and C. Seigneur
Atmos. Chem. Phys., 15, 5325–5358, https://doi.org/10.5194/acp-15-5325-2015, https://doi.org/10.5194/acp-15-5325-2015, 2015
Short summary
Short summary
Data assimilation is used in atmospheric chemistry models to improve air quality forecasts, construct re-analyses of concentrations, and perform inverse modeling. Coupled chemistry meteorology models (CCMM) are atmospheric chemistry models that simulate meteorological processes and chemical transformations jointly. We review here the current status of data assimilation in atmospheric chemistry models, with a particular focus on future prospects for data assimilation in CCMM.
Y. Wang, K. N. Sartelet, M. Bocquet, P. Chazette, M. Sicard, G. D'Amico, J. F. Léon, L. Alados-Arboledas, A. Amodeo, P. Augustin, J. Bach, L. Belegante, I. Binietoglou, X. Bush, A. Comerón, H. Delbarre, D. García-Vízcaino, J. L. Guerrero-Rascado, M. Hervo, M. Iarlori, P. Kokkalis, D. Lange, F. Molero, N. Montoux, A. Muñoz, C. Muñoz, D. Nicolae, A. Papayannis, G. Pappalardo, J. Preissler, V. Rizi, F. Rocadenbosch, K. Sellegri, F. Wagner, and F. Dulac
Atmos. Chem. Phys., 14, 12031–12053, https://doi.org/10.5194/acp-14-12031-2014, https://doi.org/10.5194/acp-14-12031-2014, 2014
Y. Wang, K. N. Sartelet, M. Bocquet, and P. Chazette
Atmos. Chem. Phys., 14, 3511–3532, https://doi.org/10.5194/acp-14-3511-2014, https://doi.org/10.5194/acp-14-3511-2014, 2014
O. Saunier, A. Mathieu, D. Didier, M. Tombette, D. Quélo, V. Winiarek, and M. Bocquet
Atmos. Chem. Phys., 13, 11403–11421, https://doi.org/10.5194/acp-13-11403-2013, https://doi.org/10.5194/acp-13-11403-2013, 2013
M. Bocquet and P. Sakov
Nonlin. Processes Geophys., 20, 803–818, https://doi.org/10.5194/npg-20-803-2013, https://doi.org/10.5194/npg-20-803-2013, 2013
M. R. Koohkan, M. Bocquet, Y. Roustan, Y. Kim, and C. Seigneur
Atmos. Chem. Phys., 13, 5887–5905, https://doi.org/10.5194/acp-13-5887-2013, https://doi.org/10.5194/acp-13-5887-2013, 2013
Y. Wang, K. N. Sartelet, M. Bocquet, and P. Chazette
Atmos. Chem. Phys., 13, 269–283, https://doi.org/10.5194/acp-13-269-2013, https://doi.org/10.5194/acp-13-269-2013, 2013
Matthew J. Martin, Ibrahim Hoteit, Laurent Bertino, and Andrew M. Moore
State Planet, 5-opsr, 9, https://doi.org/10.5194/sp-5-opsr-9-2025, https://doi.org/10.5194/sp-5-opsr-9-2025, 2025
Short summary
Short summary
Observations of the ocean from satellites and platforms in the ocean are combined with information from computer models to produce predictions of how the ocean temperature, salinity, and currents will evolve over the coming days and weeks and to describe how the ocean has evolved in the past. This paper summarises the methods used to produce these ocean forecasts at various centres around the world and outlines the practical considerations for implementing such forecasting systems.
Laurent Bertino, Patrick Heimbach, Ed Blockley, and Einar Ólason
State Planet, 5-opsr, 14, https://doi.org/10.5194/sp-5-opsr-14-2025, https://doi.org/10.5194/sp-5-opsr-14-2025, 2025
Short summary
Short summary
Forecasts of sea ice are in high demand in the polar regions, and they are also quickly improving and becoming more easily accessible to non-experts. We provide here a brief status of the short-term forecasting services – typically 10 d ahead – and an outlook of their upcoming developments.
Cyril Palerme, Johannes Röhrs, Thomas Lavergne, Jozef Rusin, Are Frode Kvanum, Atle Macdonald Sørensen, Arne Melsom, Julien Brajard, Martina Idžanović, Marina Durán Moro, and Malte Müller
EGUsphere, https://doi.org/10.5194/egusphere-2025-2001, https://doi.org/10.5194/egusphere-2025-2001, 2025
This preprint is open for discussion and under review for Geoscientific Model Development (GMD).
Short summary
Short summary
We present MET-AICE, a sea ice prediction system based on artificial intelligence techniques that has been running operationally since March 2024. The forecasts are produced daily and provide sea ice concentration predictions for the next 10 days. We evaluate the MET-AICE forecasts from the first year of operation, and we compare them to forecasts produced by a physically-based model (Barents-2.5km). We show that MET-AICE is skillful and provides more accurate forecasts than Barents-2.5km.
Ieuan Higgs, Ross Bannister, Jozef Skákala, Alberto Carrassi, and Stefano Ciavatta
EGUsphere, https://doi.org/10.48550/arXiv.2504.05218, https://doi.org/10.48550/arXiv.2504.05218, 2025
This preprint is open for discussion and under review for Biogeosciences (BG).
Short summary
Short summary
We explored how machine learning can improve computer models that simulate ocean ecosystems. These models help us understand how the ocean works, but they often struggle due to limited observations and complex processes. Our approach uses machine learning to better connect the parts of the system we can observe with those we cannot. This leads to more accurate and efficient predictions, offering a promising way to improve future ocean monitoring and forecasting tools.
Zikang He, Yiguo Wang, Julien Brajard, Xidong Wang, and Zheqi Shen
EGUsphere, https://doi.org/10.5194/egusphere-2024-4092, https://doi.org/10.5194/egusphere-2024-4092, 2025
Short summary
Short summary
Declining Arctic sea ice presents both risks and opportunities for ecosystems, communities, and economic activities. To address prediction errors in dynamical models, we apply machine learning for error correction during prediction (online) or post-processing (offline). Our results show both methods enhance sea ice predictions, particularly from September to January, with offline corrections outperforming online corrections.
Léo Edel, Jiping Xie, Anton Korosov, Julien Brajard, and Laurent Bertino
The Cryosphere, 19, 731–752, https://doi.org/10.5194/tc-19-731-2025, https://doi.org/10.5194/tc-19-731-2025, 2025
Short summary
Short summary
This study developed a new method to estimate Arctic sea ice thickness from 1992 to 2010 using a combination of machine learning and data assimilation. By training a machine learning model on data from 2011 to 2022, past errors in sea ice thickness can be corrected, leading to improved estimations. This approach provides insights into historical changes in sea ice thickness, showing a notable decline from 1992 to 2022, and offers a valuable resource for future studies.
Charlotte Durand, Tobias Sebastian Finn, Alban Farchi, Marc Bocquet, Julien Brajard, and Laurent Bertino
EGUsphere, https://doi.org/10.5194/egusphere-2024-4028, https://doi.org/10.5194/egusphere-2024-4028, 2025
Short summary
Short summary
This paper presents a four-dimensional variational data assimilation system based on a neural network emulator for sea-ice thickness, learned from neXtSIM simulation outputs. Testing with simulated and real observation retrievals, the system improves forecasts and bias error, performing comparably to operational methods, demonstrating the promise of sea-ice data-driven data assimilation systems.
Zikang He, Julien Brajard, Yiguo Wang, Xidong Wang, and Zheqi Shen
EGUsphere, https://doi.org/10.5194/egusphere-2025-212, https://doi.org/10.5194/egusphere-2025-212, 2025
Short summary
Short summary
Climate prediction is challenging due to systematic errors in traditional climate models. We addressed this by training a machine learning model to correct these errors and then integrating it with the traditional climate model to form an AI-physics hybrid model. Our study demonstrates that the hybrid model outperforms the original climate model on both short-term and long-term predictions of the atmosphere and ocean.
Georges Baaklini, Julien Brajard, Leila Issa, Gina Fifani, Laurent Mortier, and Roy El Hourany
Ocean Sci., 20, 1707–1720, https://doi.org/10.5194/os-20-1707-2024, https://doi.org/10.5194/os-20-1707-2024, 2024
Short summary
Short summary
Understanding the flow of the Levantine Sea surface current is not straightforward. We propose a study based on learning techniques to follow interactions between water near the shore and further out at sea. Our results show changes in the coastal currents past 33.8° E, with frequent instances of water breaking away along the Lebanese coast. These events happen quickly and sometimes lead to long-lasting eddies. This study underscores the need for direct observations to improve our knowledge.
Alexander Barth, Julien Brajard, Aida Alvera-Azcárate, Bayoumy Mohamed, Charles Troupin, and Jean-Marie Beckers
Ocean Sci., 20, 1567–1584, https://doi.org/10.5194/os-20-1567-2024, https://doi.org/10.5194/os-20-1567-2024, 2024
Short summary
Short summary
Most satellite observations have gaps, for example, due to clouds. This paper presents a method to reconstruct missing data in satellite observations of the chlorophyll a concentration in the Black Sea. Rather than giving a single possible reconstructed field, the discussed method provides an ensemble of possible reconstructions using a generative neural network. The resulting ensemble is validated using techniques from numerical weather prediction and ocean modelling.
Simon Driscoll, Alberto Carrassi, Julien Brajard, Laurent Bertino, Einar Ólason, Marc Bocquet, and Amos Lawless
EGUsphere, https://doi.org/10.5194/egusphere-2024-2476, https://doi.org/10.5194/egusphere-2024-2476, 2024
Short summary
Short summary
The formation and evolution of sea ice melt ponds (ponds of melted water) are complex, insufficiently understood and represented in models with considerable uncertainty. These uncertain representations are not traditionally included in climate models potentially causing the known underestimation of sea ice loss in climate models. Our work creates the first observationally based machine learning model of melt ponds that is also a ready and viable candidate to be included in climate models.
Joffrey Dumont Le Brazidec, Pierre Vanderbecken, Alban Farchi, Grégoire Broquet, Gerrit Kuhlmann, and Marc Bocquet
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2024-156, https://doi.org/10.5194/gmd-2024-156, 2024
Revised manuscript accepted for GMD
Short summary
Short summary
We developed a deep learning method to estimate CO2 emissions from power plants using satellite images. Trained and validated on simulated data, our model accurately predicts emissions despite challenges like cloud cover. When applied to real OCO3 satellite image, the results closely match reported emissions. This study shows that neural networks trained on simulations can effectively analyse real satellite data, offering a new way to monitor CO2 emissions from space.
Tobias Sebastian Finn, Lucas Disson, Alban Farchi, Marc Bocquet, and Charlotte Durand
Nonlin. Processes Geophys., 31, 409–431, https://doi.org/10.5194/npg-31-409-2024, https://doi.org/10.5194/npg-31-409-2024, 2024
Short summary
Short summary
We train neural networks as denoising diffusion models for state generation in the Lorenz 1963 system and demonstrate that they learn an internal representation of the system. We make use of this learned representation and the pre-trained model in two downstream tasks: surrogate modelling and ensemble generation. For both tasks, the diffusion model can outperform other more common approaches. Thus, we see a potential of representation learning with diffusion models for dynamical systems.
Marc Bocquet, Pierre J. Vanderbecken, Alban Farchi, Joffrey Dumont Le Brazidec, and Yelva Roustan
Nonlin. Processes Geophys., 31, 335–357, https://doi.org/10.5194/npg-31-335-2024, https://doi.org/10.5194/npg-31-335-2024, 2024
Short summary
Short summary
A novel approach, optimal transport data assimilation (OTDA), is introduced to merge DA and OT concepts. By leveraging OT's displacement interpolation in space, it minimises mislocation errors within DA applied to physical fields, such as water vapour, hydrometeors, and chemical species. Its richness and flexibility are showcased through one- and two-dimensional illustrations.
Lilian Garcia-Oliva, Alberto Carrassi, and François Counillon
EGUsphere, https://doi.org/10.5194/egusphere-2024-1843, https://doi.org/10.5194/egusphere-2024-1843, 2024
Short summary
Short summary
We used a simple coupled model and a data assimilation method to find the correct initialisation for climate predictions. We aim to clarify when weakly or strongly coupled data assimilation (WCDA or SCDA) is best, depending on the system's dynamical characteristics (spatio-temporal) and data coverage.
We found that WCDA is better in full data coverage. When we have a partially observed system, SCDA is better. This result depends on the temporal and spatial scale of the observed quantity.
We found that WCDA is better in full data coverage. When we have a partially observed system, SCDA is better. This result depends on the temporal and spatial scale of the observed quantity.
Yumeng Chen, Polly Smith, Alberto Carrassi, Ivo Pasmans, Laurent Bertino, Marc Bocquet, Tobias Sebastian Finn, Pierre Rampal, and Véronique Dansereau
The Cryosphere, 18, 2381–2406, https://doi.org/10.5194/tc-18-2381-2024, https://doi.org/10.5194/tc-18-2381-2024, 2024
Short summary
Short summary
We explore multivariate state and parameter estimation using a data assimilation approach through idealised simulations in a dynamics-only sea-ice model based on novel rheology. We identify various potential issues that can arise in complex operational sea-ice models when model parameters are estimated. Even though further investigation will be needed for such complex sea-ice models, we show possibilities of improving the observed and the unobserved model state forecast and parameter accuracy.
Cyril Palerme, Thomas Lavergne, Jozef Rusin, Arne Melsom, Julien Brajard, Are Frode Kvanum, Atle Macdonald Sørensen, Laurent Bertino, and Malte Müller
The Cryosphere, 18, 2161–2176, https://doi.org/10.5194/tc-18-2161-2024, https://doi.org/10.5194/tc-18-2161-2024, 2024
Short summary
Short summary
Sea ice forecasts are operationally produced using physically based models, but these forecasts are often not accurate enough for maritime operations. In this study, we developed a statistical correction technique using machine learning in order to improve the skill of short-term (up to 10 d) sea ice concentration forecasts produced by the TOPAZ4 model. This technique allows for the reduction of errors from the TOPAZ4 sea ice concentration forecasts by 41 % on average.
Charlotte Durand, Tobias Sebastian Finn, Alban Farchi, Marc Bocquet, Guillaume Boutin, and Einar Ólason
The Cryosphere, 18, 1791–1815, https://doi.org/10.5194/tc-18-1791-2024, https://doi.org/10.5194/tc-18-1791-2024, 2024
Short summary
Short summary
This paper focuses on predicting Arctic-wide sea-ice thickness using surrogate modeling with deep learning. The model has a predictive power of 12 h up to 6 months. For this forecast horizon, persistence and daily climatology are systematically outperformed, a result of learned thermodynamics and advection. Consequently, surrogate modeling with deep learning proves to be effective at capturing the complex behavior of sea ice.
Marina Durán Moro, Ann Kristin Sperrevik, Thomas Lavergne, Laurent Bertino, Yvonne Gusdal, Silje Christine Iversen, and Jozef Rusin
The Cryosphere, 18, 1597–1619, https://doi.org/10.5194/tc-18-1597-2024, https://doi.org/10.5194/tc-18-1597-2024, 2024
Short summary
Short summary
Individual satellite passes instead of daily means of sea ice concentration are used to correct the sea ice model forecast in the Barents Sea. The use of passes provides a significantly larger improvement of the forecasts even after a 7 d period due to the more precise information on temporal and spatial variability contained in the passes. One major advantage of the use of satellite passes is that there is no need to wait for the daily mean availability in order to update the forecast.
Joffrey Dumont Le Brazidec, Pierre Vanderbecken, Alban Farchi, Grégoire Broquet, Gerrit Kuhlmann, and Marc Bocquet
Geosci. Model Dev., 17, 1995–2014, https://doi.org/10.5194/gmd-17-1995-2024, https://doi.org/10.5194/gmd-17-1995-2024, 2024
Short summary
Short summary
Our research presents an innovative approach to estimating power plant CO2 emissions from satellite images of the corresponding plumes such as those from the forthcoming CO2M satellite constellation. The exploitation of these images is challenging due to noise and meteorological uncertainties. To overcome these obstacles, we use a deep learning neural network trained on simulated CO2 images. Our method outperforms alternatives, providing a positive perspective for the analysis of CO2M images.
Ieuan Higgs, Jozef Skákala, Ross Bannister, Alberto Carrassi, and Stefano Ciavatta
Biogeosciences, 21, 731–746, https://doi.org/10.5194/bg-21-731-2024, https://doi.org/10.5194/bg-21-731-2024, 2024
Short summary
Short summary
A complex network is a way of representing which parts of a system are connected to other parts. We have constructed a complex network based on an ecosystem–ocean model. From this, we can identify patterns in the structure and areas of similar behaviour. This can help to understand how natural, or human-made, changes will affect the shelf sea ecosystem, and it can be used in multiple future applications such as improving modelling, data assimilation, or machine learning.
Stefania A. Ciliberti, Enrique Alvarez Fanjul, Jay Pearlman, Kirsten Wilmer-Becker, Pierre Bahurel, Fabrice Ardhuin, Alain Arnaud, Mike Bell, Segolene Berthou, Laurent Bertino, Arthur Capet, Eric Chassignet, Stefano Ciavatta, Mauro Cirano, Emanuela Clementi, Gianpiero Cossarini, Gianpaolo Coro, Stuart Corney, Fraser Davidson, Marie Drevillon, Yann Drillet, Renaud Dussurget, Ghada El Serafy, Katja Fennel, Marcos Garcia Sotillo, Patrick Heimbach, Fabrice Hernandez, Patrick Hogan, Ibrahim Hoteit, Sudheer Joseph, Simon Josey, Pierre-Yves Le Traon, Simone Libralato, Marco Mancini, Pascal Matte, Angelique Melet, Yasumasa Miyazawa, Andrew M. Moore, Antonio Novellino, Andrew Porter, Heather Regan, Laia Romero, Andreas Schiller, John Siddorn, Joanna Staneva, Cecile Thomas-Courcoux, Marina Tonani, Jose Maria Garcia-Valdecasas, Jennifer Veitch, Karina von Schuckmann, Liying Wan, John Wilkin, and Romane Zufic
State Planet, 1-osr7, 2, https://doi.org/10.5194/sp-1-osr7-2-2023, https://doi.org/10.5194/sp-1-osr7-2-2023, 2023
Tobias Sebastian Finn, Charlotte Durand, Alban Farchi, Marc Bocquet, Yumeng Chen, Alberto Carrassi, and Véronique Dansereau
The Cryosphere, 17, 2965–2991, https://doi.org/10.5194/tc-17-2965-2023, https://doi.org/10.5194/tc-17-2965-2023, 2023
Short summary
Short summary
We combine deep learning with a regional sea-ice model to correct model errors in the sea-ice dynamics of low-resolution forecasts towards high-resolution simulations. The combined model improves the forecast by up to 75 % and thereby surpasses the performance of persistence. As the error connection can additionally be used to analyse the shortcomings of the forecasts, this study highlights the potential of combined modelling for short-term sea-ice forecasting.
Joffrey Dumont Le Brazidec, Pierre Vanderbecken, Alban Farchi, Marc Bocquet, Jinghui Lian, Grégoire Broquet, Gerrit Kuhlmann, Alexandre Danjou, and Thomas Lauvaux
Geosci. Model Dev., 16, 3997–4016, https://doi.org/10.5194/gmd-16-3997-2023, https://doi.org/10.5194/gmd-16-3997-2023, 2023
Short summary
Short summary
Monitoring of CO2 emissions is key to the development of reduction policies. Local emissions, from cities or power plants, may be estimated from CO2 plumes detected in satellite images. CO2 plumes generally have a weak signal and are partially concealed by highly variable background concentrations and instrument errors, which hampers their detection. To address this problem, we propose and apply deep learning methods to detect the contour of a plume in simulated CO2 satellite images.
Sukun Cheng, Yumeng Chen, Ali Aydoğdu, Laurent Bertino, Alberto Carrassi, Pierre Rampal, and Christopher K. R. T. Jones
The Cryosphere, 17, 1735–1754, https://doi.org/10.5194/tc-17-1735-2023, https://doi.org/10.5194/tc-17-1735-2023, 2023
Short summary
Short summary
This work studies a novel application of combining a Lagrangian sea ice model, neXtSIM, and data assimilation. It uses a deterministic ensemble Kalman filter to incorporate satellite-observed ice concentration and thickness in simulations. The neXtSIM Lagrangian nature is handled using a remapping strategy on a common homogeneous mesh. The ensemble is formed by perturbing air–ocean boundary conditions and ice cohesion. Thanks to data assimilation, winter Arctic sea ice forecasting is enhanced.
Pierre J. Vanderbecken, Joffrey Dumont Le Brazidec, Alban Farchi, Marc Bocquet, Yelva Roustan, Élise Potier, and Grégoire Broquet
Atmos. Meas. Tech., 16, 1745–1766, https://doi.org/10.5194/amt-16-1745-2023, https://doi.org/10.5194/amt-16-1745-2023, 2023
Short summary
Short summary
Instruments dedicated to monitoring atmospheric gaseous compounds from space will provide images of urban-scale plumes. We discuss here the use of new metrics to compare observed plumes with model predictions that will be less sensitive to meteorology uncertainties. We have evaluated our metrics on diverse plumes and shown that by eliminating some aspects of the discrepancies, they are indeed less sensitive to meteorological variations.
Jiping Xie, Roshin P. Raj, Laurent Bertino, Justino Martínez, Carolina Gabarró, and Rafael Catany
Ocean Sci., 19, 269–287, https://doi.org/10.5194/os-19-269-2023, https://doi.org/10.5194/os-19-269-2023, 2023
Short summary
Short summary
Sea ice melt, together with other freshwater sources, has effects on the Arctic environment. Sea surface salinity (SSS) plays a key role in representing water mixing. Recently the satellite SSS from SMOS was developed in the Arctic region. In this study, we first evaluate the impact of assimilating these satellite data in an Arctic reanalysis system. It shows that SSS errors are reduced by 10–50 % depending on areas, encouraging its use in a long-time reanalysis to monitor the Arctic water cycle.
Joffrey Dumont Le Brazidec, Marc Bocquet, Olivier Saunier, and Yelva Roustan
Geosci. Model Dev., 16, 1039–1052, https://doi.org/10.5194/gmd-16-1039-2023, https://doi.org/10.5194/gmd-16-1039-2023, 2023
Short summary
Short summary
When radionuclides are released into the atmosphere, the assessment of the consequences depends on the evaluation of the magnitude and temporal evolution of the release, which can be highly variable as in the case of Fukushima Daiichi.
Here, we propose Bayesian inverse modelling methods and the reversible-jump Markov chain Monte Carlo technique, which allows one to evaluate the temporal variability of the release and to integrate different types of information in the source reconstruction.
Colin Grudzien and Marc Bocquet
Geosci. Model Dev., 15, 7641–7681, https://doi.org/10.5194/gmd-15-7641-2022, https://doi.org/10.5194/gmd-15-7641-2022, 2022
Short summary
Short summary
Iterative optimization techniques, the state of the art in data assimilation, have largely focused on extending forecast accuracy to moderate- to long-range forecast systems. However, current methodology may not be cost-effective in reducing forecast errors in online, short-range forecast systems. We propose a novel optimization of these techniques for online, short-range forecast cycles, simultaneously providing an improvement in forecast accuracy and a reduction in the computational cost.
Georges Baaklini, Roy El Hourany, Milad Fakhri, Julien Brajard, Leila Issa, Gina Fifani, and Laurent Mortier
Ocean Sci., 18, 1491–1505, https://doi.org/10.5194/os-18-1491-2022, https://doi.org/10.5194/os-18-1491-2022, 2022
Short summary
Short summary
We use machine learning to analyze the long-term variation of the surface currents in the Levantine Sea, located in the eastern Mediterranean Sea. We decompose the circulation into groups based on their physical characteristics and analyze their spatial and temporal variability. We show that most structures of the Levantine Sea are becoming more energetic over time, despite those of the western area remaining the most dominant due to their complex bathymetry and strong currents.
Francine Schevenhoven and Alberto Carrassi
Geosci. Model Dev., 15, 3831–3844, https://doi.org/10.5194/gmd-15-3831-2022, https://doi.org/10.5194/gmd-15-3831-2022, 2022
Short summary
Short summary
In this study, we present a novel formulation to build a dynamical combination of models, the so-called supermodel, which needs to be trained based on data. Previously, we assumed complete and noise-free observations. Here, we move towards a realistic scenario and develop adaptations to the training methods in order to cope with sparse and noisy observations. The results are very promising and shed light on how to apply the method with state of the art general circulation models.
Fabio Mangini, Léon Chafik, Antonio Bonaduce, Laurent Bertino, and Jan Even Ø. Nilsen
Ocean Sci., 18, 331–359, https://doi.org/10.5194/os-18-331-2022, https://doi.org/10.5194/os-18-331-2022, 2022
Short summary
Short summary
We validate the recent ALES-reprocessed coastal satellite altimetry dataset along the Norwegian coast between 2003 and 2018. We find that coastal altimetry and conventional altimetry products perform similarly along the Norwegian coast. However, the agreement with tide gauges slightly increases in terms of trends when we use the ALES coastal altimetry data. We then use the ALES dataset and hydrographic stations to explore the steric contribution to the Norwegian sea-level anomaly.
Justino Martínez, Carolina Gabarró, Antonio Turiel, Verónica González-Gambau, Marta Umbert, Nina Hoareau, Cristina González-Haro, Estrella Olmedo, Manuel Arias, Rafael Catany, Laurent Bertino, Roshin P. Raj, Jiping Xie, Roberto Sabia, and Diego Fernández
Earth Syst. Sci. Data, 14, 307–323, https://doi.org/10.5194/essd-14-307-2022, https://doi.org/10.5194/essd-14-307-2022, 2022
Short summary
Short summary
Measuring salinity from space is challenging since the sensitivity of the brightness temperature to sea surface salinity is low, but the retrieval of SSS in cold waters is even more challenging. In 2019, the ESA launched a specific initiative called Arctic+Salinity to produce an enhanced Arctic SSS product with better quality and resolution than the available products. This paper presents the methodologies used to produce the new enhanced Arctic SMOS SSS product.
Yumeng Chen, Alberto Carrassi, and Valerio Lucarini
Nonlin. Processes Geophys., 28, 633–649, https://doi.org/10.5194/npg-28-633-2021, https://doi.org/10.5194/npg-28-633-2021, 2021
Short summary
Short summary
Chaotic dynamical systems are sensitive to the initial conditions, which are crucial for climate forecast. These properties are often used to inform the design of data assimilation (DA), a method used to estimate the exact initial conditions. However, obtaining the instability properties is burdensome for complex problems, both numerically and analytically. Here, we suggest a different viewpoint. We show that the skill of DA can be used to infer the instability properties of a dynamical system.
Joffrey Dumont Le Brazidec, Marc Bocquet, Olivier Saunier, and Yelva Roustan
Atmos. Chem. Phys., 21, 13247–13267, https://doi.org/10.5194/acp-21-13247-2021, https://doi.org/10.5194/acp-21-13247-2021, 2021
Short summary
Short summary
The assessment of the environmental consequences of a radionuclide release depends on the estimation of its source. This paper aims to develop inverse Bayesian methods which combine transport models with measurements, in order to reconstruct the ensemble of possible sources.
Three methods to quantify uncertainties based on the definition of probability distributions and the physical models are proposed and evaluated for the case of 106Ru releases over Europe in 2017.
Amy Solomon, Céline Heuzé, Benjamin Rabe, Sheldon Bacon, Laurent Bertino, Patrick Heimbach, Jun Inoue, Doroteaciro Iovino, Ruth Mottram, Xiangdong Zhang, Yevgeny Aksenov, Ronan McAdam, An Nguyen, Roshin P. Raj, and Han Tang
Ocean Sci., 17, 1081–1102, https://doi.org/10.5194/os-17-1081-2021, https://doi.org/10.5194/os-17-1081-2021, 2021
Short summary
Short summary
Freshwater in the Arctic Ocean plays a critical role in the global climate system by impacting ocean circulations, stratification, mixing, and emergent regimes. In this review paper we assess how Arctic Ocean freshwater changed in the 2010s relative to the 2000s. Estimates from observations and reanalyses show a qualitative stabilization in the 2010s due to a compensation between a freshening of the Beaufort Gyre and a reduction in freshwater in the Amerasian and Eurasian basins.
Sourav Chatterjee, Roshin P. Raj, Laurent Bertino, Sebastian H. Mernild, Meethale Puthukkottu Subeesh, Nuncio Murukesh, and Muthalagu Ravichandran
The Cryosphere, 15, 1307–1319, https://doi.org/10.5194/tc-15-1307-2021, https://doi.org/10.5194/tc-15-1307-2021, 2021
Short summary
Short summary
Sea ice in the Greenland Sea (GS) is important for its climatic (fresh water), economical (shipping), and ecological contribution (light availability). The study proposes a mechanism through which sea ice concentration in GS is partly governed by the atmospheric and ocean circulation in the region. The mechanism proposed in this study can be useful for assessing the sea ice variability and its future projection in the GS.
Khalil Yala, N'Dèye Niang, Julien Brajard, Carlos Mejia, Mory Ouattara, Roy El Hourany, Michel Crépon, and Sylvie Thiria
Ocean Sci., 16, 513–533, https://doi.org/10.5194/os-16-513-2020, https://doi.org/10.5194/os-16-513-2020, 2020
Short summary
Short summary
The paper is a contribution to the study of phytoplankton pigment climatology from satellite ocean-color observations in the Senegalo–Mauritanian upwelling, which is a very productive region where in situ observations are lacking. We processed the satellite data with an efficient new neural network classifier. We were able to provide the climatological cycle of diatoms. This study may have an economic impact on fisheries thanks to better knowledge of phytoplankton dynamics.
Colin Grudzien, Marc Bocquet, and Alberto Carrassi
Geosci. Model Dev., 13, 1903–1924, https://doi.org/10.5194/gmd-13-1903-2020, https://doi.org/10.5194/gmd-13-1903-2020, 2020
Short summary
Short summary
All scales of a dynamical physical process cannot be resolved accurately in a multiscale, geophysical model. The behavior of unresolved scales of motion are often parametrized by a random process to emulate their effects on the dynamically resolved variables, and this results in a random–dynamical model. We study how the choice of a numerical discretization of such a system affects the model forecast and estimation statistics, when the random–dynamical model is unbiased in its parametrization.
Roshin P. Raj, Sourav Chatterjee, Laurent Bertino, Antonio Turiel, and Marcos Portabella
Ocean Sci., 15, 1729–1744, https://doi.org/10.5194/os-15-1729-2019, https://doi.org/10.5194/os-15-1729-2019, 2019
Short summary
Short summary
In this study we investigated the variability of the Arctic Front (AF), an important biologically productive region in the Norwegian Sea, using a suite of satellite data, atmospheric reanalysis and a regional coupled ocean–sea ice data assimilation system. We show evidence of the two-way interaction between the atmosphere and the ocean at the AF. The North Atlantic Oscillation is found to influence the strength of the AF and may have a profound influence on the region's biological productivity.
Francine Schevenhoven, Frank Selten, Alberto Carrassi, and Noel Keenlyside
Earth Syst. Dynam., 10, 789–807, https://doi.org/10.5194/esd-10-789-2019, https://doi.org/10.5194/esd-10-789-2019, 2019
Short summary
Short summary
Weather and climate predictions potentially improve by dynamically combining different models into a
supermodel. A crucial step is to train the supermodel on the basis of observations. Here, we apply two different training methods to the global atmosphere–ocean–land model SPEEDO. We demonstrate that both training methods yield climate and weather predictions of superior quality compared to the individual models. Supermodel predictions can also outperform the commonly used multi-model mean.
Thomas Lauvaux, Liza I. Díaz-Isaac, Marc Bocquet, and Nicolas Bousserez
Atmos. Chem. Phys., 19, 12007–12024, https://doi.org/10.5194/acp-19-12007-2019, https://doi.org/10.5194/acp-19-12007-2019, 2019
Short summary
Short summary
A small-size ensemble of mesoscale simulations has been filtered to characterize the spatial structures of transport errors in atmospheric CO2 mixing ratios. The extracted error structures in in situ and column CO2 show similar length scales compared to other meteorological variables, including seasonality, which could be used as proxies in regional inversion systems.
Jiping Xie, Roshin P. Raj, Laurent Bertino, Annette Samuelsen, and Tsuyoshi Wakamatsu
Ocean Sci., 15, 1191–1206, https://doi.org/10.5194/os-15-1191-2019, https://doi.org/10.5194/os-15-1191-2019, 2019
Short summary
Short summary
Two gridded sea surface salinity (SSS) products have been derived from the European Space Agency’s Soil Moisture and Ocean Salinity mission. The uncertainties of these two products in the Arctic are quantified against two SSS products in the Copernicus Marine Environment Monitoring Services, two climatologies, and other in situ data. The results compared with independent in situ data clearly show a common challenge for the six SSS products to represent central Arctic freshwater masses (<24 psu).
Ali Aydoğdu, Alberto Carrassi, Colin T. Guider, Chris K. R. T Jones, and Pierre Rampal
Nonlin. Processes Geophys., 26, 175–193, https://doi.org/10.5194/npg-26-175-2019, https://doi.org/10.5194/npg-26-175-2019, 2019
Short summary
Short summary
Computational models involving adaptive meshes can both evolve dynamically and be remeshed. Remeshing means that the state vector dimension changes in time and across ensemble members, making the ensemble Kalman filter (EnKF) unsuitable for assimilation of observational data. We develop a modification in which analysis is performed on a fixed uniform grid onto which the ensemble is mapped, with resolution relating to the remeshing criteria. The approach is successfully tested on two 1-D models.
Julien Brajard, Alberto Carrassi, Marc Bocquet, and Laurent Bertino
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2019-136, https://doi.org/10.5194/gmd-2019-136, 2019
Revised manuscript not accepted
Short summary
Short summary
We explore the possibility of combining data assimilation with machine learning. We introduce a new hybrid method for a two-fold scope: (i) emulating hidden, possibly chaotic, dynamics and (ii) predicting its future states. Numerical experiments have been carried out using the chaotic Lorenz 96 model, proving both the convergence of the hybrid method and its statistical skills including short-term forecasting and emulation of the long-term dynamics.
Liza I. Díaz-Isaac, Thomas Lauvaux, Marc Bocquet, and Kenneth J. Davis
Atmos. Chem. Phys., 19, 5695–5718, https://doi.org/10.5194/acp-19-5695-2019, https://doi.org/10.5194/acp-19-5695-2019, 2019
Short summary
Short summary
We demonstrate that transport model errors, one of the main contributors to the uncertainty in regional CO2 inversions, can be represented by a small-size ensemble carefully calibrated with meteorological data. Our results also confirm transport model errors represent a significant fraction of the model–data mismatch in CO2 mole fractions and hence in regional inverse CO2 fluxes.
Jiping Xie, François Counillon, and Laurent Bertino
The Cryosphere, 12, 3671–3691, https://doi.org/10.5194/tc-12-3671-2018, https://doi.org/10.5194/tc-12-3671-2018, 2018
Short summary
Short summary
We use the winter sea-ice thickness dataset CS2SMOS merged from two satellites SMOS and CryoSat-2 for assimilation into an ice–ocean reanalysis of the Arctic, complemented by several other ocean and sea-ice measurements, using an Ensemble Kalman Filter. The errors of sea-ice thickness are reduced by 28% and the improvements persists through the summer when observations are unavailable. Improvements of ice drift are however limited to the Central Arctic.
Alban Farchi and Marc Bocquet
Nonlin. Processes Geophys., 25, 765–807, https://doi.org/10.5194/npg-25-765-2018, https://doi.org/10.5194/npg-25-765-2018, 2018
Short summary
Short summary
Data assimilation looks for an optimal way to learn from observations of a dynamical system to improve the quality of its predictions. The goal is to filter out the noise (both observation and model noise) to retrieve the true signal. Among all possible methods, particle filters are promising; the method is fast and elegant, and it allows for a Bayesian analysis. In this review paper, we discuss implementation techniques for (local) particle filters in high-dimensional systems.
Colin Grudzien, Alberto Carrassi, and Marc Bocquet
Nonlin. Processes Geophys., 25, 633–648, https://doi.org/10.5194/npg-25-633-2018, https://doi.org/10.5194/npg-25-633-2018, 2018
Short summary
Short summary
Using the framework Lyapunov vectors, we analyze the asymptotic properties of ensemble based Kalman filters and how these are influenced by dynamical chaos, especially in the context of random model errors and small ensemble sizes. Particularly, we show a novel derivation of the evolution of forecast uncertainty for ensemble-based Kalman filters with weakly-nonlinear error growth, and discuss its impact for filter design in geophysical models.
Olivier Pannekoucke, Marc Bocquet, and Richard Ménard
Nonlin. Processes Geophys., 25, 481–495, https://doi.org/10.5194/npg-25-481-2018, https://doi.org/10.5194/npg-25-481-2018, 2018
Short summary
Short summary
The forecast of weather prediction uncertainty is a real challenge and is crucial for risk management. However, uncertainty prediction is beyond the capacity of supercomputers, and improvements of the technology may not solve this issue. A new uncertainty prediction method is introduced which takes advantage of fluid equations to predict simple quantities which approximate real uncertainty but at a low numerical cost. A proof of concept is shown by an academic model derived from fluid dynamics.
Takuya Nakanowatari, Jun Inoue, Kazutoshi Sato, Laurent Bertino, Jiping Xie, Mio Matsueda, Akio Yamagami, Takeshi Sugimura, Hironori Yabuki, and Natsuhiko Otsuka
The Cryosphere, 12, 2005–2020, https://doi.org/10.5194/tc-12-2005-2018, https://doi.org/10.5194/tc-12-2005-2018, 2018
Short summary
Short summary
Medium-range predictability of early summer sea ice thickness in the East Siberian Sea was examined, based on TOPAZ4 forecast data. Statistical examination indicates that the estimate drops abruptly at 4 days, which is related to dynamical process controlled by synoptic-scale atmospheric fluctuations such as an Arctic cyclone. For longer lead times (> 4 days), the thermodynamic melting process takes over, which represents most of the remaining prediction.
Fabrice Ardhuin, Yevgueny Aksenov, Alvise Benetazzo, Laurent Bertino, Peter Brandt, Eric Caubet, Bertrand Chapron, Fabrice Collard, Sophie Cravatte, Jean-Marc Delouis, Frederic Dias, Gérald Dibarboure, Lucile Gaultier, Johnny Johannessen, Anton Korosov, Georgy Manucharyan, Dimitris Menemenlis, Melisa Menendez, Goulven Monnier, Alexis Mouche, Frédéric Nouguier, George Nurser, Pierre Rampal, Ad Reniers, Ernesto Rodriguez, Justin Stopa, Céline Tison, Clément Ubelmann, Erik van Sebille, and Jiping Xie
Ocean Sci., 14, 337–354, https://doi.org/10.5194/os-14-337-2018, https://doi.org/10.5194/os-14-337-2018, 2018
Short summary
Short summary
The Sea surface KInematics Multiscale (SKIM) monitoring mission is a proposal for a future satellite that is designed to measure ocean currents and waves. Using a Doppler radar, the accurate measurement of currents requires the removal of the mean velocity due to ocean wave motions. This paper describes the main processing steps needed to produce currents and wave data from the radar measurements. With this technique, SKIM can provide unprecedented coverage and resolution, over the global ocean.
Anthony Fillion, Marc Bocquet, and Serge Gratton
Nonlin. Processes Geophys., 25, 315–334, https://doi.org/10.5194/npg-25-315-2018, https://doi.org/10.5194/npg-25-315-2018, 2018
Short summary
Short summary
This study generalizes a paper by Pires et al. (1996) to state-of-the-art data assimilation techniques, such as the iterative ensemble Kalman smoother (IEnKS). We show that the longer the time window over which observations are assimilated, the better the accuracy of the IEnKS. Beyond a critical time length that we estimate, we show that this accuracy finally degrades. We show that the use of the quasi-static minimizations but generalized to the IEnKS yields a significantly improved accuracy.
Matthias Rabatel, Pierre Rampal, Alberto Carrassi, Laurent Bertino, and Christopher K. R. T. Jones
The Cryosphere, 12, 935–953, https://doi.org/10.5194/tc-12-935-2018, https://doi.org/10.5194/tc-12-935-2018, 2018
Short summary
Short summary
Large deviations still exist between sea ice forecasts and observations because of both missing physics in models and uncertainties on model inputs. We investigate how the new sea ice model neXtSIM is sensitive to uncertainties in the winds. We highlight and quantify the role of the internal forces in the ice on this sensitivity and show that neXtSIM is better at predicting sea ice drift than a free-drift (without internal forces) ice model and is a skilful tool for search and rescue operations.
Kristoffer Aalstad, Sebastian Westermann, Thomas Vikhamar Schuler, Julia Boike, and Laurent Bertino
The Cryosphere, 12, 247–270, https://doi.org/10.5194/tc-12-247-2018, https://doi.org/10.5194/tc-12-247-2018, 2018
Short summary
Short summary
We demonstrate how snow cover data from satellites can be used to constrain estimates of snow distributions at sites in the Arctic. In this effort, we make use of data assimilation to combine the information contained in the snow cover data with a simple snow model. By comparing our snow distribution estimates to independent observations, we find that this method performs favorably. Being modular, this method could be applied to other areas as a component of a larger reanalysis system.
Jiping Xie, Laurent Bertino, François Counillon, Knut A. Lisæter, and Pavel Sakov
Ocean Sci., 13, 123–144, https://doi.org/10.5194/os-13-123-2017, https://doi.org/10.5194/os-13-123-2017, 2017
Short summary
Short summary
The Arctic Ocean plays an important role in the global climate system, but the concerned interpretation about its changes is severely hampered by the sparseness of the observations of sea ice and ocean. The focus of this study is to provide a quantitative assessment of the performance of the TOPAZ4 reanalysis for ocean and sea ice variables in the pan-Arctic region (north of 63 °N) in order to guide the user through its skills and limitations.
Hector Simon Benavides Pinjosovsky, Sylvie Thiria, Catherine Ottlé, Julien Brajard, Fouad Badran, and Pascal Maugis
Geosci. Model Dev., 10, 85–104, https://doi.org/10.5194/gmd-10-85-2017, https://doi.org/10.5194/gmd-10-85-2017, 2017
Short summary
Short summary
The objective of this work is to deliver the adjoint model of SECHIBA obtained with software called YAO, in order to perform 4D-VAR data assimilation. The SECHIBA module of the ORCHIDEE land surface model describes the exchanges of water and energy between the surface and the atmosphere. A distributed version is available when only the land surface temperature is used as an observation, with two examples and documentation.
Jiping Xie, François Counillon, Laurent Bertino, Xiangshan Tian-Kunze, and Lars Kaleschke
The Cryosphere, 10, 2745–2761, https://doi.org/10.5194/tc-10-2745-2016, https://doi.org/10.5194/tc-10-2745-2016, 2016
Short summary
Short summary
As a potentially operational daily product, the SMOS-Ice can improve the statements of sea ice thickness and concentration. In this study, focusing on the SMOS-Ice data assimilated into the TOPAZ system, the quantitative evaluation for the impacts and the concerned comparison with the present observation system are valuable to understand the further improvement of the accuracy of operational ocean forecasting system.
J.-M. Haussaire and M. Bocquet
Geosci. Model Dev., 9, 393–412, https://doi.org/10.5194/gmd-9-393-2016, https://doi.org/10.5194/gmd-9-393-2016, 2016
Short summary
Short summary
The focus is on the development of low-order models of atmospheric transport and chemistry and their use for data assimilation purposes. A new low-order coupled chemistry meteorology model is developed. It consists of the Lorenz40-variable model used as a wind field coupled with a simple ozone photochemistry module. Advanced ensemble variational methods are applied to this model to obtain insights on the use of data assimilation with coupled models, in an offline mode or in an online mode.
M. Bocquet, P. N. Raanes, and A. Hannart
Nonlin. Processes Geophys., 22, 645–662, https://doi.org/10.5194/npg-22-645-2015, https://doi.org/10.5194/npg-22-645-2015, 2015
Short summary
Short summary
The popular data assimilation technique known as the ensemble Kalman filter (EnKF) suffers from sampling errors due to the limited size of the ensemble. This deficiency is usually cured by inflating the sampled error covariances and by using localization. This paper further develops and discusses the finite-size EnKF, or EnKF-N, a variant of the EnKF that does not require inflation. It expands the use of the EnKF-N to a wider range of dynamical regimes.
M. Bocquet, H. Elbern, H. Eskes, M. Hirtl, R. Žabkar, G. R. Carmichael, J. Flemming, A. Inness, M. Pagowski, J. L. Pérez Camaño, P. E. Saide, R. San Jose, M. Sofiev, J. Vira, A. Baklanov, C. Carnevale, G. Grell, and C. Seigneur
Atmos. Chem. Phys., 15, 5325–5358, https://doi.org/10.5194/acp-15-5325-2015, https://doi.org/10.5194/acp-15-5325-2015, 2015
Short summary
Short summary
Data assimilation is used in atmospheric chemistry models to improve air quality forecasts, construct re-analyses of concentrations, and perform inverse modeling. Coupled chemistry meteorology models (CCMM) are atmospheric chemistry models that simulate meteorological processes and chemical transformations jointly. We review here the current status of data assimilation in atmospheric chemistry models, with a particular focus on future prospects for data assimilation in CCMM.
Y. Wang, K. N. Sartelet, M. Bocquet, P. Chazette, M. Sicard, G. D'Amico, J. F. Léon, L. Alados-Arboledas, A. Amodeo, P. Augustin, J. Bach, L. Belegante, I. Binietoglou, X. Bush, A. Comerón, H. Delbarre, D. García-Vízcaino, J. L. Guerrero-Rascado, M. Hervo, M. Iarlori, P. Kokkalis, D. Lange, F. Molero, N. Montoux, A. Muñoz, C. Muñoz, D. Nicolae, A. Papayannis, G. Pappalardo, J. Preissler, V. Rizi, F. Rocadenbosch, K. Sellegri, F. Wagner, and F. Dulac
Atmos. Chem. Phys., 14, 12031–12053, https://doi.org/10.5194/acp-14-12031-2014, https://doi.org/10.5194/acp-14-12031-2014, 2014
Y. Wang, K. N. Sartelet, M. Bocquet, and P. Chazette
Atmos. Chem. Phys., 14, 3511–3532, https://doi.org/10.5194/acp-14-3511-2014, https://doi.org/10.5194/acp-14-3511-2014, 2014
O. Saunier, A. Mathieu, D. Didier, M. Tombette, D. Quélo, V. Winiarek, and M. Bocquet
Atmos. Chem. Phys., 13, 11403–11421, https://doi.org/10.5194/acp-13-11403-2013, https://doi.org/10.5194/acp-13-11403-2013, 2013
M. Bocquet and P. Sakov
Nonlin. Processes Geophys., 20, 803–818, https://doi.org/10.5194/npg-20-803-2013, https://doi.org/10.5194/npg-20-803-2013, 2013
M. R. Koohkan, M. Bocquet, Y. Roustan, Y. Kim, and C. Seigneur
Atmos. Chem. Phys., 13, 5887–5905, https://doi.org/10.5194/acp-13-5887-2013, https://doi.org/10.5194/acp-13-5887-2013, 2013
Y. Wang, K. N. Sartelet, M. Bocquet, and P. Chazette
Atmos. Chem. Phys., 13, 269–283, https://doi.org/10.5194/acp-13-269-2013, https://doi.org/10.5194/acp-13-269-2013, 2013
Related subject area
Subject: Predictability, probabilistic forecasts, data assimilation, inverse problems | Topic: Climate, atmosphere, ocean, hydrology, cryosphere, biosphere
Dynamic–statistic combined ensemble prediction and impact factors of China's summer precipitation
Evaluation of Effectiveness of Intervention Strategy in Control Simulation Experiment through Comparison with Model Predictive Control
Inferring flow energy, space scales, and timescales: freely drifting vs. fixed-point observations
Multilevel Monte Carlo methods for ensemble variational data assimilation
Explaining the high skill of Reservoir Computing methods in El Niño prediction
A comparison of two nonlinear data assimilation methods
On Process-Oriented Conditional Targeted Covariance Inflation (TCI) for 3D-Volume Radar Data Assimilation
Prognostic assumed-probability-density-function (distribution density function) approach: further generalization and demonstrations
Bridging classical data assimilation and optimal transport: the 3D-Var case
Leading the Lorenz 63 system toward the prescribed regime by model predictive control coupled with data assimilation
Selecting and weighting dynamical models using data-driven approaches
Improving ensemble data assimilation through Probit-space Ensemble Size Expansion for Gaussian Copulas (PESE-GC)
A quest for precipitation attractors in weather radar archives
Quantum data assimilation: a new approach to solving data assimilation on quantum annealers
Evolution of small-scale turbulence at large Richardson numbers
Robust weather-adaptive post-processing using model output statistics random forests
Comparative study of strongly and weakly coupled data assimilation with a global land–atmosphere coupled model
How far can the statistical error estimation problem be closed by collocated data?
Using orthogonal vectors to improve the ensemble space of the ensemble Kalman filter and its effect on data assimilation and forecasting
Review article: Towards strongly coupled ensemble data assimilation with additional improvements from machine learning
Reducing manipulations in a control simulation experiment based on instability vectors with the Lorenz-63 model
Control simulation experiments of extreme events with the Lorenz-96 model
Toward a multivariate formulation of the parametric Kalman filter assimilation: application to a simplified chemical transport model
Data-driven reconstruction of partially observed dynamical systems
A range of outcomes: the combined effects of internal variability and anthropogenic forcing on regional climate trends over Europe
Extending ensemble Kalman filter algorithms to assimilate observations with an unknown time offset
Guidance on how to improve vertical covariance localization based on a 1000-member ensemble
Weather pattern dynamics over western Europe under climate change: predictability, information entropy and production
Using a hybrid optimal interpolation–ensemble Kalman filter for the Canadian Precipitation Analysis
Applying prior correlations for ensemble-based spatial localization
A stochastic covariance shrinkage approach to particle rejuvenation in the ensemble transform particle filter
Control simulation experiment with Lorenz's butterfly attractor
Ensemble Riemannian data assimilation: towards large-scale dynamical systems
Inferring the instability of a dynamical system from the skill of data assimilation exercises
Reduced non-Gaussianity by 30 s rapid update in convective-scale numerical weather prediction
Multivariate localization functions for strongly coupled data assimilation in the bivariate Lorenz 96 system
A study of capturing Atlantic meridional overturning circulation (AMOC) regime transition through observation-constrained model parameters
Calibrated ensemble forecasts of the height of new snow using quantile regression forests and ensemble model output statistics
Enhancing geophysical flow machine learning performance via scale separation
Improving the potential accuracy and usability of EURO-CORDEX estimates of future rainfall climate using frequentist model averaging
Ensemble Riemannian data assimilation over the Wasserstein space
An early warning sign of critical transition in the Antarctic ice sheet – a data-driven tool for a spatiotemporal tipping point
Training a convolutional neural network to conserve mass in data assimilation
Behavior of the iterative ensemble-based variational method in nonlinear problems
Fast hybrid tempered ensemble transform filter formulation for Bayesian elliptical problems via Sinkhorn approximation
A methodology to obtain model-error covariances due to the discretization scheme from the parametric Kalman filter perspective
A method for predicting the uncompleted climate transition process
Statistical postprocessing of ensemble forecasts for severe weather at Deutscher Wetterdienst
Data-driven predictions of a multiscale Lorenz 96 chaotic system using machine-learning methods: reservoir computing, artificial neural network, and long short-term memory network
From research to applications – examples of operational ensemble post-processing in France using machine learning
Xiaojuan Wang, Zihan Yang, Shuai Li, Qingquan Li, and Guolin Feng
Nonlin. Processes Geophys., 32, 117–130, https://doi.org/10.5194/npg-32-117-2025, https://doi.org/10.5194/npg-32-117-2025, 2025
Short summary
Short summary
Unequal-weighted ensemble prediction (UWE) using outputs of the dynamic–statistic prediction is presented, and its possible impact factors are also analysed. Results indicate that the UWE has shown promise in improving the prediction skill of summer precipitation in China on account of the fact that UWE can overcome the shortcomings of the structural inadequacy of individual dynamic–statistic predictions, reducing formulation uncertainties and resulting in more stable and accurate predictions.
Rikuto Nagai, Yang Bai, Masaki Ogura, Shunji Kotsuki, and Naoki Wakamiya
Nonlin. Processes Geophys. Discuss., https://doi.org/10.5194/npg-2024-26, https://doi.org/10.5194/npg-2024-26, 2024
Preprint under review for NPG
Short summary
Short summary
Controlling chaotic systems is a key step toward weather control. The Control Simulation Experiment (CSE) modifies weather systems using small perturbations, as shown in studies with the Lorenz-63 model. However, the effectiveness of CSE compared to other methods is unclear. This study evaluates CSE against Model Predictive Control (MPC). Simulations reveal that MPC achieves higher success rates with less effort under certain conditions, linking control theory and atmospheric science.
Aurelien Luigi Serge Ponte, Lachlan C. Astfalck, Matthew D. Rayson, Andrew P. Zulberti, and Nicole L. Jones
Nonlin. Processes Geophys., 31, 571–586, https://doi.org/10.5194/npg-31-571-2024, https://doi.org/10.5194/npg-31-571-2024, 2024
Short summary
Short summary
We propose a novel method for the estimation of ocean surface flow properties in terms of its energy and spatial and temporal scales. The method relies on flow observations collected either at a fixed location or along the flow, as would be inferred from the trajectory of freely drifting platforms. The accuracy of the method is quantified in several experimental configurations. We innovatively demonstrate that freely drifting platforms, even in isolation, can be used to capture flow properties.
Mayeul Destouches, Paul Mycek, Selime Gürol, Anthony T. Weaver, Serge Gratton, and Ehouarn Simon
EGUsphere, https://doi.org/10.5194/egusphere-2024-3628, https://doi.org/10.5194/egusphere-2024-3628, 2024
Short summary
Short summary
We explore the potential of Multilevel Monte Carlo methods to improve ensemble-variational data assimilation without increasing the computational cost. By shifting part of the ensemble generation cost to coarser simulation grids, larger sample sizes and smaller sampling errors become affordable, while keeping the final estimate unbiased. Numerical experiments with a quasi-geostrophic model demonstrate the potential of the approach and highlight the challenges towards operational implementation.
Francesco Guardamagna, Claudia Wieners, and Henk Dijkstra
Nonlin. Processes Geophys. Discuss., https://doi.org/10.5194/npg-2024-24, https://doi.org/10.5194/npg-2024-24, 2024
Revised manuscript accepted for NPG
Short summary
Short summary
Artificial intelligence (AI) has recently shown promising results in ENSO (El Niño Southern Oscillation) forecasting, outperforming traditional models. Yet, AI models deliver accurate predictions without showing the underlying mechanisms. Our study examines a specific AI model, the Reservoir Computer (RC). Our results show that the RC is less sensitive to initial perturbations than the traditional Zebiak and Cane (ZC) model. This reduced sensitivity can explain the RC's superior skills.
Vivian A. Montiforte, Hans E. Ngodock, and Innocent Souopgui
Nonlin. Processes Geophys., 31, 463–476, https://doi.org/10.5194/npg-31-463-2024, https://doi.org/10.5194/npg-31-463-2024, 2024
Short summary
Short summary
Advanced data assimilation methods are complex and computationally expensive. We compare two simpler methods, diffusive back-and-forth nudging and concave–convex nonlinearity, which account for change over time with the potential of providing accurate results with a reduced computational cost. We evaluate the accuracy of the two methods by implementing them within simple chaotic models. We conclude that the length and frequency of observations impact which method is better suited for a problem.
Klaus Vobig, Roland Potthast, and Klaus Stephan
EGUsphere, https://doi.org/10.5194/egusphere-2024-2876, https://doi.org/10.5194/egusphere-2024-2876, 2024
Short summary
Short summary
We present a novel approach to targeted covariance inflation (TCI) which aims to improve the assimilation of 3D radar reflectivity and, eventually, the short-term forecast of reflectivity and precipitation.
Using an operational numerical weather prediction framework, our numerical results show that TCI makes the system accurately generate new reflectivity cells and significantly improves the fractional skill score of forecasts over lead times of up to six hours by up to 10 %.
Jun-Ichi Yano
Nonlin. Processes Geophys., 31, 359–380, https://doi.org/10.5194/npg-31-359-2024, https://doi.org/10.5194/npg-31-359-2024, 2024
Short summary
Short summary
A methodology for directly predicting the time evolution of the assumed parameters for the distribution densities based on the Liouville equation, as proposed earlier, is extended to multidimensional cases and to cases in which the systems are constrained by integrals over a part of the variable range. The extended methodology is tested against a convective energy-cycle system as well as the Lorenz strange attractor.
Marc Bocquet, Pierre J. Vanderbecken, Alban Farchi, Joffrey Dumont Le Brazidec, and Yelva Roustan
Nonlin. Processes Geophys., 31, 335–357, https://doi.org/10.5194/npg-31-335-2024, https://doi.org/10.5194/npg-31-335-2024, 2024
Short summary
Short summary
A novel approach, optimal transport data assimilation (OTDA), is introduced to merge DA and OT concepts. By leveraging OT's displacement interpolation in space, it minimises mislocation errors within DA applied to physical fields, such as water vapour, hydrometeors, and chemical species. Its richness and flexibility are showcased through one- and two-dimensional illustrations.
Fumitoshi Kawasaki and Shunji Kotsuki
Nonlin. Processes Geophys., 31, 319–333, https://doi.org/10.5194/npg-31-319-2024, https://doi.org/10.5194/npg-31-319-2024, 2024
Short summary
Short summary
Recently, scientists have been looking into ways to control the weather to lead to a desirable direction for mitigating weather-induced disasters caused by torrential rainfall and typhoons. This study proposes using the model predictive control (MPC), an advanced control method, to control a chaotic system. Through numerical experiments using a low-dimensional chaotic system, we demonstrate that the system can be successfully controlled with shorter forecasts compared to previous studies.
Pierre Le Bras, Florian Sévellec, Pierre Tandeo, Juan Ruiz, and Pierre Ailliot
Nonlin. Processes Geophys., 31, 303–317, https://doi.org/10.5194/npg-31-303-2024, https://doi.org/10.5194/npg-31-303-2024, 2024
Short summary
Short summary
The goal of this paper is to weight several dynamic models in order to improve the representativeness of a system. It is illustrated using a set of versions of an idealized model describing the Atlantic Meridional Overturning Circulation. The low-cost method is based on data-driven forecasts. It enables model performance to be evaluated on their dynamics. Taking into account both model performance and codependency, the derived weights outperform benchmarks in reconstructing a model distribution.
Man-Yau Chan
Nonlin. Processes Geophys., 31, 287–302, https://doi.org/10.5194/npg-31-287-2024, https://doi.org/10.5194/npg-31-287-2024, 2024
Short summary
Short summary
Forecasts have uncertainties. It is thus essential to reduce these uncertainties. Such reduction requires uncertainty quantification, which often means running costly models multiple times. The cost limits the number of model runs and thus the quantification’s accuracy. This study proposes a technique that utilizes users’ knowledge of forecast uncertainties to improve uncertainty quantification. Tests show that this technique improves uncertainty reduction.
Loris Foresti, Bernat Puigdomènech Treserras, Daniele Nerini, Aitor Atencia, Marco Gabella, Ioannis V. Sideris, Urs Germann, and Isztar Zawadzki
Nonlin. Processes Geophys., 31, 259–286, https://doi.org/10.5194/npg-31-259-2024, https://doi.org/10.5194/npg-31-259-2024, 2024
Short summary
Short summary
We compared two ways of defining the phase space of low-dimensional attractors describing the evolution of radar precipitation fields. The first defines the phase space by the domain-scale statistics of precipitation fields, such as their mean, spatial and temporal correlations. The second uses principal component analysis to account for the spatial distribution of precipitation. To represent different climates, radar archives over the United States and the Swiss Alpine region were used.
Shunji Kotsuki, Fumitoshi Kawasaki, and Masanao Ohashi
Nonlin. Processes Geophys., 31, 237–245, https://doi.org/10.5194/npg-31-237-2024, https://doi.org/10.5194/npg-31-237-2024, 2024
Short summary
Short summary
In Earth science, data assimilation plays an important role in integrating real-world observations with numerical simulations for improving subsequent predictions. To overcome the time-consuming computations of conventional data assimilation methods, this paper proposes using quantum annealing machines. Using the D-Wave quantum annealer, the proposed method found solutions with comparable accuracy to conventional approaches and significantly reduced computational time.
Lev Ostrovsky, Irina Soustova, Yuliya Troitskaya, and Daria Gladskikh
Nonlin. Processes Geophys., 31, 219–227, https://doi.org/10.5194/npg-31-219-2024, https://doi.org/10.5194/npg-31-219-2024, 2024
Short summary
Short summary
The nonstationary kinetic model of turbulence is used to describe the evolution and structure of the upper turbulent layer with the parameters taken from in situ observations. As an example, we use a set of data for three cruises made in different areas of the world ocean. With the given profiles of current shear and buoyancy frequency, the theory yields results that satisfactorily agree with the measurements of the turbulent dissipation rate.
Thomas Muschinski, Georg J. Mayr, Achim Zeileis, and Thorsten Simon
Nonlin. Processes Geophys., 30, 503–514, https://doi.org/10.5194/npg-30-503-2023, https://doi.org/10.5194/npg-30-503-2023, 2023
Short summary
Short summary
Statistical post-processing is necessary to generate probabilistic forecasts from physical numerical weather prediction models. To allow for more flexibility, there has been a shift in post-processing away from traditional parametric regression models towards modern machine learning methods. By fusing these two approaches, we developed model output statistics random forests, a new post-processing method that is highly flexible but at the same time also very robust and easy to interpret.
Kenta Kurosawa, Shunji Kotsuki, and Takemasa Miyoshi
Nonlin. Processes Geophys., 30, 457–479, https://doi.org/10.5194/npg-30-457-2023, https://doi.org/10.5194/npg-30-457-2023, 2023
Short summary
Short summary
This study aimed to enhance weather and hydrological forecasts by integrating soil moisture data into a global weather model. By assimilating atmospheric observations and soil moisture data, the accuracy of forecasts was improved, and certain biases were reduced. The method was found to be particularly beneficial in areas like the Sahel and equatorial Africa, where precipitation patterns vary seasonally. This new approach has the potential to improve the precision of weather predictions.
Annika Vogel and Richard Ménard
Nonlin. Processes Geophys., 30, 375–398, https://doi.org/10.5194/npg-30-375-2023, https://doi.org/10.5194/npg-30-375-2023, 2023
Short summary
Short summary
Accurate estimation of the error statistics required for data assimilation remains an ongoing challenge, as statistical assumptions are required to solve the estimation problem. This work provides a conceptual view of the statistical error estimation problem in light of the increasing number of available datasets. We found that the total number of required assumptions increases with the number of overlapping datasets, but the relative number of error statistics that can be estimated increases.
Yung-Yun Cheng, Shu-Chih Yang, Zhe-Hui Lin, and Yung-An Lee
Nonlin. Processes Geophys., 30, 289–297, https://doi.org/10.5194/npg-30-289-2023, https://doi.org/10.5194/npg-30-289-2023, 2023
Short summary
Short summary
In the ensemble Kalman filter, the ensemble space may not fully capture the forecast errors due to the limited ensemble size and systematic model errors, which affect the accuracy of analysis and prediction. This study proposes a new algorithm to use cost-free pseudomembers to expand the ensemble space effectively and improve analysis accuracy during the analysis step, without increasing the ensemble size during forecasting.
Eugenia Kalnay, Travis Sluka, Takuma Yoshida, Cheng Da, and Safa Mote
Nonlin. Processes Geophys., 30, 217–236, https://doi.org/10.5194/npg-30-217-2023, https://doi.org/10.5194/npg-30-217-2023, 2023
Short summary
Short summary
Strongly coupled data assimilation (SCDA) generates coherent integrated Earth system analyses by assimilating the full Earth observation set into all Earth components. We describe SCDA based on the ensemble Kalman filter with a hierarchy of coupled models, from a coupled Lorenz to the Climate Forecast System v2. SCDA with a sufficiently large ensemble can provide more accurate coupled analyses compared to weakly coupled DA. The correlation-cutoff method can compensate for a small ensemble size.
Mao Ouyang, Keita Tokuda, and Shunji Kotsuki
Nonlin. Processes Geophys., 30, 183–193, https://doi.org/10.5194/npg-30-183-2023, https://doi.org/10.5194/npg-30-183-2023, 2023
Short summary
Short summary
This research found that weather control would change the chaotic behavior of an atmospheric model. We proposed to introduce chaos theory in the weather control. Experimental results demonstrated that the proposed approach reduced the manipulations, including the control times and magnitudes, which throw light on the weather control in a real atmospheric model.
Qiwen Sun, Takemasa Miyoshi, and Serge Richard
Nonlin. Processes Geophys., 30, 117–128, https://doi.org/10.5194/npg-30-117-2023, https://doi.org/10.5194/npg-30-117-2023, 2023
Short summary
Short summary
This paper is a follow-up of a work by Miyoshi and Sun which was published in NPG Letters in 2022. The control simulation experiment is applied to the Lorenz-96 model for avoiding extreme events. The results show that extreme events of this partially and imperfectly observed chaotic system can be avoided by applying pre-designed small perturbations. These investigations may be extended to more realistic numerical weather prediction models.
Antoine Perrot, Olivier Pannekoucke, and Vincent Guidard
Nonlin. Processes Geophys., 30, 139–166, https://doi.org/10.5194/npg-30-139-2023, https://doi.org/10.5194/npg-30-139-2023, 2023
Short summary
Short summary
This work is a theoretical contribution that provides equations for understanding uncertainty prediction applied in air quality where multiple chemical species can interact. A simplified minimal test bed is introduced that shows the ability of our equations to reproduce the statistics estimated from an ensemble of forecasts. While the latter estimation is the state of the art, solving equations is numerically less costly, depending on the number of chemical species, and motivates this research.
Pierre Tandeo, Pierre Ailliot, and Florian Sévellec
Nonlin. Processes Geophys., 30, 129–137, https://doi.org/10.5194/npg-30-129-2023, https://doi.org/10.5194/npg-30-129-2023, 2023
Short summary
Short summary
The goal of this paper is to obtain probabilistic predictions of a partially observed dynamical system without knowing the model equations. It is illustrated using the three-dimensional Lorenz system, where only two components are observed. The proposed data-driven procedure is low-cost, is easy to implement, uses linear and Gaussian assumptions and requires only a small amount of data. It is based on an iterative linear Kalman smoother with a state augmentation.
Clara Deser and Adam S. Phillips
Nonlin. Processes Geophys., 30, 63–84, https://doi.org/10.5194/npg-30-63-2023, https://doi.org/10.5194/npg-30-63-2023, 2023
Short summary
Short summary
Past and future climate change at regional scales is a result of both human influences and natural (internal) variability. Here, we provide an overview of recent advances in climate modeling and physical understanding that has led to new insights into their respective roles, illustrated with original results for the European climate. Our findings highlight the confounding role of internal variability in attribution, climate model evaluation, and accuracy of future projections.
Elia Gorokhovsky and Jeffrey L. Anderson
Nonlin. Processes Geophys., 30, 37–47, https://doi.org/10.5194/npg-30-37-2023, https://doi.org/10.5194/npg-30-37-2023, 2023
Short summary
Short summary
Older observations of the Earth system sometimes lack information about the time they were taken, posing problems for analyses of past climate. To begin to ameliorate this problem, we propose new methods of varying complexity, including methods to estimate the distribution of the offsets between true and reported observation times. The most successful method accounts for the nonlinearity in the system, but even the less expensive ones can improve data assimilation in the presence of time error.
Tobias Necker, David Hinger, Philipp Johannes Griewank, Takemasa Miyoshi, and Martin Weissmann
Nonlin. Processes Geophys., 30, 13–29, https://doi.org/10.5194/npg-30-13-2023, https://doi.org/10.5194/npg-30-13-2023, 2023
Short summary
Short summary
This study investigates vertical localization based on a convection-permitting 1000-member ensemble simulation. We derive an empirical optimal localization (EOL) that minimizes sampling error in 40-member sub-sample correlations assuming 1000-member correlations as truth. The results will provide guidance for localization in convective-scale ensemble data assimilation systems.
Stéphane Vannitsem
Nonlin. Processes Geophys., 30, 1–12, https://doi.org/10.5194/npg-30-1-2023, https://doi.org/10.5194/npg-30-1-2023, 2023
Short summary
Short summary
The impact of climate change on weather pattern dynamics over the North Atlantic is explored through the lens of information theory. These tools allow the predictability of the succession of weather patterns and the irreversible nature of the dynamics to be clarified. It is shown that the predictability is increasing in the observations, while the opposite trend is found in model projections. The irreversibility displays an overall increase in time in both the observations and the model runs.
Dikraa Khedhaouiria, Stéphane Bélair, Vincent Fortin, Guy Roy, and Franck Lespinas
Nonlin. Processes Geophys., 29, 329–344, https://doi.org/10.5194/npg-29-329-2022, https://doi.org/10.5194/npg-29-329-2022, 2022
Short summary
Short summary
This study introduces a well-known use of hybrid methods in data assimilation (DA) algorithms that has not yet been explored for precipitation analyses. Our approach combined an ensemble-based DA approach with an existing deterministically based DA. Both DA scheme families have desirable aspects that can be leveraged if combined. The DA hybrid method showed better precipitation analyses in regions with a low rate of assimilated surface observations, which is typically the case in winter.
Chu-Chun Chang and Eugenia Kalnay
Nonlin. Processes Geophys., 29, 317–327, https://doi.org/10.5194/npg-29-317-2022, https://doi.org/10.5194/npg-29-317-2022, 2022
Short summary
Short summary
This study introduces a new approach for enhancing the ensemble data assimilation (DA), a technique that combines observations and forecasts to improve numerical weather predictions. Our method uses the prescribed correlations to suppress spurious errors, improving the accuracy of DA. The experiments on the simplified atmosphere model show that our method has comparable performance to the traditional method but is superior in the early stage and is more computationally efficient.
Andrey A. Popov, Amit N. Subrahmanya, and Adrian Sandu
Nonlin. Processes Geophys., 29, 241–253, https://doi.org/10.5194/npg-29-241-2022, https://doi.org/10.5194/npg-29-241-2022, 2022
Short summary
Short summary
Numerical weather prediction requires the melding of both computational model and data obtained from sensors such as satellites. We focus on one algorithm to accomplish this. We aim to aid its use by additionally supplying it with data obtained from separate models that describe the average behavior of the computational model at any given time. We show that our approach outperforms the standard approaches to this problem.
Takemasa Miyoshi and Qiwen Sun
Nonlin. Processes Geophys., 29, 133–139, https://doi.org/10.5194/npg-29-133-2022, https://doi.org/10.5194/npg-29-133-2022, 2022
Short summary
Short summary
The weather is chaotic and hard to predict, but the chaos implies an effective control where a small control signal grows rapidly to make a big difference. This study proposes a control simulation experiment where we apply a small signal to control
naturein a computational simulation. Idealized experiments with a low-order chaotic system show successful results by small control signals of only 3 % of the observation error. This is the first step toward realistic weather simulations.
Sagar K. Tamang, Ardeshir Ebtehaj, Peter Jan van Leeuwen, Gilad Lerman, and Efi Foufoula-Georgiou
Nonlin. Processes Geophys., 29, 77–92, https://doi.org/10.5194/npg-29-77-2022, https://doi.org/10.5194/npg-29-77-2022, 2022
Short summary
Short summary
The outputs from Earth system models are optimally combined with satellite observations to produce accurate forecasts through a process called data assimilation. Many existing data assimilation methodologies have some assumptions regarding the shape of the probability distributions of model output and observations, which results in forecast inaccuracies. In this paper, we test the effectiveness of a newly proposed methodology that relaxes such assumptions about high-dimensional models.
Yumeng Chen, Alberto Carrassi, and Valerio Lucarini
Nonlin. Processes Geophys., 28, 633–649, https://doi.org/10.5194/npg-28-633-2021, https://doi.org/10.5194/npg-28-633-2021, 2021
Short summary
Short summary
Chaotic dynamical systems are sensitive to the initial conditions, which are crucial for climate forecast. These properties are often used to inform the design of data assimilation (DA), a method used to estimate the exact initial conditions. However, obtaining the instability properties is burdensome for complex problems, both numerically and analytically. Here, we suggest a different viewpoint. We show that the skill of DA can be used to infer the instability properties of a dynamical system.
Juan Ruiz, Guo-Yuan Lien, Keiichi Kondo, Shigenori Otsuka, and Takemasa Miyoshi
Nonlin. Processes Geophys., 28, 615–626, https://doi.org/10.5194/npg-28-615-2021, https://doi.org/10.5194/npg-28-615-2021, 2021
Short summary
Short summary
Effective use of observations with numerical weather prediction models, also known as data assimilation, is a key part of weather forecasting systems. For precise prediction at the scales of thunderstorms, fast nonlinear processes pose a grand challenge because most data assimilation systems are based on linear processes and normal distribution errors. We investigate how, every 30 s, weather radar observations can help reduce the effect of nonlinear processes and nonnormal distributions.
Zofia Stanley, Ian Grooms, and William Kleiber
Nonlin. Processes Geophys., 28, 565–583, https://doi.org/10.5194/npg-28-565-2021, https://doi.org/10.5194/npg-28-565-2021, 2021
Short summary
Short summary
In weather forecasting, observations are incorporated into a model of the atmosphere through a process called data assimilation. Sometimes observations in one location may impact the weather forecast in another faraway location in undesirable ways. The impact of distant observations on the forecast is mitigated through a process called localization. We propose a new method for localization when a model has multiple length scales, as in a model spanning both the ocean and the atmosphere.
Zhao Liu, Shaoqing Zhang, Yang Shen, Yuping Guan, and Xiong Deng
Nonlin. Processes Geophys., 28, 481–500, https://doi.org/10.5194/npg-28-481-2021, https://doi.org/10.5194/npg-28-481-2021, 2021
Short summary
Short summary
A general methodology is introduced to capture regime transitions of the Atlantic meridional overturning circulation (AMOC). The assimilation models with different parameters simulate different paths for the AMOC to switch between equilibrium states. Constraining model parameters with observations can significantly mitigate the model deviations, thus capturing AMOC regime transitions. This simple model study serves as a guideline for improving coupled general circulation models.
Guillaume Evin, Matthieu Lafaysse, Maxime Taillardat, and Michaël Zamo
Nonlin. Processes Geophys., 28, 467–480, https://doi.org/10.5194/npg-28-467-2021, https://doi.org/10.5194/npg-28-467-2021, 2021
Short summary
Short summary
Forecasting the height of new snow is essential for avalanche hazard surveys, road and ski resort management, tourism attractiveness, etc. Météo-France operates a probabilistic forecasting system using a numerical weather prediction system and a snowpack model. It provides better forecasts than direct diagnostics but exhibits significant biases. Post-processing methods can be applied to provide automatic forecasting products from this system.
Davide Faranda, Mathieu Vrac, Pascal Yiou, Flavio Maria Emanuele Pons, Adnane Hamid, Giulia Carella, Cedric Ngoungue Langue, Soulivanh Thao, and Valerie Gautard
Nonlin. Processes Geophys., 28, 423–443, https://doi.org/10.5194/npg-28-423-2021, https://doi.org/10.5194/npg-28-423-2021, 2021
Short summary
Short summary
Machine learning approaches are spreading rapidly in climate sciences. They are of great help in many practical situations where using the underlying equations is difficult because of the limitation in computational power. Here we use a systematic approach to investigate the limitations of the popular echo state network algorithms used to forecast the long-term behaviour of chaotic systems, such as the weather. Our results show that noise and intermittency greatly affect the performances.
Stephen Jewson, Giuliana Barbato, Paola Mercogliano, Jaroslav Mysiak, and Maximiliano Sassi
Nonlin. Processes Geophys., 28, 329–346, https://doi.org/10.5194/npg-28-329-2021, https://doi.org/10.5194/npg-28-329-2021, 2021
Short summary
Short summary
Climate model simulations are uncertain. In some cases this makes it difficult to know how to use them. Significance testing is often used to deal with this issue but has various shortcomings. We describe two alternative ways to manage uncertainty in climate model simulations that avoid these shortcomings. We test them on simulations of future rainfall over Europe and show they produce more accurate projections than either using unadjusted climate model output or statistical testing.
Sagar K. Tamang, Ardeshir Ebtehaj, Peter J. van Leeuwen, Dongmian Zou, and Gilad Lerman
Nonlin. Processes Geophys., 28, 295–309, https://doi.org/10.5194/npg-28-295-2021, https://doi.org/10.5194/npg-28-295-2021, 2021
Short summary
Short summary
Data assimilation aims to improve hydrologic and weather forecasts by combining available information from Earth system models and observations. The classical approaches to data assimilation usually proceed with some preconceived assumptions about the shape of their probability distributions. As a result, when such assumptions are invalid, the forecast accuracy suffers. In the proposed methodology, we relax such assumptions and demonstrate improved performance.
Abd AlRahman AlMomani and Erik Bollt
Nonlin. Processes Geophys., 28, 153–166, https://doi.org/10.5194/npg-28-153-2021, https://doi.org/10.5194/npg-28-153-2021, 2021
Short summary
Short summary
This paper introduces a tool for data-driven discovery of early warning signs of critical transitions in ice shelves from remote sensing data. Our directed spectral clustering method considers an asymmetric affinity matrix along with the associated directed graph Laplacian. We applied our approach to reprocessing the ice velocity data and remote sensing satellite images of the Larsen C ice shelf.
Yvonne Ruckstuhl, Tijana Janjić, and Stephan Rasp
Nonlin. Processes Geophys., 28, 111–119, https://doi.org/10.5194/npg-28-111-2021, https://doi.org/10.5194/npg-28-111-2021, 2021
Short summary
Short summary
The assimilation of observations using standard algorithms can lead to a violation of physical laws (e.g. mass conservation), which is shown to have a detrimental impact on the system's forecast. We use a neural network (NN) to correct this mass violation, using training data generated from expensive algorithms that can constrain such physical properties. We found that, in an idealized set-up, the NN can match the performance of these expensive algorithms at negligible computational costs.
Shin'ya Nakano
Nonlin. Processes Geophys., 28, 93–109, https://doi.org/10.5194/npg-28-93-2021, https://doi.org/10.5194/npg-28-93-2021, 2021
Short summary
Short summary
The ensemble-based variational method is a method for solving nonlinear data assimilation problems by using an ensemble of multiple simulation results. Although this method is derived based on a linear approximation, highly uncertain problems, in which system nonlinearity is significant, can also be solved by applying this method iteratively. This paper reformulated this iterative algorithm to analyze its behavior in high-dimensional nonlinear problems and discuss the convergence.
Sangeetika Ruchi, Svetlana Dubinkina, and Jana de Wiljes
Nonlin. Processes Geophys., 28, 23–41, https://doi.org/10.5194/npg-28-23-2021, https://doi.org/10.5194/npg-28-23-2021, 2021
Short summary
Short summary
To infer information of an unknown quantity that helps to understand an associated system better and to predict future outcomes, observations and a physical model that connects the data points to the unknown parameter are typically used as information sources. Yet this problem is often very challenging due to the fact that the unknown is generally high dimensional, the data are sparse and the model can be non-linear. We propose a novel approach to address these challenges.
Olivier Pannekoucke, Richard Ménard, Mohammad El Aabaribaoune, and Matthieu Plu
Nonlin. Processes Geophys., 28, 1–22, https://doi.org/10.5194/npg-28-1-2021, https://doi.org/10.5194/npg-28-1-2021, 2021
Short summary
Short summary
Numerical weather prediction involves numerically solving the mathematical equations, which describe the geophysical flow, by transforming them so that they can be computed. Through this transformation, it appears that the equations actually solved by the machine are then a modified version of the original equations, introducing an error that contributes to the model error. This work helps to characterize the covariance of the model error that is due to this modification of the equations.
Pengcheng Yan, Guolin Feng, Wei Hou, and Ping Yang
Nonlin. Processes Geophys., 27, 489–500, https://doi.org/10.5194/npg-27-489-2020, https://doi.org/10.5194/npg-27-489-2020, 2020
Short summary
Short summary
A system transiting from one stable state to another has to experience a period. Can we predict the end moment (state) if the process has not been completed? This paper presents a method to solve this problem. This method is based on the quantitative relationship among the parameters, which is used to describe the transition process of the abrupt change. By using the historical data, we extract some parameters for predicting the uncompleted climate transition process.
Reinhold Hess
Nonlin. Processes Geophys., 27, 473–487, https://doi.org/10.5194/npg-27-473-2020, https://doi.org/10.5194/npg-27-473-2020, 2020
Short summary
Short summary
Forecasts of ensemble systems are statistically aligned to synoptic observations at DWD in order to provide support for warning decision management. Motivation and design consequences for extreme and rare meteorological events are presented. Especially for probabilities of severe wind gusts global logistic parameterisations are developed that generate robust statistical forecasts for extreme events, while local characteristics are preserved.
Ashesh Chattopadhyay, Pedram Hassanzadeh, and Devika Subramanian
Nonlin. Processes Geophys., 27, 373–389, https://doi.org/10.5194/npg-27-373-2020, https://doi.org/10.5194/npg-27-373-2020, 2020
Short summary
Short summary
The performance of three machine-learning methods for data-driven modeling of a multiscale chaotic Lorenz 96 system is examined. One of the methods is found to be able to predict the future evolution of the chaotic system well from just knowing the past observations of the large-scale component of the multiscale state vector. Potential applications to data-driven and data-assisted surrogate modeling of complex dynamical systems such as weather and climate are discussed.
Maxime Taillardat and Olivier Mestre
Nonlin. Processes Geophys., 27, 329–347, https://doi.org/10.5194/npg-27-329-2020, https://doi.org/10.5194/npg-27-329-2020, 2020
Short summary
Short summary
Statistical post-processing of ensemble forecasts is now a well-known procedure in order to correct biased and misdispersed ensemble weather predictions. But practical application in European national weather services is in its infancy. Different applications of ensemble post-processing using machine learning at an industrial scale are presented. Forecast quality and value are improved compared to the raw ensemble, but several facilities have to be made to adjust to operational constraints.
Cited articles
Abarbanel, H. D. I., Rozdeba, P. J., and Shirman, S.: Machine Learning: Deepest
Learning as Statistical Data Assimilation Problems, Neural Comput., 30,
2025–2055, https://doi.org/10.1162/neco_a_01094, 2018. a, b
Amezcua, J., Goodliff, M., and van Leeuwen, P.-J.: A weak-constraint
4DEnsembleVar. Part I: formulation and simple model experiments, Tellus
A, 69, 1271564, https://doi.org/10.1080/16000870.2016.1271564, 2017. a
Aster, R. C., Borchers, B., and Thuber, C. H.: Parameter Estimation and
Inverse Problems, Elsevier Academic Press, 2nd Edn., 2013. a
Bocquet, M.: Parameter field estimation for atmospheric dispersion:
Application to the Chernobyl accident using 4D-Var, Q. J. Roy.
Meteor. Soc., 138, 664–681, https://doi.org/10.1002/qj.961, 2012. a, b
Brunton, S. L., Proctor, J. L., and Kutz, J. N.: Discovering governing
equations from data by sparse identification of nonlinear dynamical systems,
P. Natl. Acad. Sci. USA, 113, 3932–3937, https://doi.org/10.1073/pnas.1517384113, 2016. a, b
Buizza, R., Miller, M., and Palmer, T. N.: Stochastic representation of model
uncertainties in the ECMWF ensemble prediction system, Q. J. Roy. Meteor.
Soc., 125, 2887–2908, 1999. a
Byrd, R. H., Lu, P., and Nocedal, J.: A Limited Memory Algorithm for Bound
Constrained Optimization, SIAM J. Sci. Stat.
Comp., 16, 1190–1208, 1995. a
Carlu, M., Ginelli, F., Lucarini, V., and Politi, A.: Lyapunov analysis of multiscale dynamics: the slow bundle of the two-scale Lorenz 96 model, Nonlin. Processes Geophys., 26, 73–89, https://doi.org/10.5194/npg-26-73-2019, 2019. a
Carrassi, A. and Vannitsem, S.: Accounting for model error in variational data
assimilation: A deterministic formulation, Mon. Weather Rev., 138, 3369–3386,
https://doi.org/10.1175/2010MWR3192.1, 2010. a
Carrassi, A., Bocquet, M., Bertino, L., and Evensen, G.: Data Assimilation in
the Geosciences: An overview on methods, issues, and perspectives, WIREs
Climate Change, 9, e535, https://doi.org/10.1002/wcc.535, 2018. a
Chang, B., Meng, L., Haber, E., Tung, F., and Begert, D.: Multi-level residual
networks from dynamical systems view, in: Proceedings of ICLR 2018, 2018. a
Chen, T. Q., Rubanova, Y., Bettencourt, J., and Duvenaud, D.: Neural ordinary differential equations, in: Advances in Neural Information Processing Systems, 6571–6583, 2018. a
Dreano, D., Tandeo, P., Pulido, M., Ait-El-Fquih, B., Chonavel, T., and Hoteit,
I.: Estimating model error covariances in nonlinear state-space models using
Kalman smoothing and the expectation-maximisation algorithm, Q. J. Roy.
Meteor. Soc., 143, 1877–1885, https://doi.org/10.1002/qj.3048, 2017. a
Dueben, P. D. and Bauer, P.: Challenges and design choices for global weather and climate models based on machine learning, Geosci. Model Dev., 11, 3999–4009, https://doi.org/10.5194/gmd-11-3999-2018, 2018. a
Fablet, R., Ouala, S., and Herzet, C.: Bilinear residual neural network for the
identification and forecasting of dynamical systems, in: EUSIPCO 2018,
European Signal Processing Conference, Rome, Italy, 1–5,
available at: https://hal.archives-ouvertes.fr/hal-01686766 (last access: 8 July 2019), 2018. a, b, c, d
Gautschi, W.: Numerical analysis, Springer Science & Business Media, 2nd
Edn., 2012. a
Goodfellow, I., Bengio, Y., and Courville, A.: Deep learning, The MIT Press,
Cambridge Massachusetts, London, England, 2016. a
Grudzien, C., Carrassi, A., and Bocquet, M.: Chaotic dynamics and the role of covariance inflation for reduced rank Kalman filters with model error, Nonlin. Processes Geophys., 25, 633–648, https://doi.org/10.5194/npg-25-633-2018, 2018. a
Harlim, J.: Model error in data assimilation, in: Nonlinear and stochastic
climate dynamics, edited by: Franzke, C. L. E. and O'Kane, T. J.,
Cambridge University Press, 276–317, https://doi.org/10.1017/9781316339251.011, 2017. a
Harlim, J.: Data-driven computational methods: parameter and operator
estimations, Cambridge University Press, Cambridge, 2018. a
Hodyss, D.: Ensemble State Estimation for Nonlinear Systems Using Polynomial
Expansions in the Innovation, Mon. Weather Rev., 139, 3571–3588,
https://doi.org/10.1175/2011MWR3558.1, 2011. a
Hodyss, D.: Accounting for Skewness in Ensemble Data Assimilation, Mon. Weather
Rev., 140, 2346–2358, https://doi.org/10.1175/MWR-D-11-00198.1, 2012. a
Hsieh, W. W. and Tang, B.: Applying Neural Network Models to Prediction and
Data Analysis in Meteorology and Oceanography, B. Am. Meteorol. Soc.,
79, 1855–1870, https://doi.org/10.1175/1520-0477(1998)079<1855:ANNMTP>2.0.CO;2, 1998. a
Janjić, T., Bormann, N., Bocquet, M., Carton, J. A., Cohn, S. E., Dance,
S. L., Losa, S. N., Nichols, N. K., Potthast, R., Waller, J. A., and Weston,
P.: On the representation error in data assimilation, Q. J. Roy. Meteor.
Soc., 144, 1257–1278, https://doi.org/10.1002/qj.3130, 2018. a
Kalnay, E.: Atmospheric Modeling, Data Assimilation and Predictability,
Cambridge University Press, Cambridge, 2002. a
Kassam, A.-K. and Trefethen, L. N.: Fourth-Order Time-Stepping For Stiff
PDEs, Siam J. Sci. Comput., 26, 1214–1233,
https://doi.org/10.1137/S1064827502410633, 2005. a
Kondrashov, D. and Chrekroun, M. D.: Data-adaptive harmonic spectra and
multilayer Stuart-Landau models, Chaos, 27, 093110,
https://doi.org/10.1016/j.physd.2014.12.005, 2017. a
Kondrashov, D., Chrekroun, M. D., and Ghil, M.: Data-driven non-Markovian
closure models, Physica D, 297, 33–55,
https://doi.org/10.1063/1.4989400, 2015. a
Kondrashov, D., Chrekroun, M. D., Yuan, X., and Ghil, M.: Data-adaptive
harmonic decomposition and stochastic modeling of Arctic sea ice, in:
Advances in Nonlinear Geosciences, edited by: Tsonis, A.,
Springer, Cham, 179–205, https://doi.org/10.1007/978-3-319-58895-7_10, 2018. a
Kuramoto, Y. and Tsuzuki, T.: Persistent propagation of concentration waves in
dissipative media far from thermal equilibrium, Prog. Theor. Phys., 55,
356–369, 1976. a
Lguensat, R., Tandeo, P., Ailliot, P., Pulido, M., and Fablet, R.: The Analog
Data Assimilation, Mon. Weather Rev., 145, 4093–4107,
https://doi.org/10.1175/MWR-D-16-0441.1, 2017. a
Long, Z., Lu, Y., Ma, X., and Dong, B.: PDE-Net: Learning PDEs from Data,
in: Proceedings of the 35th International Conference on Machine Learning,
2018. a
Lorenz, E. N.: Deterministic nonperiodic flow, J. Atmos. Sci., 20, 130–141,
1963. a
Lorenz, E. N.: Designing Chaotic Models, J. Atmos. Sci., 62, 1574–1587,
https://doi.org/10.1175/JAS3430.1, 2005. a
Lorenz, E. N. and Emanuel, K. A.: Optimal sites for supplementary weather
observations: simulation with a small model, J. Atmos. Sci., 55, 399–414,
https://doi.org/10.1175/1520-0469(1998)055<0399:OSFSWO>2.0.CO;2, 1998. a
Magnusson, L. and Källén, E.: Factors influencing skill improvements in
the ECMWF forecasting system, Mon. Weather Rev., 141, 3142–3153,
https://doi.org/10.1175/MWR-D-12-00318.1, 2013. a
Mitchell, L. and Carrassi, A.: Accounting for model error due to unresolved
scales within ensemble Kalman filtering, Q. J. Roy. Meteor. Soc., 141,
1417–1428, https://doi.org/10.1175/MWR-D-16-0478.1, 2015. a
Paduart, J., Lauwers, L., Swevers, J., Smolders, K., Schoukens, J., and
Pintelon, R.: Identification of nonlinear systems using polynomial nonlinear
state space models, Automatica, 46, 647–656,
https://doi.org/10.1016/j.automatica.2010.01.001, 2010. a, b
Park, D. C. and Zhu, Y.: Bilinear recurrent neural network, IEEE World Congress on Computational Intelligence, Neural
Networks, 3, 1459–1464, 1994. a
Pathak, J., Lu, Z., Hunt, B. R., Girvan, M., and Ott, E.: Using machine
learning to replicate chaotic attractors and calculate Lyapunov exponents
from data, Chaos, 27, 121102, https://doi.org/10.1063/1.5010300, 2017.
a
Pathak, J., Hunt, B., Girvan, M., Lu, Z., and Ott, E.: Model-Free Prediction of
Large Spatiotemporally Chaotic Systems from Data: A Reservoir Computing
Approach, Phys. Rev. Lett., 120, 024102,
https://doi.org/10.1103/PhysRevLett.120.024102, 2018. a
Raanes, P. N., Carrassi, A., and Bertino, L.: Extending the square root method
to account for additive forecast noise in ensemble methods, Mon. Weather Rev.,
143, 3857–3873, https://doi.org/10.1175/MWR-D-14-00375.1, 2015. a
Raanes, P. N., Bocquet, M., and Carrassi, A.: Adaptive covariance inflation in the ensemble Kalman filter by Gaussian scale mixtures, Q. J. Roy. Meteor.
Soc., 145, 53–75, https://doi.org/10.1002/qj.3386, 2019. a
Resseguier, V., Mémin, E., and Chapron, B.: Geophysical flows under
location uncertainty, Part I Random transport and general models,
Geophys. Astro. Fluid, 111, 149–176,
https://doi.org/10.1080/03091929.2017.1310210, 2017. a
Ruiz, J. J., Pulido, M., and Miyoshi, T.: Estimating model parameters with
ensemble-based data assimilation: A Review, J. Meteorol. Soc. Jpn., 91,
79–99, https://doi.org/10.2151/jmsj.2013-201, 2013. a
Sakov, P., Haussaire, J.-M., and Bocquet, M.: An iterative ensemble Kalman
filter in presence of additive model error, Q. J. Roy. Meteor. Soc., 144,
1297–1309, https://doi.org/10.1002/qj.3213, 2018. a
Sivashinsky, G. I.: Nonlinear analysis of hydrodynamic instability in laminar
flames-I. Derivation of basic equations, Acta Astronaut., 4, 1177–1206,
1977. a
Tandeo, P., Ailliot, P., Bocquet, M., Carrassi, A., Miyoshi, T., Pulido, M.,
and Zhen, Y.: Joint Estimation of Model and Observation Error Covariance
Matrices in Data Assimilation: a Review,
available at: https://hal-imt-atlantique.archives-ouvertes.fr/hal-01867958 (last access: 8 July 2019),
submitted, 2019. a
Trémolet, Y.: Accounting for an imperfect model in 4D-Var, Q. J. Roy.
Meteor. Soc., 132, 2483–2504, 2006. a
Wang, Y.-J. and Lin, C.-T.: Runge-Kutta neural network for identification
of dynamical systems in high accuracy, IEEE T. Neural Networ.,
9, 294–307, https://doi.org/10.1109/72.661124, 1998. a, b
Weinan, E.: A proposal on machine learning via dynamical systems, Commun. Math.
Stat., 5, 1–11, https://doi.org/10.1007/s40304-017-0103-z, 2017. a
Whitaker, J. S. and Hamill, T. M.: Evaluating Methods to Account for System
Errors in Ensemble Data Assimilation, Mon. Weather Rev., 140, 3078–3089,
https://doi.org/10.1175/MWR-D-11-00276.1, 2012. a
Short summary
This paper describes an innovative way to use data assimilation to infer the dynamics of a physical system from its observation only. The method can operate with noisy and partial observation of the physical system. It acts as a deep learning technique specialised to dynamical models without the need for machine learning tools. The method is successfully tested on chaotic dynamical systems: the Lorenz-63, Lorenz-96, and Kuramoto–Sivashinski models and a two-scale Lorenz model.
This paper describes an innovative way to use data assimilation to infer the dynamics of a...
