Articles | Volume 31, issue 3
https://doi.org/10.5194/npg-31-335-2024
© Author(s) 2024. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/npg-31-335-2024
© Author(s) 2024. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Research article
| 
12 Jul 2024
Research article |
| 12 Jul 2024
| 12 Jul 2024
Bridging classical data assimilation and optimal transport: the 3D-Var case
CEREA, École des Ponts and EDF R&D, Île-de-France, France
Pierre J. Vanderbecken
CEREA, École des Ponts and EDF R&D, Île-de-France, France
Alban Farchi
CEREA, École des Ponts and EDF R&D, Île-de-France, France
Joffrey Dumont Le Brazidec
CEREA, École des Ponts and EDF R&D, Île-de-France, France
Yelva Roustan
CEREA, École des Ponts and EDF R&D, Île-de-France, France
Related authors
Yumeng Chen, Polly Smith, Alberto Carrassi, Ivo Pasmans, Laurent Bertino, Marc Bocquet, Tobias Sebastian Finn, Pierre Rampal, and Véronique Dansereau
The Cryosphere, 18, 2381–2406, https://doi.org/10.5194/tc-18-2381-2024, https://doi.org/10.5194/tc-18-2381-2024, 2024
Short summary
Short summary
We explore multivariate state and parameter estimation using a data assimilation approach through idealised simulations in a dynamics-only sea-ice model based on novel rheology. We identify various potential issues that can arise in complex operational sea-ice models when model parameters are estimated. Even though further investigation will be needed for such complex sea-ice models, we show possibilities of improving the observed and the unobserved model state forecast and parameter accuracy.
Charlotte Durand, Tobias Sebastian Finn, Alban Farchi, Marc Bocquet, Guillaume Boutin, and Einar Ólason
The Cryosphere, 18, 1791–1815, https://doi.org/10.5194/tc-18-1791-2024, https://doi.org/10.5194/tc-18-1791-2024, 2024
Short summary
Short summary
This paper focuses on predicting Arctic-wide sea-ice thickness using surrogate modeling with deep learning. The model has a predictive power of 12 h up to 6 months. For this forecast horizon, persistence and daily climatology are systematically outperformed, a result of learned thermodynamics and advection. Consequently, surrogate modeling with deep learning proves to be effective at capturing the complex behavior of sea ice.
Joffrey Dumont Le Brazidec, Pierre Vanderbecken, Alban Farchi, Grégoire Broquet, Gerrit Kuhlmann, and Marc Bocquet
Geosci. Model Dev., 17, 1995–2014, https://doi.org/10.5194/gmd-17-1995-2024, https://doi.org/10.5194/gmd-17-1995-2024, 2024
Short summary
Short summary
Our research presents an innovative approach to estimating power plant CO2 emissions from satellite images of the corresponding plumes such as those from the forthcoming CO2M satellite constellation. The exploitation of these images is challenging due to noise and meteorological uncertainties. To overcome these obstacles, we use a deep learning neural network trained on simulated CO2 images. Our method outperforms alternatives, providing a positive perspective for the analysis of CO2M images.
Tobias Sebastian Finn, Lucas Disson, Alban Farchi, Marc Bocquet, and Charlotte Durand
EGUsphere, https://doi.org/10.5194/egusphere-2023-2261, https://doi.org/10.5194/egusphere-2023-2261, 2023
Short summary
Short summary
We train neural networks as denoising diffusion models for state generation in the Lorenz 1963 system and demonstrate that they learn an internal representation of the system. We make use of this learned representation and the pre-trained model in two downstream tasks: surrogate modelling and ensemble generation. For both tasks, the diffusion model can outperform other more common approaches. Thus, we see a potential of representation learning with diffusion models for dynamical systems.
Tobias Sebastian Finn, Charlotte Durand, Alban Farchi, Marc Bocquet, Yumeng Chen, Alberto Carrassi, and Véronique Dansereau
The Cryosphere, 17, 2965–2991, https://doi.org/10.5194/tc-17-2965-2023, https://doi.org/10.5194/tc-17-2965-2023, 2023
Short summary
Short summary
We combine deep learning with a regional sea-ice model to correct model errors in the sea-ice dynamics of low-resolution forecasts towards high-resolution simulations. The combined model improves the forecast by up to 75 % and thereby surpasses the performance of persistence. As the error connection can additionally be used to analyse the shortcomings of the forecasts, this study highlights the potential of combined modelling for short-term sea-ice forecasting.
Joffrey Dumont Le Brazidec, Pierre Vanderbecken, Alban Farchi, Marc Bocquet, Jinghui Lian, Grégoire Broquet, Gerrit Kuhlmann, Alexandre Danjou, and Thomas Lauvaux
Geosci. Model Dev., 16, 3997–4016, https://doi.org/10.5194/gmd-16-3997-2023, https://doi.org/10.5194/gmd-16-3997-2023, 2023
Short summary
Short summary
Monitoring of CO2 emissions is key to the development of reduction policies. Local emissions, from cities or power plants, may be estimated from CO2 plumes detected in satellite images. CO2 plumes generally have a weak signal and are partially concealed by highly variable background concentrations and instrument errors, which hampers their detection. To address this problem, we propose and apply deep learning methods to detect the contour of a plume in simulated CO2 satellite images.
Pierre J. Vanderbecken, Joffrey Dumont Le Brazidec, Alban Farchi, Marc Bocquet, Yelva Roustan, Élise Potier, and Grégoire Broquet
Atmos. Meas. Tech., 16, 1745–1766, https://doi.org/10.5194/amt-16-1745-2023, https://doi.org/10.5194/amt-16-1745-2023, 2023
Short summary
Short summary
Instruments dedicated to monitoring atmospheric gaseous compounds from space will provide images of urban-scale plumes. We discuss here the use of new metrics to compare observed plumes with model predictions that will be less sensitive to meteorology uncertainties. We have evaluated our metrics on diverse plumes and shown that by eliminating some aspects of the discrepancies, they are indeed less sensitive to meteorological variations.
Joffrey Dumont Le Brazidec, Marc Bocquet, Olivier Saunier, and Yelva Roustan
Geosci. Model Dev., 16, 1039–1052, https://doi.org/10.5194/gmd-16-1039-2023, https://doi.org/10.5194/gmd-16-1039-2023, 2023
Short summary
Short summary
When radionuclides are released into the atmosphere, the assessment of the consequences depends on the evaluation of the magnitude and temporal evolution of the release, which can be highly variable as in the case of Fukushima Daiichi.
Here, we propose Bayesian inverse modelling methods and the reversible-jump Markov chain Monte Carlo technique, which allows one to evaluate the temporal variability of the release and to integrate different types of information in the source reconstruction.
Colin Grudzien and Marc Bocquet
Geosci. Model Dev., 15, 7641–7681, https://doi.org/10.5194/gmd-15-7641-2022, https://doi.org/10.5194/gmd-15-7641-2022, 2022
Short summary
Short summary
Iterative optimization techniques, the state of the art in data assimilation, have largely focused on extending forecast accuracy to moderate- to long-range forecast systems. However, current methodology may not be cost-effective in reducing forecast errors in online, short-range forecast systems. We propose a novel optimization of these techniques for online, short-range forecast cycles, simultaneously providing an improvement in forecast accuracy and a reduction in the computational cost.
Joffrey Dumont Le Brazidec, Marc Bocquet, Olivier Saunier, and Yelva Roustan
Atmos. Chem. Phys., 21, 13247–13267, https://doi.org/10.5194/acp-21-13247-2021, https://doi.org/10.5194/acp-21-13247-2021, 2021
Short summary
Short summary
The assessment of the environmental consequences of a radionuclide release depends on the estimation of its source. This paper aims to develop inverse Bayesian methods which combine transport models with measurements, in order to reconstruct the ensemble of possible sources.
Three methods to quantify uncertainties based on the definition of probability distributions and the physical models are proposed and evaluated for the case of 106Ru releases over Europe in 2017.
Colin Grudzien, Marc Bocquet, and Alberto Carrassi
Geosci. Model Dev., 13, 1903–1924, https://doi.org/10.5194/gmd-13-1903-2020, https://doi.org/10.5194/gmd-13-1903-2020, 2020
Short summary
Short summary
All scales of a dynamical physical process cannot be resolved accurately in a multiscale, geophysical model. The behavior of unresolved scales of motion are often parametrized by a random process to emulate their effects on the dynamically resolved variables, and this results in a random–dynamical model. We study how the choice of a numerical discretization of such a system affects the model forecast and estimation statistics, when the random–dynamical model is unbiased in its parametrization.
Thomas Lauvaux, Liza I. Díaz-Isaac, Marc Bocquet, and Nicolas Bousserez
Atmos. Chem. Phys., 19, 12007–12024, https://doi.org/10.5194/acp-19-12007-2019, https://doi.org/10.5194/acp-19-12007-2019, 2019
Short summary
Short summary
A small-size ensemble of mesoscale simulations has been filtered to characterize the spatial structures of transport errors in atmospheric CO2 mixing ratios. The extracted error structures in in situ and column CO2 show similar length scales compared to other meteorological variables, including seasonality, which could be used as proxies in regional inversion systems.
Marc Bocquet, Julien Brajard, Alberto Carrassi, and Laurent Bertino
Nonlin. Processes Geophys., 26, 143–162, https://doi.org/10.5194/npg-26-143-2019, https://doi.org/10.5194/npg-26-143-2019, 2019
Short summary
Short summary
This paper describes an innovative way to use data assimilation to infer the dynamics of a physical system from its observation only. The method can operate with noisy and partial observation of the physical system. It acts as a deep learning technique specialised to dynamical models without the need for machine learning tools. The method is successfully tested on chaotic dynamical systems: the Lorenz-63, Lorenz-96, and Kuramoto–Sivashinski models and a two-scale Lorenz model.
Julien Brajard, Alberto Carrassi, Marc Bocquet, and Laurent Bertino
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2019-136, https://doi.org/10.5194/gmd-2019-136, 2019
Revised manuscript not accepted
Short summary
Short summary
We explore the possibility of combining data assimilation with machine learning. We introduce a new hybrid method for a two-fold scope: (i) emulating hidden, possibly chaotic, dynamics and (ii) predicting its future states. Numerical experiments have been carried out using the chaotic Lorenz 96 model, proving both the convergence of the hybrid method and its statistical skills including short-term forecasting and emulation of the long-term dynamics.
Liza I. Díaz-Isaac, Thomas Lauvaux, Marc Bocquet, and Kenneth J. Davis
Atmos. Chem. Phys., 19, 5695–5718, https://doi.org/10.5194/acp-19-5695-2019, https://doi.org/10.5194/acp-19-5695-2019, 2019
Short summary
Short summary
We demonstrate that transport model errors, one of the main contributors to the uncertainty in regional CO2 inversions, can be represented by a small-size ensemble carefully calibrated with meteorological data. Our results also confirm transport model errors represent a significant fraction of the model–data mismatch in CO2 mole fractions and hence in regional inverse CO2 fluxes.
Alban Farchi and Marc Bocquet
Nonlin. Processes Geophys., 25, 765–807, https://doi.org/10.5194/npg-25-765-2018, https://doi.org/10.5194/npg-25-765-2018, 2018
Short summary
Short summary
Data assimilation looks for an optimal way to learn from observations of a dynamical system to improve the quality of its predictions. The goal is to filter out the noise (both observation and model noise) to retrieve the true signal. Among all possible methods, particle filters are promising; the method is fast and elegant, and it allows for a Bayesian analysis. In this review paper, we discuss implementation techniques for (local) particle filters in high-dimensional systems.
Colin Grudzien, Alberto Carrassi, and Marc Bocquet
Nonlin. Processes Geophys., 25, 633–648, https://doi.org/10.5194/npg-25-633-2018, https://doi.org/10.5194/npg-25-633-2018, 2018
Short summary
Short summary
Using the framework Lyapunov vectors, we analyze the asymptotic properties of ensemble based Kalman filters and how these are influenced by dynamical chaos, especially in the context of random model errors and small ensemble sizes. Particularly, we show a novel derivation of the evolution of forecast uncertainty for ensemble-based Kalman filters with weakly-nonlinear error growth, and discuss its impact for filter design in geophysical models.
Olivier Pannekoucke, Marc Bocquet, and Richard Ménard
Nonlin. Processes Geophys., 25, 481–495, https://doi.org/10.5194/npg-25-481-2018, https://doi.org/10.5194/npg-25-481-2018, 2018
Short summary
Short summary
The forecast of weather prediction uncertainty is a real challenge and is crucial for risk management. However, uncertainty prediction is beyond the capacity of supercomputers, and improvements of the technology may not solve this issue. A new uncertainty prediction method is introduced which takes advantage of fluid equations to predict simple quantities which approximate real uncertainty but at a low numerical cost. A proof of concept is shown by an academic model derived from fluid dynamics.
Anthony Fillion, Marc Bocquet, and Serge Gratton
Nonlin. Processes Geophys., 25, 315–334, https://doi.org/10.5194/npg-25-315-2018, https://doi.org/10.5194/npg-25-315-2018, 2018
Short summary
Short summary
This study generalizes a paper by Pires et al. (1996) to state-of-the-art data assimilation techniques, such as the iterative ensemble Kalman smoother (IEnKS). We show that the longer the time window over which observations are assimilated, the better the accuracy of the IEnKS. Beyond a critical time length that we estimate, we show that this accuracy finally degrades. We show that the use of the quasi-static minimizations but generalized to the IEnKS yields a significantly improved accuracy.
J.-M. Haussaire and M. Bocquet
Geosci. Model Dev., 9, 393–412, https://doi.org/10.5194/gmd-9-393-2016, https://doi.org/10.5194/gmd-9-393-2016, 2016
Short summary
Short summary
The focus is on the development of low-order models of atmospheric transport and chemistry and their use for data assimilation purposes. A new low-order coupled chemistry meteorology model is developed. It consists of the Lorenz40-variable model used as a wind field coupled with a simple ozone photochemistry module. Advanced ensemble variational methods are applied to this model to obtain insights on the use of data assimilation with coupled models, in an offline mode or in an online mode.
M. Bocquet, P. N. Raanes, and A. Hannart
Nonlin. Processes Geophys., 22, 645–662, https://doi.org/10.5194/npg-22-645-2015, https://doi.org/10.5194/npg-22-645-2015, 2015
Short summary
Short summary
The popular data assimilation technique known as the ensemble Kalman filter (EnKF) suffers from sampling errors due to the limited size of the ensemble. This deficiency is usually cured by inflating the sampled error covariances and by using localization. This paper further develops and discusses the finite-size EnKF, or EnKF-N, a variant of the EnKF that does not require inflation. It expands the use of the EnKF-N to a wider range of dynamical regimes.
M. Bocquet, H. Elbern, H. Eskes, M. Hirtl, R. Žabkar, G. R. Carmichael, J. Flemming, A. Inness, M. Pagowski, J. L. Pérez Camaño, P. E. Saide, R. San Jose, M. Sofiev, J. Vira, A. Baklanov, C. Carnevale, G. Grell, and C. Seigneur
Atmos. Chem. Phys., 15, 5325–5358, https://doi.org/10.5194/acp-15-5325-2015, https://doi.org/10.5194/acp-15-5325-2015, 2015
Short summary
Short summary
Data assimilation is used in atmospheric chemistry models to improve air quality forecasts, construct re-analyses of concentrations, and perform inverse modeling. Coupled chemistry meteorology models (CCMM) are atmospheric chemistry models that simulate meteorological processes and chemical transformations jointly. We review here the current status of data assimilation in atmospheric chemistry models, with a particular focus on future prospects for data assimilation in CCMM.
Y. Wang, K. N. Sartelet, M. Bocquet, P. Chazette, M. Sicard, G. D'Amico, J. F. Léon, L. Alados-Arboledas, A. Amodeo, P. Augustin, J. Bach, L. Belegante, I. Binietoglou, X. Bush, A. Comerón, H. Delbarre, D. García-Vízcaino, J. L. Guerrero-Rascado, M. Hervo, M. Iarlori, P. Kokkalis, D. Lange, F. Molero, N. Montoux, A. Muñoz, C. Muñoz, D. Nicolae, A. Papayannis, G. Pappalardo, J. Preissler, V. Rizi, F. Rocadenbosch, K. Sellegri, F. Wagner, and F. Dulac
Atmos. Chem. Phys., 14, 12031–12053, https://doi.org/10.5194/acp-14-12031-2014, https://doi.org/10.5194/acp-14-12031-2014, 2014
Y. Wang, K. N. Sartelet, M. Bocquet, and P. Chazette
Atmos. Chem. Phys., 14, 3511–3532, https://doi.org/10.5194/acp-14-3511-2014, https://doi.org/10.5194/acp-14-3511-2014, 2014
O. Saunier, A. Mathieu, D. Didier, M. Tombette, D. Quélo, V. Winiarek, and M. Bocquet
Atmos. Chem. Phys., 13, 11403–11421, https://doi.org/10.5194/acp-13-11403-2013, https://doi.org/10.5194/acp-13-11403-2013, 2013
M. Bocquet and P. Sakov
Nonlin. Processes Geophys., 20, 803–818, https://doi.org/10.5194/npg-20-803-2013, https://doi.org/10.5194/npg-20-803-2013, 2013
M. R. Koohkan, M. Bocquet, Y. Roustan, Y. Kim, and C. Seigneur
Atmos. Chem. Phys., 13, 5887–5905, https://doi.org/10.5194/acp-13-5887-2013, https://doi.org/10.5194/acp-13-5887-2013, 2013
Y. Wang, K. N. Sartelet, M. Bocquet, and P. Chazette
Atmos. Chem. Phys., 13, 269–283, https://doi.org/10.5194/acp-13-269-2013, https://doi.org/10.5194/acp-13-269-2013, 2013
Alexis Squarcioni, Yelva Roustan, Myrto Valari, Youngseob Kim, Karine Sartelet, Lya Lugon, Fabrice Dugay, and Robin Voitot
EGUsphere, https://doi.org/10.5194/egusphere-2024-1043, https://doi.org/10.5194/egusphere-2024-1043, 2024
Short summary
Short summary
This study highlights the interest of using a street network model to estimate pollutant concentrations of NOx, NO2, and PM2.5 in heterogeneous urban areas, particularly those adjacent to highways, compared with the Subgrid approach embedded in the 3D eulerian model CHIMERE. However, the study also reveals comparable performance between the two approaches for the aforementioned pollutants in areas near the city centre, where urban characteristics are more uniform.
Yumeng Chen, Polly Smith, Alberto Carrassi, Ivo Pasmans, Laurent Bertino, Marc Bocquet, Tobias Sebastian Finn, Pierre Rampal, and Véronique Dansereau
The Cryosphere, 18, 2381–2406, https://doi.org/10.5194/tc-18-2381-2024, https://doi.org/10.5194/tc-18-2381-2024, 2024
Short summary
Short summary
We explore multivariate state and parameter estimation using a data assimilation approach through idealised simulations in a dynamics-only sea-ice model based on novel rheology. We identify various potential issues that can arise in complex operational sea-ice models when model parameters are estimated. Even though further investigation will be needed for such complex sea-ice models, we show possibilities of improving the observed and the unobserved model state forecast and parameter accuracy.
Charlotte Durand, Tobias Sebastian Finn, Alban Farchi, Marc Bocquet, Guillaume Boutin, and Einar Ólason
The Cryosphere, 18, 1791–1815, https://doi.org/10.5194/tc-18-1791-2024, https://doi.org/10.5194/tc-18-1791-2024, 2024
Short summary
Short summary
This paper focuses on predicting Arctic-wide sea-ice thickness using surrogate modeling with deep learning. The model has a predictive power of 12 h up to 6 months. For this forecast horizon, persistence and daily climatology are systematically outperformed, a result of learned thermodynamics and advection. Consequently, surrogate modeling with deep learning proves to be effective at capturing the complex behavior of sea ice.
Joffrey Dumont Le Brazidec, Pierre Vanderbecken, Alban Farchi, Grégoire Broquet, Gerrit Kuhlmann, and Marc Bocquet
Geosci. Model Dev., 17, 1995–2014, https://doi.org/10.5194/gmd-17-1995-2024, https://doi.org/10.5194/gmd-17-1995-2024, 2024
Short summary
Short summary
Our research presents an innovative approach to estimating power plant CO2 emissions from satellite images of the corresponding plumes such as those from the forthcoming CO2M satellite constellation. The exploitation of these images is challenging due to noise and meteorological uncertainties. To overcome these obstacles, we use a deep learning neural network trained on simulated CO2 images. Our method outperforms alternatives, providing a positive perspective for the analysis of CO2M images.
Jerry Jose, Auguste Gires, Yelva Roustan, Ernani Schnorenberger, Ioulia Tchiguirinskaia, and Daniel Schertzer
Nonlin. Processes Geophys. Discuss., https://doi.org/10.5194/npg-2024-5, https://doi.org/10.5194/npg-2024-5, 2024
Preprint under review for NPG
Short summary
Short summary
Wind energy exhibits extreme variability in space and time. However, they also show scaling properties (properties that remain similar across different time and space of measurement), this can be quantified using appropriate statistical tools. In this line, the scaling properties of power from a wind farm are analyzed here. Since every turbine is manufactured by design for a rated power, this acts as an upper limit in the data. This bias is identified here using data and numerical simulations.
Jerry Jose, Auguste Gires, Ernani Schnorenberger, Yelva Roustan, Daniel Schertzer, and Ioulia Tchiguirinskaia
Nonlin. Processes Geophys. Discuss., https://doi.org/10.5194/npg-2024-6, https://doi.org/10.5194/npg-2024-6, 2024
Preprint under review for NPG
Short summary
Short summary
To understand the influence of rainfall on wind power production, turbine power and rainfall were simultaneously measured in an operational wind farm and subjected to analysis. The correlation between wind, wind power, air density and other fields was obtained across various temporal scales during rain and dry conditions. An increase in correlation was observed with an increase in rain; rain also influenced the correspondence between actual and expected values of power at various velocities.
Tobias Sebastian Finn, Lucas Disson, Alban Farchi, Marc Bocquet, and Charlotte Durand
EGUsphere, https://doi.org/10.5194/egusphere-2023-2261, https://doi.org/10.5194/egusphere-2023-2261, 2023
Short summary
Short summary
We train neural networks as denoising diffusion models for state generation in the Lorenz 1963 system and demonstrate that they learn an internal representation of the system. We make use of this learned representation and the pre-trained model in two downstream tasks: surrogate modelling and ensemble generation. For both tasks, the diffusion model can outperform other more common approaches. Thus, we see a potential of representation learning with diffusion models for dynamical systems.
Thibaud Sarica, Alice Maison, Yelva Roustan, Matthias Ketzel, Steen Solvang Jensen, Youngseob Kim, Christophe Chaillou, and Karine Sartelet
Geosci. Model Dev., 16, 5281–5303, https://doi.org/10.5194/gmd-16-5281-2023, https://doi.org/10.5194/gmd-16-5281-2023, 2023
Short summary
Short summary
A new version of the Model of Urban Network of Intersecting Canyons and Highways (MUNICH) is developed to represent heterogeneities of concentrations in streets. The street volume is discretized vertically and horizontally to limit the artificial dilution of emissions and concentrations. This new version is applied to street networks in Copenhagen and Paris. The comparisons to observations are improved, with higher concentrations of pollutants emitted by traffic at the bottom of the street.
Tobias Sebastian Finn, Charlotte Durand, Alban Farchi, Marc Bocquet, Yumeng Chen, Alberto Carrassi, and Véronique Dansereau
The Cryosphere, 17, 2965–2991, https://doi.org/10.5194/tc-17-2965-2023, https://doi.org/10.5194/tc-17-2965-2023, 2023
Short summary
Short summary
We combine deep learning with a regional sea-ice model to correct model errors in the sea-ice dynamics of low-resolution forecasts towards high-resolution simulations. The combined model improves the forecast by up to 75 % and thereby surpasses the performance of persistence. As the error connection can additionally be used to analyse the shortcomings of the forecasts, this study highlights the potential of combined modelling for short-term sea-ice forecasting.
Joffrey Dumont Le Brazidec, Pierre Vanderbecken, Alban Farchi, Marc Bocquet, Jinghui Lian, Grégoire Broquet, Gerrit Kuhlmann, Alexandre Danjou, and Thomas Lauvaux
Geosci. Model Dev., 16, 3997–4016, https://doi.org/10.5194/gmd-16-3997-2023, https://doi.org/10.5194/gmd-16-3997-2023, 2023
Short summary
Short summary
Monitoring of CO2 emissions is key to the development of reduction policies. Local emissions, from cities or power plants, may be estimated from CO2 plumes detected in satellite images. CO2 plumes generally have a weak signal and are partially concealed by highly variable background concentrations and instrument errors, which hampers their detection. To address this problem, we propose and apply deep learning methods to detect the contour of a plume in simulated CO2 satellite images.
Pierre J. Vanderbecken, Joffrey Dumont Le Brazidec, Alban Farchi, Marc Bocquet, Yelva Roustan, Élise Potier, and Grégoire Broquet
Atmos. Meas. Tech., 16, 1745–1766, https://doi.org/10.5194/amt-16-1745-2023, https://doi.org/10.5194/amt-16-1745-2023, 2023
Short summary
Short summary
Instruments dedicated to monitoring atmospheric gaseous compounds from space will provide images of urban-scale plumes. We discuss here the use of new metrics to compare observed plumes with model predictions that will be less sensitive to meteorology uncertainties. We have evaluated our metrics on diverse plumes and shown that by eliminating some aspects of the discrepancies, they are indeed less sensitive to meteorological variations.
Joffrey Dumont Le Brazidec, Marc Bocquet, Olivier Saunier, and Yelva Roustan
Geosci. Model Dev., 16, 1039–1052, https://doi.org/10.5194/gmd-16-1039-2023, https://doi.org/10.5194/gmd-16-1039-2023, 2023
Short summary
Short summary
When radionuclides are released into the atmosphere, the assessment of the consequences depends on the evaluation of the magnitude and temporal evolution of the release, which can be highly variable as in the case of Fukushima Daiichi.
Here, we propose Bayesian inverse modelling methods and the reversible-jump Markov chain Monte Carlo technique, which allows one to evaluate the temporal variability of the release and to integrate different types of information in the source reconstruction.
Colin Grudzien and Marc Bocquet
Geosci. Model Dev., 15, 7641–7681, https://doi.org/10.5194/gmd-15-7641-2022, https://doi.org/10.5194/gmd-15-7641-2022, 2022
Short summary
Short summary
Iterative optimization techniques, the state of the art in data assimilation, have largely focused on extending forecast accuracy to moderate- to long-range forecast systems. However, current methodology may not be cost-effective in reducing forecast errors in online, short-range forecast systems. We propose a novel optimization of these techniques for online, short-range forecast cycles, simultaneously providing an improvement in forecast accuracy and a reduction in the computational cost.
Youngseob Kim, Lya Lugon, Alice Maison, Thibaud Sarica, Yelva Roustan, Myrto Valari, Yang Zhang, Michel André, and Karine Sartelet
Geosci. Model Dev., 15, 7371–7396, https://doi.org/10.5194/gmd-15-7371-2022, https://doi.org/10.5194/gmd-15-7371-2022, 2022
Short summary
Short summary
This paper presents the latest version of the street-network model MUNICH, v2.0. The description of MUNICH v1.0, which models gas-phase pollutants in a street network, was published in GMD in 2018. Since then, major modifications have been made to MUNICH. The comprehensive aerosol model SSH-aerosol is now coupled to MUNICH to simulate primary and secondary aerosol concentrations. New parameterisations have also been introduced. Test cases are defined to illustrate the new model functionalities.
Svetlana Tsyro, Wenche Aas, Augustin Colette, Camilla Andersson, Bertrand Bessagnet, Giancarlo Ciarelli, Florian Couvidat, Kees Cuvelier, Astrid Manders, Kathleen Mar, Mihaela Mircea, Noelia Otero, Maria-Teresa Pay, Valentin Raffort, Yelva Roustan, Mark R. Theobald, Marta G. Vivanco, Hilde Fagerli, Peter Wind, Gino Briganti, Andrea Cappelletti, Massimo D'Isidoro, and Mario Adani
Atmos. Chem. Phys., 22, 7207–7257, https://doi.org/10.5194/acp-22-7207-2022, https://doi.org/10.5194/acp-22-7207-2022, 2022
Short summary
Short summary
Particulate matter (PM) air pollution causes adverse health effects. In Europe, the emissions caused by anthropogenic activities have been reduced in the last decades. To assess the efficiency of emission reductions in improving air quality, we have studied the evolution of PM pollution in Europe. Simulations with six air quality models and observational data indicate a decrease in PM concentrations by 10 % to 30 % across Europe from 2000 to 2010, which is mainly a result of emission reductions.
Joffrey Dumont Le Brazidec, Marc Bocquet, Olivier Saunier, and Yelva Roustan
Atmos. Chem. Phys., 21, 13247–13267, https://doi.org/10.5194/acp-21-13247-2021, https://doi.org/10.5194/acp-21-13247-2021, 2021
Short summary
Short summary
The assessment of the environmental consequences of a radionuclide release depends on the estimation of its source. This paper aims to develop inverse Bayesian methods which combine transport models with measurements, in order to reconstruct the ensemble of possible sources.
Three methods to quantify uncertainties based on the definition of probability distributions and the physical models are proposed and evaluated for the case of 106Ru releases over Europe in 2017.
Colin Grudzien, Marc Bocquet, and Alberto Carrassi
Geosci. Model Dev., 13, 1903–1924, https://doi.org/10.5194/gmd-13-1903-2020, https://doi.org/10.5194/gmd-13-1903-2020, 2020
Short summary
Short summary
All scales of a dynamical physical process cannot be resolved accurately in a multiscale, geophysical model. The behavior of unresolved scales of motion are often parametrized by a random process to emulate their effects on the dynamically resolved variables, and this results in a random–dynamical model. We study how the choice of a numerical discretization of such a system affects the model forecast and estimation statistics, when the random–dynamical model is unbiased in its parametrization.
Thomas Lauvaux, Liza I. Díaz-Isaac, Marc Bocquet, and Nicolas Bousserez
Atmos. Chem. Phys., 19, 12007–12024, https://doi.org/10.5194/acp-19-12007-2019, https://doi.org/10.5194/acp-19-12007-2019, 2019
Short summary
Short summary
A small-size ensemble of mesoscale simulations has been filtered to characterize the spatial structures of transport errors in atmospheric CO2 mixing ratios. The extracted error structures in in situ and column CO2 show similar length scales compared to other meteorological variables, including seasonality, which could be used as proxies in regional inversion systems.
Marc Bocquet, Julien Brajard, Alberto Carrassi, and Laurent Bertino
Nonlin. Processes Geophys., 26, 143–162, https://doi.org/10.5194/npg-26-143-2019, https://doi.org/10.5194/npg-26-143-2019, 2019
Short summary
Short summary
This paper describes an innovative way to use data assimilation to infer the dynamics of a physical system from its observation only. The method can operate with noisy and partial observation of the physical system. It acts as a deep learning technique specialised to dynamical models without the need for machine learning tools. The method is successfully tested on chaotic dynamical systems: the Lorenz-63, Lorenz-96, and Kuramoto–Sivashinski models and a two-scale Lorenz model.
Julien Brajard, Alberto Carrassi, Marc Bocquet, and Laurent Bertino
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2019-136, https://doi.org/10.5194/gmd-2019-136, 2019
Revised manuscript not accepted
Short summary
Short summary
We explore the possibility of combining data assimilation with machine learning. We introduce a new hybrid method for a two-fold scope: (i) emulating hidden, possibly chaotic, dynamics and (ii) predicting its future states. Numerical experiments have been carried out using the chaotic Lorenz 96 model, proving both the convergence of the hybrid method and its statistical skills including short-term forecasting and emulation of the long-term dynamics.
Liza I. Díaz-Isaac, Thomas Lauvaux, Marc Bocquet, and Kenneth J. Davis
Atmos. Chem. Phys., 19, 5695–5718, https://doi.org/10.5194/acp-19-5695-2019, https://doi.org/10.5194/acp-19-5695-2019, 2019
Short summary
Short summary
We demonstrate that transport model errors, one of the main contributors to the uncertainty in regional CO2 inversions, can be represented by a small-size ensemble carefully calibrated with meteorological data. Our results also confirm transport model errors represent a significant fraction of the model–data mismatch in CO2 mole fractions and hence in regional inverse CO2 fluxes.
Alban Farchi and Marc Bocquet
Nonlin. Processes Geophys., 25, 765–807, https://doi.org/10.5194/npg-25-765-2018, https://doi.org/10.5194/npg-25-765-2018, 2018
Short summary
Short summary
Data assimilation looks for an optimal way to learn from observations of a dynamical system to improve the quality of its predictions. The goal is to filter out the noise (both observation and model noise) to retrieve the true signal. Among all possible methods, particle filters are promising; the method is fast and elegant, and it allows for a Bayesian analysis. In this review paper, we discuss implementation techniques for (local) particle filters in high-dimensional systems.
Colin Grudzien, Alberto Carrassi, and Marc Bocquet
Nonlin. Processes Geophys., 25, 633–648, https://doi.org/10.5194/npg-25-633-2018, https://doi.org/10.5194/npg-25-633-2018, 2018
Short summary
Short summary
Using the framework Lyapunov vectors, we analyze the asymptotic properties of ensemble based Kalman filters and how these are influenced by dynamical chaos, especially in the context of random model errors and small ensemble sizes. Particularly, we show a novel derivation of the evolution of forecast uncertainty for ensemble-based Kalman filters with weakly-nonlinear error growth, and discuss its impact for filter design in geophysical models.
Olivier Pannekoucke, Marc Bocquet, and Richard Ménard
Nonlin. Processes Geophys., 25, 481–495, https://doi.org/10.5194/npg-25-481-2018, https://doi.org/10.5194/npg-25-481-2018, 2018
Short summary
Short summary
The forecast of weather prediction uncertainty is a real challenge and is crucial for risk management. However, uncertainty prediction is beyond the capacity of supercomputers, and improvements of the technology may not solve this issue. A new uncertainty prediction method is introduced which takes advantage of fluid equations to predict simple quantities which approximate real uncertainty but at a low numerical cost. A proof of concept is shown by an academic model derived from fluid dynamics.
Anthony Fillion, Marc Bocquet, and Serge Gratton
Nonlin. Processes Geophys., 25, 315–334, https://doi.org/10.5194/npg-25-315-2018, https://doi.org/10.5194/npg-25-315-2018, 2018
Short summary
Short summary
This study generalizes a paper by Pires et al. (1996) to state-of-the-art data assimilation techniques, such as the iterative ensemble Kalman smoother (IEnKS). We show that the longer the time window over which observations are assimilated, the better the accuracy of the IEnKS. Beyond a critical time length that we estimate, we show that this accuracy finally degrades. We show that the use of the quasi-static minimizations but generalized to the IEnKS yields a significantly improved accuracy.
Youngseob Kim, You Wu, Christian Seigneur, and Yelva Roustan
Geosci. Model Dev., 11, 611–629, https://doi.org/10.5194/gmd-11-611-2018, https://doi.org/10.5194/gmd-11-611-2018, 2018
Short summary
Short summary
A new multi-scale model of urban air pollution is presented. This model combines a regional chemical transport model (CTM) with spatial scales down to 1 km and a street-network model. The street-network model MUNICH is coupled to the Polair3D CTM to constitute the Street-in-Grid (SinG) model. SinG and MUNICH are used to simulate the concentrations of NOx and ozone in a Paris suburb. SinG shows better performance than MUNICH for NO2 measured at monitoring stations within a street canyon.
Sébastien Ars, Grégoire Broquet, Camille Yver Kwok, Yelva Roustan, Lin Wu, Emmanuel Arzoumanian, and Philippe Bousquet
Atmos. Meas. Tech., 10, 5017–5037, https://doi.org/10.5194/amt-10-5017-2017, https://doi.org/10.5194/amt-10-5017-2017, 2017
Short summary
Short summary
This study presents a new concept for estimating the pollutant emission rates of a site combining the tracer release method, local-scale atmospheric transport modelling and a statistical atmospheric inversion approach. The potential of this new concept is evaluated with a practical implementation based on a series of inversions of controlled methane and tracer point sources in different spatial configurations to assess the efficiency of the method in comparison with the classic tracer method.
Augustin Colette, Camilla Andersson, Astrid Manders, Kathleen Mar, Mihaela Mircea, Maria-Teresa Pay, Valentin Raffort, Svetlana Tsyro, Cornelius Cuvelier, Mario Adani, Bertrand Bessagnet, Robert Bergström, Gino Briganti, Tim Butler, Andrea Cappelletti, Florian Couvidat, Massimo D'Isidoro, Thierno Doumbia, Hilde Fagerli, Claire Granier, Chris Heyes, Zig Klimont, Narendra Ojha, Noelia Otero, Martijn Schaap, Katarina Sindelarova, Annemiek I. Stegehuis, Yelva Roustan, Robert Vautard, Erik van Meijgaard, Marta Garcia Vivanco, and Peter Wind
Geosci. Model Dev., 10, 3255–3276, https://doi.org/10.5194/gmd-10-3255-2017, https://doi.org/10.5194/gmd-10-3255-2017, 2017
Short summary
Short summary
The EURODELTA-Trends numerical experiment has been designed to assess the capability of chemistry-transport models to capture the evolution of surface air quality over the 1990–2010 period in Europe. It also includes sensitivity experiments in order to analyse the relative contribution of (i) emission changes, (ii) meteorological variability, and (iii) boundary conditions to air quality trends. The article is a detailed presentation of the experiment design and participating models.
J.-M. Haussaire and M. Bocquet
Geosci. Model Dev., 9, 393–412, https://doi.org/10.5194/gmd-9-393-2016, https://doi.org/10.5194/gmd-9-393-2016, 2016
Short summary
Short summary
The focus is on the development of low-order models of atmospheric transport and chemistry and their use for data assimilation purposes. A new low-order coupled chemistry meteorology model is developed. It consists of the Lorenz40-variable model used as a wind field coupled with a simple ozone photochemistry module. Advanced ensemble variational methods are applied to this model to obtain insights on the use of data assimilation with coupled models, in an offline mode or in an online mode.
M. Bocquet, P. N. Raanes, and A. Hannart
Nonlin. Processes Geophys., 22, 645–662, https://doi.org/10.5194/npg-22-645-2015, https://doi.org/10.5194/npg-22-645-2015, 2015
Short summary
Short summary
The popular data assimilation technique known as the ensemble Kalman filter (EnKF) suffers from sampling errors due to the limited size of the ensemble. This deficiency is usually cured by inflating the sampled error covariances and by using localization. This paper further develops and discusses the finite-size EnKF, or EnKF-N, a variant of the EnKF that does not require inflation. It expands the use of the EnKF-N to a wider range of dynamical regimes.
M. Bocquet, H. Elbern, H. Eskes, M. Hirtl, R. Žabkar, G. R. Carmichael, J. Flemming, A. Inness, M. Pagowski, J. L. Pérez Camaño, P. E. Saide, R. San Jose, M. Sofiev, J. Vira, A. Baklanov, C. Carnevale, G. Grell, and C. Seigneur
Atmos. Chem. Phys., 15, 5325–5358, https://doi.org/10.5194/acp-15-5325-2015, https://doi.org/10.5194/acp-15-5325-2015, 2015
Short summary
Short summary
Data assimilation is used in atmospheric chemistry models to improve air quality forecasts, construct re-analyses of concentrations, and perform inverse modeling. Coupled chemistry meteorology models (CCMM) are atmospheric chemistry models that simulate meteorological processes and chemical transformations jointly. We review here the current status of data assimilation in atmospheric chemistry models, with a particular focus on future prospects for data assimilation in CCMM.
N. Cherin, Y. Roustan, L. Musson-Genon, and C. Seigneur
Geosci. Model Dev., 8, 893–910, https://doi.org/10.5194/gmd-8-893-2015, https://doi.org/10.5194/gmd-8-893-2015, 2015
Short summary
Short summary
Atmospheric dry deposition is classically modelled using an average roughness
length. This approach cannot account for the spatial variability of dry deposition in urban areas. We extend here the urban canyon concept, previously introduced to parametrise momentum and heat transfer to mass transfer. This approach provides spatially distributed dry deposition fluxes that depend on surfaces (streets, walls, roofs) and flow regimes (recirculation and ventilation) within the urban area.
Y. Wang, K. N. Sartelet, M. Bocquet, P. Chazette, M. Sicard, G. D'Amico, J. F. Léon, L. Alados-Arboledas, A. Amodeo, P. Augustin, J. Bach, L. Belegante, I. Binietoglou, X. Bush, A. Comerón, H. Delbarre, D. García-Vízcaino, J. L. Guerrero-Rascado, M. Hervo, M. Iarlori, P. Kokkalis, D. Lange, F. Molero, N. Montoux, A. Muñoz, C. Muñoz, D. Nicolae, A. Papayannis, G. Pappalardo, J. Preissler, V. Rizi, F. Rocadenbosch, K. Sellegri, F. Wagner, and F. Dulac
Atmos. Chem. Phys., 14, 12031–12053, https://doi.org/10.5194/acp-14-12031-2014, https://doi.org/10.5194/acp-14-12031-2014, 2014
Y. Wang, K. N. Sartelet, M. Bocquet, and P. Chazette
Atmos. Chem. Phys., 14, 3511–3532, https://doi.org/10.5194/acp-14-3511-2014, https://doi.org/10.5194/acp-14-3511-2014, 2014
O. Saunier, A. Mathieu, D. Didier, M. Tombette, D. Quélo, V. Winiarek, and M. Bocquet
Atmos. Chem. Phys., 13, 11403–11421, https://doi.org/10.5194/acp-13-11403-2013, https://doi.org/10.5194/acp-13-11403-2013, 2013
M. Bocquet and P. Sakov
Nonlin. Processes Geophys., 20, 803–818, https://doi.org/10.5194/npg-20-803-2013, https://doi.org/10.5194/npg-20-803-2013, 2013
M. R. Koohkan, M. Bocquet, Y. Roustan, Y. Kim, and C. Seigneur
Atmos. Chem. Phys., 13, 5887–5905, https://doi.org/10.5194/acp-13-5887-2013, https://doi.org/10.5194/acp-13-5887-2013, 2013
Y. Wang, K. N. Sartelet, M. Bocquet, and P. Chazette
Atmos. Chem. Phys., 13, 269–283, https://doi.org/10.5194/acp-13-269-2013, https://doi.org/10.5194/acp-13-269-2013, 2013
Related subject area
Subject: Predictability, probabilistic forecasts, data assimilation, inverse problems | Topic: Climate, atmosphere, ocean, hydrology, cryosphere, biosphere | Techniques: Theory
Improving ensemble data assimilation through Probit-space Ensemble Size Expansion for Gaussian Copulas (PESE-GC)
Evolution of small-scale turbulence at large Richardson numbers
Prognostic Assumed-PDF (DDF) Approach: Further Generalization and Demonstrations
How far can the statistical error estimation problem be closed by collocated data?
Using orthogonal vectors to improve the ensemble space of the ensemble Kalman filter and its effect on data assimilation and forecasting
Review article: Towards strongly coupled ensemble data assimilation with additional improvements from machine learning
Toward a multivariate formulation of the parametric Kalman filter assimilation: application to a simplified chemical transport model
Data-driven reconstruction of partially observed dynamical systems
Extending ensemble Kalman filter algorithms to assimilate observations with an unknown time offset
Applying prior correlations for ensemble-based spatial localization
A stochastic covariance shrinkage approach to particle rejuvenation in the ensemble transform particle filter
Ensemble Riemannian data assimilation: towards large-scale dynamical systems
Inferring the instability of a dynamical system from the skill of data assimilation exercises
Multivariate localization functions for strongly coupled data assimilation in the bivariate Lorenz 96 system
Improving the potential accuracy and usability of EURO-CORDEX estimates of future rainfall climate using frequentist model averaging
Ensemble Riemannian data assimilation over the Wasserstein space
An early warning sign of critical transition in the Antarctic ice sheet – a data-driven tool for a spatiotemporal tipping point
Behavior of the iterative ensemble-based variational method in nonlinear problems
A methodology to obtain model-error covariances due to the discretization scheme from the parametric Kalman filter perspective
A method for predicting the uncompleted climate transition process
Statistical postprocessing of ensemble forecasts for severe weather at Deutscher Wetterdienst
Correcting for model changes in statistical postprocessing – an approach based on response theory
Brief communication: Residence time of energy in the atmosphere
Seasonal statistical–dynamical prediction of the North Atlantic Oscillation by probabilistic post-processing and its evaluation
Application of a local attractor dimension to reduced space strongly coupled data assimilation for chaotic multiscale systems
Order of operation for multi-stage post-processing of ensemble wind forecast trajectories
Man-Yau Chan
Nonlin. Processes Geophys., 31, 287–302, https://doi.org/10.5194/npg-31-287-2024, https://doi.org/10.5194/npg-31-287-2024, 2024
Short summary
Short summary
Forecasts have uncertainties. It is thus essential to reduce these uncertainties. Such reduction requires uncertainty quantification, which often means running costly models multiple times. The cost limits the number of model runs and thus the quantification’s accuracy. This study proposes a technique that utilizes users’ knowledge of forecast uncertainties to improve uncertainty quantification. Tests show that this technique improves uncertainty reduction.
Lev Ostrovsky, Irina Soustova, Yuliya Troitskaya, and Daria Gladskikh
Nonlin. Processes Geophys., 31, 219–227, https://doi.org/10.5194/npg-31-219-2024, https://doi.org/10.5194/npg-31-219-2024, 2024
Short summary
Short summary
The nonstationary kinetic model of turbulence is used to describe the evolution and structure of the upper turbulent layer with the parameters taken from in situ observations. As an example, we use a set of data for three cruises made in different areas of the world ocean. With the given profiles of current shear and buoyancy frequency, the theory yields results that satisfactorily agree with the measurements of the turbulent dissipation rate.
Jun-Ichi Yano
EGUsphere, https://doi.org/10.5194/egusphere-2024-287, https://doi.org/10.5194/egusphere-2024-287, 2024
Short summary
Short summary
A methodology for directly predicting the time evolution of the assumed parameters for the distribution densities based on the Liouville equation, as proposed earlier, is extended to multi–dimensional cases as well as when the systems are constrained by integrals over a part of the variable range. The extended methodology is tested against a convective energy cycle system as well as the Lorenz's stranger attractor.
Annika Vogel and Richard Ménard
Nonlin. Processes Geophys., 30, 375–398, https://doi.org/10.5194/npg-30-375-2023, https://doi.org/10.5194/npg-30-375-2023, 2023
Short summary
Short summary
Accurate estimation of the error statistics required for data assimilation remains an ongoing challenge, as statistical assumptions are required to solve the estimation problem. This work provides a conceptual view of the statistical error estimation problem in light of the increasing number of available datasets. We found that the total number of required assumptions increases with the number of overlapping datasets, but the relative number of error statistics that can be estimated increases.
Yung-Yun Cheng, Shu-Chih Yang, Zhe-Hui Lin, and Yung-An Lee
Nonlin. Processes Geophys., 30, 289–297, https://doi.org/10.5194/npg-30-289-2023, https://doi.org/10.5194/npg-30-289-2023, 2023
Short summary
Short summary
In the ensemble Kalman filter, the ensemble space may not fully capture the forecast errors due to the limited ensemble size and systematic model errors, which affect the accuracy of analysis and prediction. This study proposes a new algorithm to use cost-free pseudomembers to expand the ensemble space effectively and improve analysis accuracy during the analysis step, without increasing the ensemble size during forecasting.
Eugenia Kalnay, Travis Sluka, Takuma Yoshida, Cheng Da, and Safa Mote
Nonlin. Processes Geophys., 30, 217–236, https://doi.org/10.5194/npg-30-217-2023, https://doi.org/10.5194/npg-30-217-2023, 2023
Short summary
Short summary
Strongly coupled data assimilation (SCDA) generates coherent integrated Earth system analyses by assimilating the full Earth observation set into all Earth components. We describe SCDA based on the ensemble Kalman filter with a hierarchy of coupled models, from a coupled Lorenz to the Climate Forecast System v2. SCDA with a sufficiently large ensemble can provide more accurate coupled analyses compared to weakly coupled DA. The correlation-cutoff method can compensate for a small ensemble size.
Antoine Perrot, Olivier Pannekoucke, and Vincent Guidard
Nonlin. Processes Geophys., 30, 139–166, https://doi.org/10.5194/npg-30-139-2023, https://doi.org/10.5194/npg-30-139-2023, 2023
Short summary
Short summary
This work is a theoretical contribution that provides equations for understanding uncertainty prediction applied in air quality where multiple chemical species can interact. A simplified minimal test bed is introduced that shows the ability of our equations to reproduce the statistics estimated from an ensemble of forecasts. While the latter estimation is the state of the art, solving equations is numerically less costly, depending on the number of chemical species, and motivates this research.
Pierre Tandeo, Pierre Ailliot, and Florian Sévellec
Nonlin. Processes Geophys., 30, 129–137, https://doi.org/10.5194/npg-30-129-2023, https://doi.org/10.5194/npg-30-129-2023, 2023
Short summary
Short summary
The goal of this paper is to obtain probabilistic predictions of a partially observed dynamical system without knowing the model equations. It is illustrated using the three-dimensional Lorenz system, where only two components are observed. The proposed data-driven procedure is low-cost, is easy to implement, uses linear and Gaussian assumptions and requires only a small amount of data. It is based on an iterative linear Kalman smoother with a state augmentation.
Elia Gorokhovsky and Jeffrey L. Anderson
Nonlin. Processes Geophys., 30, 37–47, https://doi.org/10.5194/npg-30-37-2023, https://doi.org/10.5194/npg-30-37-2023, 2023
Short summary
Short summary
Older observations of the Earth system sometimes lack information about the time they were taken, posing problems for analyses of past climate. To begin to ameliorate this problem, we propose new methods of varying complexity, including methods to estimate the distribution of the offsets between true and reported observation times. The most successful method accounts for the nonlinearity in the system, but even the less expensive ones can improve data assimilation in the presence of time error.
Chu-Chun Chang and Eugenia Kalnay
Nonlin. Processes Geophys., 29, 317–327, https://doi.org/10.5194/npg-29-317-2022, https://doi.org/10.5194/npg-29-317-2022, 2022
Short summary
Short summary
This study introduces a new approach for enhancing the ensemble data assimilation (DA), a technique that combines observations and forecasts to improve numerical weather predictions. Our method uses the prescribed correlations to suppress spurious errors, improving the accuracy of DA. The experiments on the simplified atmosphere model show that our method has comparable performance to the traditional method but is superior in the early stage and is more computationally efficient.
Andrey A. Popov, Amit N. Subrahmanya, and Adrian Sandu
Nonlin. Processes Geophys., 29, 241–253, https://doi.org/10.5194/npg-29-241-2022, https://doi.org/10.5194/npg-29-241-2022, 2022
Short summary
Short summary
Numerical weather prediction requires the melding of both computational model and data obtained from sensors such as satellites. We focus on one algorithm to accomplish this. We aim to aid its use by additionally supplying it with data obtained from separate models that describe the average behavior of the computational model at any given time. We show that our approach outperforms the standard approaches to this problem.
Sagar K. Tamang, Ardeshir Ebtehaj, Peter Jan van Leeuwen, Gilad Lerman, and Efi Foufoula-Georgiou
Nonlin. Processes Geophys., 29, 77–92, https://doi.org/10.5194/npg-29-77-2022, https://doi.org/10.5194/npg-29-77-2022, 2022
Short summary
Short summary
The outputs from Earth system models are optimally combined with satellite observations to produce accurate forecasts through a process called data assimilation. Many existing data assimilation methodologies have some assumptions regarding the shape of the probability distributions of model output and observations, which results in forecast inaccuracies. In this paper, we test the effectiveness of a newly proposed methodology that relaxes such assumptions about high-dimensional models.
Yumeng Chen, Alberto Carrassi, and Valerio Lucarini
Nonlin. Processes Geophys., 28, 633–649, https://doi.org/10.5194/npg-28-633-2021, https://doi.org/10.5194/npg-28-633-2021, 2021
Short summary
Short summary
Chaotic dynamical systems are sensitive to the initial conditions, which are crucial for climate forecast. These properties are often used to inform the design of data assimilation (DA), a method used to estimate the exact initial conditions. However, obtaining the instability properties is burdensome for complex problems, both numerically and analytically. Here, we suggest a different viewpoint. We show that the skill of DA can be used to infer the instability properties of a dynamical system.
Zofia Stanley, Ian Grooms, and William Kleiber
Nonlin. Processes Geophys., 28, 565–583, https://doi.org/10.5194/npg-28-565-2021, https://doi.org/10.5194/npg-28-565-2021, 2021
Short summary
Short summary
In weather forecasting, observations are incorporated into a model of the atmosphere through a process called data assimilation. Sometimes observations in one location may impact the weather forecast in another faraway location in undesirable ways. The impact of distant observations on the forecast is mitigated through a process called localization. We propose a new method for localization when a model has multiple length scales, as in a model spanning both the ocean and the atmosphere.
Stephen Jewson, Giuliana Barbato, Paola Mercogliano, Jaroslav Mysiak, and Maximiliano Sassi
Nonlin. Processes Geophys., 28, 329–346, https://doi.org/10.5194/npg-28-329-2021, https://doi.org/10.5194/npg-28-329-2021, 2021
Short summary
Short summary
Climate model simulations are uncertain. In some cases this makes it difficult to know how to use them. Significance testing is often used to deal with this issue but has various shortcomings. We describe two alternative ways to manage uncertainty in climate model simulations that avoid these shortcomings. We test them on simulations of future rainfall over Europe and show they produce more accurate projections than either using unadjusted climate model output or statistical testing.
Sagar K. Tamang, Ardeshir Ebtehaj, Peter J. van Leeuwen, Dongmian Zou, and Gilad Lerman
Nonlin. Processes Geophys., 28, 295–309, https://doi.org/10.5194/npg-28-295-2021, https://doi.org/10.5194/npg-28-295-2021, 2021
Short summary
Short summary
Data assimilation aims to improve hydrologic and weather forecasts by combining available information from Earth system models and observations. The classical approaches to data assimilation usually proceed with some preconceived assumptions about the shape of their probability distributions. As a result, when such assumptions are invalid, the forecast accuracy suffers. In the proposed methodology, we relax such assumptions and demonstrate improved performance.
Abd AlRahman AlMomani and Erik Bollt
Nonlin. Processes Geophys., 28, 153–166, https://doi.org/10.5194/npg-28-153-2021, https://doi.org/10.5194/npg-28-153-2021, 2021
Short summary
Short summary
This paper introduces a tool for data-driven discovery of early warning signs of critical transitions in ice shelves from remote sensing data. Our directed spectral clustering method considers an asymmetric affinity matrix along with the associated directed graph Laplacian. We applied our approach to reprocessing the ice velocity data and remote sensing satellite images of the Larsen C ice shelf.
Shin'ya Nakano
Nonlin. Processes Geophys., 28, 93–109, https://doi.org/10.5194/npg-28-93-2021, https://doi.org/10.5194/npg-28-93-2021, 2021
Short summary
Short summary
The ensemble-based variational method is a method for solving nonlinear data assimilation problems by using an ensemble of multiple simulation results. Although this method is derived based on a linear approximation, highly uncertain problems, in which system nonlinearity is significant, can also be solved by applying this method iteratively. This paper reformulated this iterative algorithm to analyze its behavior in high-dimensional nonlinear problems and discuss the convergence.
Olivier Pannekoucke, Richard Ménard, Mohammad El Aabaribaoune, and Matthieu Plu
Nonlin. Processes Geophys., 28, 1–22, https://doi.org/10.5194/npg-28-1-2021, https://doi.org/10.5194/npg-28-1-2021, 2021
Short summary
Short summary
Numerical weather prediction involves numerically solving the mathematical equations, which describe the geophysical flow, by transforming them so that they can be computed. Through this transformation, it appears that the equations actually solved by the machine are then a modified version of the original equations, introducing an error that contributes to the model error. This work helps to characterize the covariance of the model error that is due to this modification of the equations.
Pengcheng Yan, Guolin Feng, Wei Hou, and Ping Yang
Nonlin. Processes Geophys., 27, 489–500, https://doi.org/10.5194/npg-27-489-2020, https://doi.org/10.5194/npg-27-489-2020, 2020
Short summary
Short summary
A system transiting from one stable state to another has to experience a period. Can we predict the end moment (state) if the process has not been completed? This paper presents a method to solve this problem. This method is based on the quantitative relationship among the parameters, which is used to describe the transition process of the abrupt change. By using the historical data, we extract some parameters for predicting the uncompleted climate transition process.
Reinhold Hess
Nonlin. Processes Geophys., 27, 473–487, https://doi.org/10.5194/npg-27-473-2020, https://doi.org/10.5194/npg-27-473-2020, 2020
Short summary
Short summary
Forecasts of ensemble systems are statistically aligned to synoptic observations at DWD in order to provide support for warning decision management. Motivation and design consequences for extreme and rare meteorological events are presented. Especially for probabilities of severe wind gusts global logistic parameterisations are developed that generate robust statistical forecasts for extreme events, while local characteristics are preserved.
Jonathan Demaeyer and Stéphane Vannitsem
Nonlin. Processes Geophys., 27, 307–327, https://doi.org/10.5194/npg-27-307-2020, https://doi.org/10.5194/npg-27-307-2020, 2020
Short summary
Short summary
Postprocessing schemes used to correct weather forecasts are no longer efficient when the model generating the forecasts changes. An approach based on response theory to take the change into account without having to recompute the parameters based on past forecasts is presented. It is tested on an analytical model and a simple model of atmospheric variability. We show that this approach is effective and discuss its potential application for an operational environment.
Carlos Osácar, Manuel Membrado, and Amalio Fernández-Pacheco
Nonlin. Processes Geophys., 27, 235–237, https://doi.org/10.5194/npg-27-235-2020, https://doi.org/10.5194/npg-27-235-2020, 2020
Short summary
Short summary
We deduce that after a global thermal perturbation, the Earth's
atmosphere would need about a couple of months to come back to equilibrium.
André Düsterhus
Nonlin. Processes Geophys., 27, 121–131, https://doi.org/10.5194/npg-27-121-2020, https://doi.org/10.5194/npg-27-121-2020, 2020
Short summary
Short summary
Seasonal prediction of the of the North Atlantic Oscillation (NAO) has been improved in recent years by improving dynamical models and ensemble predictions. One step therein was the so-called sub-sampling, which combines statistical and dynamical predictions. This study generalises this approach and makes it much more accessible. Furthermore, it presents a new verification approach for such predictions.
Courtney Quinn, Terence J. O'Kane, and Vassili Kitsios
Nonlin. Processes Geophys., 27, 51–74, https://doi.org/10.5194/npg-27-51-2020, https://doi.org/10.5194/npg-27-51-2020, 2020
Short summary
Short summary
This study presents a novel method for reduced-rank data assimilation of multiscale highly nonlinear systems. Time-varying dynamical properties are used to determine the rank and projection of the system onto a reduced subspace. The variable reduced-rank method is shown to succeed over other fixed-rank methods. This work provides implications for performing strongly coupled data assimilation with a limited number of ensemble members on high-dimensional coupled climate models.
Nina Schuhen
Nonlin. Processes Geophys., 27, 35–49, https://doi.org/10.5194/npg-27-35-2020, https://doi.org/10.5194/npg-27-35-2020, 2020
Short summary
Short summary
We present a new way to adaptively improve weather forecasts by incorporating last-minute observation information. The recently measured error, together with a statistical model, gives us an indication of the expected future error of wind speed forecasts, which are then adjusted accordingly. This new technique can be especially beneficial for customers in the wind energy industry, where it is important to have reliable short-term forecasts, as well as providers of extreme weather warnings.
Cited articles
Amodei, M. and Stein, J.: Deterministic and fuzzy verification methods for a hierarchy of numerical models, Meteorol. Appl., 16, 191–203, https://doi.org/10.1002/met.101, 2009. a, b
Asch, M., Bocquet, M., and Nodet, M.: Data Assimilation: Methods, Algorithms, and Applications, Fundamentals of Algorithms, SIAM, Philadelphia, ISBN 978-1-611974-53-9, https://doi.org/10.1137/1.9781611974546, 2016. a, b
Bocquet, M.: Towards optimal choices of control space representation for geophysical data assimilation, Mon. Weather Rev., 137, 2331–2348, https://doi.org/10.1175/2009MWR2789.1, 2009. a
Bocquet, M., Wu, L., and Chevallier, F.: Bayesian design of control space for optimal assimilation of observations. I: Consistent multiscale formalism, Q. J. Roy. Meteor. Soc., 137, 1340–1356, https://doi.org/10.1002/qj.837, 2011. a
Briggs, W. M. and Levine, R. A.: Wavelets and field forecast verification, Mon. Weather Rev., 125, 1329–1341, https://doi.org/1520-0493(1997)125<1329:WAFFV>2.0.CO;2, 1997. a
Carrassi, A., Bocquet, M., Bertino, L., and Evensen, G.: Data Assimilation in the Geosciences: An overview on methods, issues, and perspectives, WIREs Clim. Change, 9, e535, https://doi.org/10.1002/wcc.535, 2018. a
Chizat, L., Peyré, G., Schmitzer, B., and Vialard, F.-X.: Scaling algorithms for unbalanced optimal transport problems, Math. Comput., 87, 2563–2609, https://doi.org/10.1090/mcom/3303, 2018. a
Courtier, P.: Dual formulation of four-dimensional variational assimilation, Q. J. Roy. Meteor. Soc., 123, 2449–2461, https://doi.org/10.1002/qj.49712354414, 1997. a, b
Daley, R.: Atmospheric Data Analysis, Cambridge University Press, New-York, ISBN 9780521458252, 1991. a
Davis, C., Brown, B., and Bullock, R.: Object-based verification of precipitation forecasts. Part I: Methodology and application to mesoscale rain areas, Mon. Weather Rev., 134, 772–1784, https://doi.org/10.1175/MWR3146.1, 2006a. a
Davis, C., Brown, B., and Bullock, R.: Object-based verification of precipitation forecasts. Part II: Application to convective rain systems, Mon. Weather Rev., 134, 1785–1795, https://doi.org/10.1175/MWR3145.1, 2006b. a
Duc, L. and Sawada, Y.: Geometry of rainfall ensemble means: from arithmetic averages to Gaussian-Hellinger barycenters in unbalanced optimal transport, J. Meteor. Soc. Jpn., 102, 35–47, https://doi.org/10.2151/jmsj.2024-003, 2024. a
Ebert, E. E.: Fuzzy verification of high-resolution gridded forecasts: a review and proposed framework, Meteorol. Appl., 15, 51–64, https://doi.org/10.1002/met.25, 2008. a
El Moselhy, T. A. and Marzouk, Y. M.: Bayesian inference with optimal maps, J. Comp. Phys., 231, 7815–7850, https://doi.org/10.1016/j.jcp.2012.07.022, 2012. a
Evensen, G., Vossepoel, F. C., and van Leeuwen. P. J.: Data Assimilation Fundamentals: A Unified Formulation of the State and Parameter Estimation Problem, Springer Textbooks in Earth Sciences, Geography and Environment, Springer Cham, ISBN 978-3-030-96708-6, https://doi.org/10.1007/978-3-030-96709-3, 2022. a
Farchi, A. and Bocquet, M.: Review article: Comparison of local particle filters and new implementations, Nonlin. Processes Geophys., 25, 765–807, https://doi.org/10.5194/npg-25-765-2018, 2018. a
Farchi, A., Bocquet, M., Roustan, Y., Mathieu, A., and Quérel, A.: Using the Wasserstein distance to compare fields of pollutants: application to the radionuclide atmospheric dispersion of the Fukushima-Daiichi accident, Tellus B, 68, 31682, https://doi.org/10.3402/tellusb.v68.31682, 2016. a, b
Flamary, R., Courty, N., Gramfort, A., Alaya, M. Z., Boisbunon, A., Chambon, S., Chapel, L., Corenflos, A., K., F., Fournier, N., Gautheron, L., Gayraud, N. T. H., Janati, H., Rakotomamonjy, A., Redko, I., Rolet, A., Schutz, A., Seguy, V., Sutherland, D. J., Tavenard, R., Tong, A., and Vayer, T.: POT: Python Optimal Transport, J. Mach. Learn. Res., 22, 1–8, http://jmlr.org/papers/v22/20-451.html (last access: 7 July 2024), 2021. a
Gangbo, W. and McCann, R. J.: The geometry of optimal transportation, Acta Math., 177, 113–1618, https://doi.org/10.1007/BF02392620, 1996. a
Gilleland, E., Ahijevych, D. A., Brown, B. G., and Ebert, E. E.: Verifying forecasts spatially, B. Am. Meteorol. Soc., 91, 1365–1373, https://doi.org/10.1175/2010BAMS2819.1, 2010a. a
Gilleland, E., Lindström, J., and Lindgren, F.: Analyzing the image warp forecast verification method on precipitation fields from the ICP, Weather Forecast., 25, 1249–1262, https://doi.org/10.1175/2010WAF2222365.1, 2010b. a
Hoffman, R. N. and Grassotti, C.: A Technique for Assimilating SSM/I Observations of Marine Atmospheric Storms: Tests with ECMWF Analyses, J. Appl. Meteorol. Clim., 35, 1177–1188, https://doi.org/10.1175/1520-0450(1996)035<1177:ATFASO>2.0.CO;2, 1996. a
Hoffman, R. N., Liu, Z., Louis, J.-F., and Grassoti, C.: Distortion representation of forecast errors, Mon. Weather Rev., 123, 2758–2770, https://doi.org/10.1175/1520-0493(1995)123<2758:DROFE>2.0.CO;2, 1995. a, b
Janjić, T., Bormann, N., Bocquet, M., Carton, J. A., Cohn, S. E., Dance, S. L., Losa, S. N., Nichols, N. K., Potthast, R., Waller, J. A., and Weston, P.: On the representation error in data assimilation, Q. J. Roy. Meteor. Soc., 144, 1257–1278, https://doi.org/10.1002/qj.3130, 2018. a
Kalnay, E.: Atmospheric Modeling, Data Assimilation and Predictability, Cambridge University Press, Cambridge, ISBN 9780521796293, 2003. a
Keil, C. and Craig, G. C.: A displacement and amplitude score employing an optical flow technique, Weather Forecast., 24, 1297–1308, https://doi.org/10.1175/2009WAF2222247.1, 2009. a
Lack, S. A., Limpert, G. L., and Fox, N. I.: An object-oriented multiscale verification scheme, Weather Forecast., 25, 79–92, https://doi.org/10.1175/2009WAF2222245.1, 2010. a
Le Coz, C., Tantet, A., Flamary, R., and Plougonven, R.: Optimal transport for the multi-model combination of sub-seasonal ensemble forecasts, EGU General Assembly 2023, Vienna, Austria, 24–28 Apr 2023, EGU23-13445, https://doi.org/10.5194/egusphere-egu23-13445, 2023. a
Liu, D. C. and Nocedal, J.: On the limited memory BFGS method for large scale optimization, Math. Programm., 45, 503–528, https://doi.org/10.1007/BF01589116, 1989. a, b
Lledó, L., Skok, G., and Haiden, T.: Estimating location errors in precipitation forecasts with the Wasserstein and Attribution distances, EMS Annual Meeting 2023, Bratislava, Slovakia, 4–8 Sep 2023, EMS2023-602, https://doi.org/10.5194/ems2023-602, 2023. a
Marzouk, Y., Moselhy, T., Parno, M., and Spantini, A.: An introduction to sampling via measure transport, in: Handbook of Uncertainty Quantification, edited by: Ghanem, R., Higdon, D., and Owhadi, H., chap. 23, Springer International Publishing, Cham, 785–825, https://doi.org/10.1007/978-3-319-12385-1_23, 2017. a
Monge, G.: Mémoire sur la théorie des déblais et des remblais, in: Histoire de l'Académie Royale des Sciences de Paris, 666–704, 1781. a
Necker, T., Wolfgruber, L., Kugler, L., Weissmann, M., Dorninger, M., and Serafin, S.: The fractions skill score for ensemble forecast verification, Authorea [preprint], https://doi.org/10.22541/au.169169008.89657659/v1, 2023. a
Ning, L.and Carli, F. P., Ebtehaj, A. M., Foufoula-Georgiou, E., and Georgiou, T. T.: Coping with model error in variational data assimilation using optimal mass transport, Water Resour. Res., 50, 5817–5830, https://doi.org/10.1002/2013WR014966, 2014. a, b
Oliver, D. S.: Minimization for conditional simulation: Relationship to optimal transport, J. Comp. Phys., 265, 1–15, https://doi.org/10.1016/j.jcp.2014.01.048, 2014. a
Optimal Transport: Github [code], https://github.com/PythonOT, last access: 7 July 2024. a
Plu, M.: A variational formulation for translation and assimilation of coherent structures, Nonlin. Processes Geophys., 20, 793–801, https://doi.org/10.5194/npg-20-793-2013, 2013. a
Ravela, S., Emanuel, K., and McLaughlin, D.: Data assimilation by field alignement, Physica D, 230, 127–145, https://doi.org/10.1016/j.physd.2006.09.035, 2007. a
Rodgers, C. D.: Inverse methods for atmospheric sounding, vol. 2, World Scientific, Series on Atmospheric, Oceanic and Planetary Physics, ISBN 978-981-02-2740-1, https://doi.org/10.1142/3171, 2000. a, b
SciPy: SciPy library main repository, Github [code], https://github.com/scipy/scipy, last access: 7 July 2024. a
Sinkhorn, R.: A relationship between arbitrary positive matrices and doubly stochastic matrices, Ann. Math. Stat., 35, 876–879, 1964. a
Skok, G.: Precipitation attribution distance, Atmos. Res., 295, 106998, https://doi.org/10.1016/j.atmosres.2023.106998, 2023. a
Talagrand, O.: Assimilation of Observations, an Introduction, J. Meteor. Soc. Jpn., 75, 191–209, https://doi.org/10.2151/jmsj1965.75.1B_191, 1997. a
Tamang, S. K., Ebtehaj, A., Zou, D., and Lerman, G.: Regularized variational data assimilation for bias treatment using the W asserstein metric, Q. J. Roy. Meteor. Soc., 146, 2332–2346, https://doi.org/10.1002/qj.3794, 2020. a
Tamang, S. K., Ebtehaj, A., van Leeuwen, P. J., Zou, D., and Lerman, G.: Ensemble Riemannian data assimilation over the Wasserstein space, Nonlin. Processes Geophys., 28, 295–309, https://doi.org/10.5194/npg-28-295-2021, 2021. a
Tamang, S. K., Ebtehaj, A., van Leeuwen, P. J., Lerman, G., and Foufoula-Georgiou, E.: Ensemble Riemannian data assimilation: towards large-scale dynamical systems, Nonlin. Processes Geophys., 29, 77–92, https://doi.org/10.5194/npg-29-77-2022, 2022. a
Vanderbecken, P. J., Dumont Le Brazidec, J., Farchi, A., Bocquet, M., Roustan, Y., Potier, É., and Broquet, G.: Accounting for meteorological biases in simulated plumes using smarter metrics, Atmos. Meas. Tech., 16, 1745–1766, https://doi.org/10.5194/amt-16-1745-2023, 2023. a, b
Vilani, C.: Topics in Optimal Transportation, vol. 58 of Graduate Studies in Mathematics, American Mathematical Society, Providence, Rhode Island, ISBN 9780821833124, 2003. a
Wernli, H., Paulat, M., Hagen, M., and Frei, C.: SAL – A Novel Quality Measure for the Verification of Quantitative Precipitation Forecasts, Mon. Weather Rev., 136, 4470–4487, https://doi.org/10.1175/2008MWR2415.1, 2008. a, b
Ying, Y.: A Multiscale Alignment Method for Ensemble Filtering with Displacement Errors, Mon. Weather Rev., 147, 4553–4565, https://doi.org/10.1175/MWR-D-19-0170.1, 2019. a
Ying, Y., Anderson, J. L., and Bertino, L.: Improving Vortex Position Accuracy with a New Multiscale Alignment Ensemble Filter, Mon. Weather Rev., 151, 1387–405, https://doi.org/10.1175/MWR-D-22-0140.1, 2023. a
Zhou, W., Bovik, A. C., Sheikh, H. R., and Simoncelli, E.: Image quality assessment: from error visibility to structural similarity, IEEE T. Image Process., 13, 600–612, https://doi.org/10.1109/TIP.2003.819861, 2004. a
Short summary
A novel approach, optimal transport data assimilation (OTDA), is introduced to merge DA and OT concepts. By leveraging OT's displacement interpolation in space, it minimises mislocation errors within DA applied to physical fields, such as water vapour, hydrometeors, and chemical species. Its richness and flexibility are showcased through one- and two-dimensional illustrations.
A novel approach, optimal transport data assimilation (OTDA), is introduced to merge DA and OT...
