Articles | Volume 22, issue 6
Nonlin. Processes Geophys., 22, 645–662, 2015
https://doi.org/10.5194/npg-22-645-2015
© Author(s) 2015. This work is distributed under
the Creative Commons Attribution 3.0 License.
the Creative Commons Attribution 3.0 License.
Nonlin. Processes Geophys., 22, 645–662, 2015
https://doi.org/10.5194/npg-22-645-2015
© Author(s) 2015. This work is distributed under
the Creative Commons Attribution 3.0 License.
the Creative Commons Attribution 3.0 License.
Research article 03 Nov 2015
Research article | 03 Nov 2015
Expanding the validity of the ensemble Kalman filter without the intrinsic need for inflation
M. Bocquet et al.
Related authors
Joffrey Dumont Le Brazidec, Marc Bocquet, Olivier Saunier, and Yelva Roustan
Atmos. Chem. Phys. Discuss., https://doi.org/10.5194/acp-2020-1129, https://doi.org/10.5194/acp-2020-1129, 2021
Preprint under review for ACP
Colin Grudzien, Marc Bocquet, and Alberto Carrassi
Geosci. Model Dev., 13, 1903–1924, https://doi.org/10.5194/gmd-13-1903-2020, https://doi.org/10.5194/gmd-13-1903-2020, 2020
Short summary
Short summary
All scales of a dynamical physical process cannot be resolved accurately in a multiscale, geophysical model. The behavior of unresolved scales of motion are often parametrized by a random process to emulate their effects on the dynamically resolved variables, and this results in a random–dynamical model. We study how the choice of a numerical discretization of such a system affects the model forecast and estimation statistics, when the random–dynamical model is unbiased in its parametrization.
Thomas Lauvaux, Liza I. Díaz-Isaac, Marc Bocquet, and Nicolas Bousserez
Atmos. Chem. Phys., 19, 12007–12024, https://doi.org/10.5194/acp-19-12007-2019, https://doi.org/10.5194/acp-19-12007-2019, 2019
Short summary
Short summary
A small-size ensemble of mesoscale simulations has been filtered to characterize the spatial structures of transport errors in atmospheric CO2 mixing ratios. The extracted error structures in in situ and column CO2 show similar length scales compared to other meteorological variables, including seasonality, which could be used as proxies in regional inversion systems.
Marc Bocquet, Julien Brajard, Alberto Carrassi, and Laurent Bertino
Nonlin. Processes Geophys., 26, 143–162, https://doi.org/10.5194/npg-26-143-2019, https://doi.org/10.5194/npg-26-143-2019, 2019
Short summary
Short summary
This paper describes an innovative way to use data assimilation to infer the dynamics of a physical system from its observation only. The method can operate with noisy and partial observation of the physical system. It acts as a deep learning technique specialised to dynamical models without the need for machine learning tools. The method is successfully tested on chaotic dynamical systems: the Lorenz-63, Lorenz-96, and Kuramoto–Sivashinski models and a two-scale Lorenz model.
Julien Brajard, Alberto Carrassi, Marc Bocquet, and Laurent Bertino
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2019-136, https://doi.org/10.5194/gmd-2019-136, 2019
Revised manuscript not accepted
Short summary
Short summary
We explore the possibility of combining data assimilation with machine learning. We introduce a new hybrid method for a two-fold scope: (i) emulating hidden, possibly chaotic, dynamics and (ii) predicting its future states. Numerical experiments have been carried out using the chaotic Lorenz 96 model, proving both the convergence of the hybrid method and its statistical skills including short-term forecasting and emulation of the long-term dynamics.
Liza I. Díaz-Isaac, Thomas Lauvaux, Marc Bocquet, and Kenneth J. Davis
Atmos. Chem. Phys., 19, 5695–5718, https://doi.org/10.5194/acp-19-5695-2019, https://doi.org/10.5194/acp-19-5695-2019, 2019
Short summary
Short summary
We demonstrate that transport model errors, one of the main contributors to the uncertainty in regional CO2 inversions, can be represented by a small-size ensemble carefully calibrated with meteorological data. Our results also confirm transport model errors represent a significant fraction of the model–data mismatch in CO2 mole fractions and hence in regional inverse CO2 fluxes.
Alban Farchi and Marc Bocquet
Nonlin. Processes Geophys., 25, 765–807, https://doi.org/10.5194/npg-25-765-2018, https://doi.org/10.5194/npg-25-765-2018, 2018
Short summary
Short summary
Data assimilation looks for an optimal way to learn from observations of a dynamical system to improve the quality of its predictions. The goal is to filter out the noise (both observation and model noise) to retrieve the true signal. Among all possible methods, particle filters are promising; the method is fast and elegant, and it allows for a Bayesian analysis. In this review paper, we discuss implementation techniques for (local) particle filters in high-dimensional systems.
Colin Grudzien, Alberto Carrassi, and Marc Bocquet
Nonlin. Processes Geophys., 25, 633–648, https://doi.org/10.5194/npg-25-633-2018, https://doi.org/10.5194/npg-25-633-2018, 2018
Short summary
Short summary
Using the framework Lyapunov vectors, we analyze the asymptotic properties of ensemble based Kalman filters and how these are influenced by dynamical chaos, especially in the context of random model errors and small ensemble sizes. Particularly, we show a novel derivation of the evolution of forecast uncertainty for ensemble-based Kalman filters with weakly-nonlinear error growth, and discuss its impact for filter design in geophysical models.
Olivier Pannekoucke, Marc Bocquet, and Richard Ménard
Nonlin. Processes Geophys., 25, 481–495, https://doi.org/10.5194/npg-25-481-2018, https://doi.org/10.5194/npg-25-481-2018, 2018
Short summary
Short summary
The forecast of weather prediction uncertainty is a real challenge and is crucial for risk management. However, uncertainty prediction is beyond the capacity of supercomputers, and improvements of the technology may not solve this issue. A new uncertainty prediction method is introduced which takes advantage of fluid equations to predict simple quantities which approximate real uncertainty but at a low numerical cost. A proof of concept is shown by an academic model derived from fluid dynamics.
Anthony Fillion, Marc Bocquet, and Serge Gratton
Nonlin. Processes Geophys., 25, 315–334, https://doi.org/10.5194/npg-25-315-2018, https://doi.org/10.5194/npg-25-315-2018, 2018
Short summary
Short summary
This study generalizes a paper by Pires et al. (1996) to state-of-the-art data assimilation techniques, such as the iterative ensemble Kalman smoother (IEnKS). We show that the longer the time window over which observations are assimilated, the better the accuracy of the IEnKS. Beyond a critical time length that we estimate, we show that this accuracy finally degrades. We show that the use of the quasi-static minimizations but generalized to the IEnKS yields a significantly improved accuracy.
J.-M. Haussaire and M. Bocquet
Geosci. Model Dev., 9, 393–412, https://doi.org/10.5194/gmd-9-393-2016, https://doi.org/10.5194/gmd-9-393-2016, 2016
Short summary
Short summary
The focus is on the development of low-order models of atmospheric transport and chemistry and their use for data assimilation purposes. A new low-order coupled chemistry meteorology model is developed. It consists of the Lorenz40-variable model used as a wind field coupled with a simple ozone photochemistry module. Advanced ensemble variational methods are applied to this model to obtain insights on the use of data assimilation with coupled models, in an offline mode or in an online mode.
M. Bocquet, H. Elbern, H. Eskes, M. Hirtl, R. Žabkar, G. R. Carmichael, J. Flemming, A. Inness, M. Pagowski, J. L. Pérez Camaño, P. E. Saide, R. San Jose, M. Sofiev, J. Vira, A. Baklanov, C. Carnevale, G. Grell, and C. Seigneur
Atmos. Chem. Phys., 15, 5325–5358, https://doi.org/10.5194/acp-15-5325-2015, https://doi.org/10.5194/acp-15-5325-2015, 2015
Short summary
Short summary
Data assimilation is used in atmospheric chemistry models to improve air quality forecasts, construct re-analyses of concentrations, and perform inverse modeling. Coupled chemistry meteorology models (CCMM) are atmospheric chemistry models that simulate meteorological processes and chemical transformations jointly. We review here the current status of data assimilation in atmospheric chemistry models, with a particular focus on future prospects for data assimilation in CCMM.
Y. Wang, K. N. Sartelet, M. Bocquet, P. Chazette, M. Sicard, G. D'Amico, J. F. Léon, L. Alados-Arboledas, A. Amodeo, P. Augustin, J. Bach, L. Belegante, I. Binietoglou, X. Bush, A. Comerón, H. Delbarre, D. García-Vízcaino, J. L. Guerrero-Rascado, M. Hervo, M. Iarlori, P. Kokkalis, D. Lange, F. Molero, N. Montoux, A. Muñoz, C. Muñoz, D. Nicolae, A. Papayannis, G. Pappalardo, J. Preissler, V. Rizi, F. Rocadenbosch, K. Sellegri, F. Wagner, and F. Dulac
Atmos. Chem. Phys., 14, 12031–12053, https://doi.org/10.5194/acp-14-12031-2014, https://doi.org/10.5194/acp-14-12031-2014, 2014
Y. Wang, K. N. Sartelet, M. Bocquet, and P. Chazette
Atmos. Chem. Phys., 14, 3511–3532, https://doi.org/10.5194/acp-14-3511-2014, https://doi.org/10.5194/acp-14-3511-2014, 2014
O. Saunier, A. Mathieu, D. Didier, M. Tombette, D. Quélo, V. Winiarek, and M. Bocquet
Atmos. Chem. Phys., 13, 11403–11421, https://doi.org/10.5194/acp-13-11403-2013, https://doi.org/10.5194/acp-13-11403-2013, 2013
M. Bocquet and P. Sakov
Nonlin. Processes Geophys., 20, 803–818, https://doi.org/10.5194/npg-20-803-2013, https://doi.org/10.5194/npg-20-803-2013, 2013
M. R. Koohkan, M. Bocquet, Y. Roustan, Y. Kim, and C. Seigneur
Atmos. Chem. Phys., 13, 5887–5905, https://doi.org/10.5194/acp-13-5887-2013, https://doi.org/10.5194/acp-13-5887-2013, 2013
Y. Wang, K. N. Sartelet, M. Bocquet, and P. Chazette
Atmos. Chem. Phys., 13, 269–283, https://doi.org/10.5194/acp-13-269-2013, https://doi.org/10.5194/acp-13-269-2013, 2013
Joffrey Dumont Le Brazidec, Marc Bocquet, Olivier Saunier, and Yelva Roustan
Atmos. Chem. Phys. Discuss., https://doi.org/10.5194/acp-2020-1129, https://doi.org/10.5194/acp-2020-1129, 2021
Preprint under review for ACP
Colin Grudzien, Marc Bocquet, and Alberto Carrassi
Geosci. Model Dev., 13, 1903–1924, https://doi.org/10.5194/gmd-13-1903-2020, https://doi.org/10.5194/gmd-13-1903-2020, 2020
Short summary
Short summary
All scales of a dynamical physical process cannot be resolved accurately in a multiscale, geophysical model. The behavior of unresolved scales of motion are often parametrized by a random process to emulate their effects on the dynamically resolved variables, and this results in a random–dynamical model. We study how the choice of a numerical discretization of such a system affects the model forecast and estimation statistics, when the random–dynamical model is unbiased in its parametrization.
Alexis Hannart
Adv. Stat. Clim. Meteorol. Oceanogr., 5, 161–171, https://doi.org/10.5194/ascmo-5-161-2019, https://doi.org/10.5194/ascmo-5-161-2019, 2019
Short summary
Short summary
In climate change attribution studies, one often seeks to maximize a signal-to-noise ratio, where the
signalis the anthropogenic response and the
noiseis climate variability. A solution commonly used in D&A studies thus far consists of projecting the signal on the subspace spanned by the leading eigenvectors of climate variability. Here I show that this approach is vastly suboptimal – in fact, it leads instead to maximizing the noise-to-signal ratio. I then describe an improved solution.
Thomas Lauvaux, Liza I. Díaz-Isaac, Marc Bocquet, and Nicolas Bousserez
Atmos. Chem. Phys., 19, 12007–12024, https://doi.org/10.5194/acp-19-12007-2019, https://doi.org/10.5194/acp-19-12007-2019, 2019
Short summary
Short summary
A small-size ensemble of mesoscale simulations has been filtered to characterize the spatial structures of transport errors in atmospheric CO2 mixing ratios. The extracted error structures in in situ and column CO2 show similar length scales compared to other meteorological variables, including seasonality, which could be used as proxies in regional inversion systems.
Marc Bocquet, Julien Brajard, Alberto Carrassi, and Laurent Bertino
Nonlin. Processes Geophys., 26, 143–162, https://doi.org/10.5194/npg-26-143-2019, https://doi.org/10.5194/npg-26-143-2019, 2019
Short summary
Short summary
This paper describes an innovative way to use data assimilation to infer the dynamics of a physical system from its observation only. The method can operate with noisy and partial observation of the physical system. It acts as a deep learning technique specialised to dynamical models without the need for machine learning tools. The method is successfully tested on chaotic dynamical systems: the Lorenz-63, Lorenz-96, and Kuramoto–Sivashinski models and a two-scale Lorenz model.
Julien Brajard, Alberto Carrassi, Marc Bocquet, and Laurent Bertino
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2019-136, https://doi.org/10.5194/gmd-2019-136, 2019
Revised manuscript not accepted
Short summary
Short summary
We explore the possibility of combining data assimilation with machine learning. We introduce a new hybrid method for a two-fold scope: (i) emulating hidden, possibly chaotic, dynamics and (ii) predicting its future states. Numerical experiments have been carried out using the chaotic Lorenz 96 model, proving both the convergence of the hybrid method and its statistical skills including short-term forecasting and emulation of the long-term dynamics.
Liza I. Díaz-Isaac, Thomas Lauvaux, Marc Bocquet, and Kenneth J. Davis
Atmos. Chem. Phys., 19, 5695–5718, https://doi.org/10.5194/acp-19-5695-2019, https://doi.org/10.5194/acp-19-5695-2019, 2019
Short summary
Short summary
We demonstrate that transport model errors, one of the main contributors to the uncertainty in regional CO2 inversions, can be represented by a small-size ensemble carefully calibrated with meteorological data. Our results also confirm transport model errors represent a significant fraction of the model–data mismatch in CO2 mole fractions and hence in regional inverse CO2 fluxes.
Alban Farchi and Marc Bocquet
Nonlin. Processes Geophys., 25, 765–807, https://doi.org/10.5194/npg-25-765-2018, https://doi.org/10.5194/npg-25-765-2018, 2018
Short summary
Short summary
Data assimilation looks for an optimal way to learn from observations of a dynamical system to improve the quality of its predictions. The goal is to filter out the noise (both observation and model noise) to retrieve the true signal. Among all possible methods, particle filters are promising; the method is fast and elegant, and it allows for a Bayesian analysis. In this review paper, we discuss implementation techniques for (local) particle filters in high-dimensional systems.
Colin Grudzien, Alberto Carrassi, and Marc Bocquet
Nonlin. Processes Geophys., 25, 633–648, https://doi.org/10.5194/npg-25-633-2018, https://doi.org/10.5194/npg-25-633-2018, 2018
Short summary
Short summary
Using the framework Lyapunov vectors, we analyze the asymptotic properties of ensemble based Kalman filters and how these are influenced by dynamical chaos, especially in the context of random model errors and small ensemble sizes. Particularly, we show a novel derivation of the evolution of forecast uncertainty for ensemble-based Kalman filters with weakly-nonlinear error growth, and discuss its impact for filter design in geophysical models.
Olivier Pannekoucke, Marc Bocquet, and Richard Ménard
Nonlin. Processes Geophys., 25, 481–495, https://doi.org/10.5194/npg-25-481-2018, https://doi.org/10.5194/npg-25-481-2018, 2018
Short summary
Short summary
The forecast of weather prediction uncertainty is a real challenge and is crucial for risk management. However, uncertainty prediction is beyond the capacity of supercomputers, and improvements of the technology may not solve this issue. A new uncertainty prediction method is introduced which takes advantage of fluid equations to predict simple quantities which approximate real uncertainty but at a low numerical cost. A proof of concept is shown by an academic model derived from fluid dynamics.
Anthony Fillion, Marc Bocquet, and Serge Gratton
Nonlin. Processes Geophys., 25, 315–334, https://doi.org/10.5194/npg-25-315-2018, https://doi.org/10.5194/npg-25-315-2018, 2018
Short summary
Short summary
This study generalizes a paper by Pires et al. (1996) to state-of-the-art data assimilation techniques, such as the iterative ensemble Kalman smoother (IEnKS). We show that the longer the time window over which observations are assimilated, the better the accuracy of the IEnKS. Beyond a critical time length that we estimate, we show that this accuracy finally degrades. We show that the use of the quasi-static minimizations but generalized to the IEnKS yields a significantly improved accuracy.
J.-M. Haussaire and M. Bocquet
Geosci. Model Dev., 9, 393–412, https://doi.org/10.5194/gmd-9-393-2016, https://doi.org/10.5194/gmd-9-393-2016, 2016
Short summary
Short summary
The focus is on the development of low-order models of atmospheric transport and chemistry and their use for data assimilation purposes. A new low-order coupled chemistry meteorology model is developed. It consists of the Lorenz40-variable model used as a wind field coupled with a simple ozone photochemistry module. Advanced ensemble variational methods are applied to this model to obtain insights on the use of data assimilation with coupled models, in an offline mode or in an online mode.
M. Bocquet, H. Elbern, H. Eskes, M. Hirtl, R. Žabkar, G. R. Carmichael, J. Flemming, A. Inness, M. Pagowski, J. L. Pérez Camaño, P. E. Saide, R. San Jose, M. Sofiev, J. Vira, A. Baklanov, C. Carnevale, G. Grell, and C. Seigneur
Atmos. Chem. Phys., 15, 5325–5358, https://doi.org/10.5194/acp-15-5325-2015, https://doi.org/10.5194/acp-15-5325-2015, 2015
Short summary
Short summary
Data assimilation is used in atmospheric chemistry models to improve air quality forecasts, construct re-analyses of concentrations, and perform inverse modeling. Coupled chemistry meteorology models (CCMM) are atmospheric chemistry models that simulate meteorological processes and chemical transformations jointly. We review here the current status of data assimilation in atmospheric chemistry models, with a particular focus on future prospects for data assimilation in CCMM.
Y. Wang, K. N. Sartelet, M. Bocquet, P. Chazette, M. Sicard, G. D'Amico, J. F. Léon, L. Alados-Arboledas, A. Amodeo, P. Augustin, J. Bach, L. Belegante, I. Binietoglou, X. Bush, A. Comerón, H. Delbarre, D. García-Vízcaino, J. L. Guerrero-Rascado, M. Hervo, M. Iarlori, P. Kokkalis, D. Lange, F. Molero, N. Montoux, A. Muñoz, C. Muñoz, D. Nicolae, A. Papayannis, G. Pappalardo, J. Preissler, V. Rizi, F. Rocadenbosch, K. Sellegri, F. Wagner, and F. Dulac
Atmos. Chem. Phys., 14, 12031–12053, https://doi.org/10.5194/acp-14-12031-2014, https://doi.org/10.5194/acp-14-12031-2014, 2014
Y. Wang, K. N. Sartelet, M. Bocquet, and P. Chazette
Atmos. Chem. Phys., 14, 3511–3532, https://doi.org/10.5194/acp-14-3511-2014, https://doi.org/10.5194/acp-14-3511-2014, 2014
O. Saunier, A. Mathieu, D. Didier, M. Tombette, D. Quélo, V. Winiarek, and M. Bocquet
Atmos. Chem. Phys., 13, 11403–11421, https://doi.org/10.5194/acp-13-11403-2013, https://doi.org/10.5194/acp-13-11403-2013, 2013
M. Bocquet and P. Sakov
Nonlin. Processes Geophys., 20, 803–818, https://doi.org/10.5194/npg-20-803-2013, https://doi.org/10.5194/npg-20-803-2013, 2013
M. R. Koohkan, M. Bocquet, Y. Roustan, Y. Kim, and C. Seigneur
Atmos. Chem. Phys., 13, 5887–5905, https://doi.org/10.5194/acp-13-5887-2013, https://doi.org/10.5194/acp-13-5887-2013, 2013
Y. Wang, K. N. Sartelet, M. Bocquet, and P. Chazette
Atmos. Chem. Phys., 13, 269–283, https://doi.org/10.5194/acp-13-269-2013, https://doi.org/10.5194/acp-13-269-2013, 2013
Related subject area
Subject: Predictability, probabilistic forecasts, data assimilation, inverse problems | Topic: Climate, atmosphere, ocean, hydrology, cryosphere, biosphere
Training a convolutional neural network to conserve mass in data assimilation
Behavior of the iterative ensemble-based variational method in nonlinear problems
Fast hybrid tempered ensemble transform filter formulation for Bayesian elliptical problems via Sinkhorn approximation
A methodology to obtain model-error covariances due to the discretization scheme from the parametric Kalman filter perspective
A method for predicting the uncompleted climate transition process
Statistical postprocessing of ensemble forecasts for severe weather at Deutscher Wetterdienst
An Early Warning Sign of Critical Transition in The Antarctic Ice Sheet – A New Data Driven Tool for Spatiotemporal Tipping Point
Data-driven predictions of a multiscale Lorenz 96 chaotic system using machine-learning methods: reservoir computing, artificial neural network, and long short-term memory network
From research to applications – examples of operational ensemble post-processing in France using machine learning
Correcting for model changes in statistical postprocessing – an approach based on response theory
Brief communication: Residence time of energy in the atmosphere
Simulating model uncertainty of subgrid-scale processes by sampling model errors at convective scales
Data-driven versus self-similar parameterizations for stochastic advection by Lie transport and location uncertainty
Seasonal statistical–dynamical prediction of the North Atlantic Oscillation by probabilistic post-processing and its evaluation
Application of a local attractor dimension to reduced space strongly coupled data assimilation for chaotic multiscale systems
Order of operation for multi-stage post-processing of ensemble wind forecast trajectories
Generalization properties of feed-forward neural networks trained on Lorenz systems
Revising the stochastic iterative ensemble smoother
Joint state-parameter estimation of a nonlinear stochastic energy balance model from sparse noisy data
Non-Gaussian statistics in global atmospheric dynamics: a study with a 10 240-member ensemble Kalman filter using an intermediate atmospheric general circulation model
Fluctuations of finite-time Lyapunov exponents in an intermediate-complexity atmospheric model: a multivariate and large-deviation perspective
Data assimilation using adaptive, non-conservative, moving mesh models
Data assimilation as a learning tool to infer ordinary differential equation representations of dynamical models
A Bayesian approach to multivariate adaptive localization in ensemble-based data assimilation with time-dependent extensions
Exploring the sensitivity of Northern Hemisphere atmospheric circulation to different surface temperature forcing using a statistical–dynamical atmospheric model
Review article: Comparison of local particle filters and new implementations
Data assimilation of radar reflectivity volumes in a LETKF scheme
Application of ensemble transform data assimilation methods for parameter estimation in reservoir modeling
Nonlinear effects in 4D-Var
A novel approach for solving CNOPs and its application in identifying sensitive regions of tropical cyclone adaptive observations
Chaotic dynamics and the role of covariance inflation for reduced rank Kalman filters with model error
Ensemble variational assimilation as a probabilistic estimator – Part 1: The linear and weak non-linear case
Ensemble variational assimilation as a probabilistic estimator – Part 2: The fully non-linear case
OSSE for a sustainable marine observing network in the Sea of Marmara
Parametric covariance dynamics for the nonlinear diffusive Burgers equation
Sensitivity analysis with respect to observations in variational data assimilation for parameter estimation
Exploring the Lyapunov instability properties of high-dimensional atmospheric and climate models
Feature-based data assimilation in geophysics
Quasi-static ensemble variational data assimilation: a theoretical and numerical study with the iterative ensemble Kalman smoother
Accelerating assimilation development for new observing systems using EFSO
Optimal transport for variational data assimilation
The Onsager–Machlup functional for data assimilation
Impact of an observational time window on coupled data assimilation: simulation with a simple climate model
Remote sensing of ocean surface currents: a review of what is being observed and what is being assimilated
Non-Gaussian data assimilation of satellite-based leaf area index observations with an individual-based dynamic global vegetation model
Data assimilation for moving mesh methods with an application to ice sheet modelling
Regularization destriping of remote sensing imagery
Controllability, not chaos, key criterion for ocean state estimation
An estimate of the inflation factor and analysis sensitivity in the ensemble Kalman filter
Formulation of scale transformation in a stochastic data assimilation framework
Yvonne Ruckstuhl, Tijana Janjić, and Stephan Rasp
Nonlin. Processes Geophys., 28, 111–119, https://doi.org/10.5194/npg-28-111-2021, https://doi.org/10.5194/npg-28-111-2021, 2021
Short summary
Short summary
The assimilation of observations using standard algorithms can lead to a violation of physical laws (e.g. mass conservation), which is shown to have a detrimental impact on the system's forecast. We use a neural network (NN) to correct this mass violation, using training data generated from expensive algorithms that can constrain such physical properties. We found that, in an idealized set-up, the NN can match the performance of these expensive algorithms at negligible computational costs.
Shin'ya Nakano
Nonlin. Processes Geophys., 28, 93–109, https://doi.org/10.5194/npg-28-93-2021, https://doi.org/10.5194/npg-28-93-2021, 2021
Short summary
Short summary
The ensemble-based variational method is a method for solving nonlinear data assimilation problems by using an ensemble of multiple simulation results. Although this method is derived based on a linear approximation, highly uncertain problems, in which system nonlinearity is significant, can also be solved by applying this method iteratively. This paper reformulated this iterative algorithm to analyze its behavior in high-dimensional nonlinear problems and discuss the convergence.
Sangeetika Ruchi, Svetlana Dubinkina, and Jana de Wiljes
Nonlin. Processes Geophys., 28, 23–41, https://doi.org/10.5194/npg-28-23-2021, https://doi.org/10.5194/npg-28-23-2021, 2021
Short summary
Short summary
To infer information of an unknown quantity that helps to understand an associated system better and to predict future outcomes, observations and a physical model that connects the data points to the unknown parameter are typically used as information sources. Yet this problem is often very challenging due to the fact that the unknown is generally high dimensional, the data are sparse and the model can be non-linear. We propose a novel approach to address these challenges.
Olivier Pannekoucke, Richard Ménard, Mohammad El Aabaribaoune, and Matthieu Plu
Nonlin. Processes Geophys., 28, 1–22, https://doi.org/10.5194/npg-28-1-2021, https://doi.org/10.5194/npg-28-1-2021, 2021
Short summary
Short summary
Numerical weather prediction involves numerically solving the mathematical equations, which describe the geophysical flow, by transforming them so that they can be computed. Through this transformation, it appears that the equations actually solved by the machine are then a modified version of the original equations, introducing an error that contributes to the model error. This work helps to characterize the covariance of the model error that is due to this modification of the equations.
Pengcheng Yan, Guolin Feng, Wei Hou, and Ping Yang
Nonlin. Processes Geophys., 27, 489–500, https://doi.org/10.5194/npg-27-489-2020, https://doi.org/10.5194/npg-27-489-2020, 2020
Short summary
Short summary
A system transiting from one stable state to another has to experience a period. Can we predict the end moment (state) if the process has not been completed? This paper presents a method to solve this problem. This method is based on the quantitative relationship among the parameters, which is used to describe the transition process of the abrupt change. By using the historical data, we extract some parameters for predicting the uncompleted climate transition process.
Reinhold Hess
Nonlin. Processes Geophys., 27, 473–487, https://doi.org/10.5194/npg-27-473-2020, https://doi.org/10.5194/npg-27-473-2020, 2020
Short summary
Short summary
Forecasts of ensemble systems are statistically aligned to synoptic observations at DWD in order to provide support for warning decision management. Motivation and design consequences for extreme and rare meteorological events are presented. Especially for probabilities of severe wind gusts global logistic parameterisations are developed that generate robust statistical forecasts for extreme events, while local characteristics are preserved.
Abd AlRahman AlMomani and Erik Bollt
Nonlin. Processes Geophys. Discuss., https://doi.org/10.5194/npg-2020-26, https://doi.org/10.5194/npg-2020-26, 2020
Revised manuscript accepted for NPG
Short summary
Short summary
In this paper, we introduce a new tool for data-driven discovery of early warning signs of critical transitions in ice shelves, from remote sensing data. Our approach adopts principles of directed spectral clustering methodology considering an asymmetric affinity matrix and the associated directed graph Laplacian. We applied our approach generally to reprocess the ice velocity data and remote sensing satellite images of the Larsen C ice shelf.
Ashesh Chattopadhyay, Pedram Hassanzadeh, and Devika Subramanian
Nonlin. Processes Geophys., 27, 373–389, https://doi.org/10.5194/npg-27-373-2020, https://doi.org/10.5194/npg-27-373-2020, 2020
Short summary
Short summary
The performance of three machine-learning methods for data-driven modeling of a multiscale chaotic Lorenz 96 system is examined. One of the methods is found to be able to predict the future evolution of the chaotic system well from just knowing the past observations of the large-scale component of the multiscale state vector. Potential applications to data-driven and data-assisted surrogate modeling of complex dynamical systems such as weather and climate are discussed.
Maxime Taillardat and Olivier Mestre
Nonlin. Processes Geophys., 27, 329–347, https://doi.org/10.5194/npg-27-329-2020, https://doi.org/10.5194/npg-27-329-2020, 2020
Short summary
Short summary
Statistical post-processing of ensemble forecasts is now a well-known procedure in order to correct biased and misdispersed ensemble weather predictions. But practical application in European national weather services is in its infancy. Different applications of ensemble post-processing using machine learning at an industrial scale are presented. Forecast quality and value are improved compared to the raw ensemble, but several facilities have to be made to adjust to operational constraints.
Jonathan Demaeyer and Stéphane Vannitsem
Nonlin. Processes Geophys., 27, 307–327, https://doi.org/10.5194/npg-27-307-2020, https://doi.org/10.5194/npg-27-307-2020, 2020
Short summary
Short summary
Postprocessing schemes used to correct weather forecasts are no longer efficient when the model generating the forecasts changes. An approach based on response theory to take the change into account without having to recompute the parameters based on past forecasts is presented. It is tested on an analytical model and a simple model of atmospheric variability. We show that this approach is effective and discuss its potential application for an operational environment.
Carlos Osácar, Manuel Membrado, and Amalio Fernández-Pacheco
Nonlin. Processes Geophys., 27, 235–237, https://doi.org/10.5194/npg-27-235-2020, https://doi.org/10.5194/npg-27-235-2020, 2020
Short summary
Short summary
We deduce that after a global thermal perturbation, the Earth's
atmosphere would need about a couple of months to come back to equilibrium.
Michiel Van Ginderachter, Daan Degrauwe, Stéphane Vannitsem, and Piet Termonia
Nonlin. Processes Geophys., 27, 187–207, https://doi.org/10.5194/npg-27-187-2020, https://doi.org/10.5194/npg-27-187-2020, 2020
Short summary
Short summary
A generic methodology is developed to estimate the model error and simulate the model uncertainty related to a specific physical process. The method estimates the model error by comparing two different representations of the physical process in otherwise identical models. The found model error can then be used to perturb the model and simulate the model uncertainty. When applying this methodology to deep convection an improvement in the probabilistic skill of the ensemble forecast is found.
Valentin Resseguier, Wei Pan, and Baylor Fox-Kemper
Nonlin. Processes Geophys., 27, 209–234, https://doi.org/10.5194/npg-27-209-2020, https://doi.org/10.5194/npg-27-209-2020, 2020
Short summary
Short summary
Geophysical flows span a broader range of temporal and spatial scales than can be resolved numerically. One way to alleviate the ensuing numerical errors is to combine simulations with measurements, taking account of the accuracies of these two sources of information. Here we quantify the distribution of numerical simulation errors without relying on high-resolution numerical simulations. Specifically, small-scale random vortices are added to simulations while conserving energy or circulation.
André Düsterhus
Nonlin. Processes Geophys., 27, 121–131, https://doi.org/10.5194/npg-27-121-2020, https://doi.org/10.5194/npg-27-121-2020, 2020
Short summary
Short summary
Seasonal prediction of the of the North Atlantic Oscillation (NAO) has been improved in recent years by improving dynamical models and ensemble predictions. One step therein was the so-called sub-sampling, which combines statistical and dynamical predictions. This study generalises this approach and makes it much more accessible. Furthermore, it presents a new verification approach for such predictions.
Courtney Quinn, Terence J. O'Kane, and Vassili Kitsios
Nonlin. Processes Geophys., 27, 51–74, https://doi.org/10.5194/npg-27-51-2020, https://doi.org/10.5194/npg-27-51-2020, 2020
Short summary
Short summary
This study presents a novel method for reduced-rank data assimilation of multiscale highly nonlinear systems. Time-varying dynamical properties are used to determine the rank and projection of the system onto a reduced subspace. The variable reduced-rank method is shown to succeed over other fixed-rank methods. This work provides implications for performing strongly coupled data assimilation with a limited number of ensemble members on high-dimensional coupled climate models.
Nina Schuhen
Nonlin. Processes Geophys., 27, 35–49, https://doi.org/10.5194/npg-27-35-2020, https://doi.org/10.5194/npg-27-35-2020, 2020
Short summary
Short summary
We present a new way to adaptively improve weather forecasts by incorporating last-minute observation information. The recently measured error, together with a statistical model, gives us an indication of the expected future error of wind speed forecasts, which are then adjusted accordingly. This new technique can be especially beneficial for customers in the wind energy industry, where it is important to have reliable short-term forecasts, as well as providers of extreme weather warnings.
Sebastian Scher and Gabriele Messori
Nonlin. Processes Geophys., 26, 381–399, https://doi.org/10.5194/npg-26-381-2019, https://doi.org/10.5194/npg-26-381-2019, 2019
Short summary
Short summary
Neural networks are a technique that is widely used to predict the time evolution of physical systems. For this the past evolution of the system is shown to the neural network – it is
trained– and then can be used to predict the evolution in the future. We show some limitations in this approach for certain systems that are important to consider when using neural networks for climate- and weather-related applications.
Patrick Nima Raanes, Andreas Størksen Stordal, and Geir Evensen
Nonlin. Processes Geophys., 26, 325–338, https://doi.org/10.5194/npg-26-325-2019, https://doi.org/10.5194/npg-26-325-2019, 2019
Short summary
Short summary
A popular variational ensemble smoother for data assimilation and history matching is simplified. An exact relationship between ensemble linearizations (linear regression) and adjoints (analytic derivatives) is established.
Fei Lu, Nils Weitzel, and Adam H. Monahan
Nonlin. Processes Geophys., 26, 227–250, https://doi.org/10.5194/npg-26-227-2019, https://doi.org/10.5194/npg-26-227-2019, 2019
Short summary
Short summary
ll-posedness of the inverse problem and sparse noisy data are two major challenges in the modeling of high-dimensional spatiotemporal processes. We present a Bayesian inference method with a strongly regularized posterior to overcome these challenges, enabling joint state-parameter estimation and quantifying uncertainty in the estimation. We demonstrate the method on a physically motivated nonlinear stochastic partial differential equation arising from paleoclimate construction.
Keiichi Kondo and Takemasa Miyoshi
Nonlin. Processes Geophys., 26, 211–225, https://doi.org/10.5194/npg-26-211-2019, https://doi.org/10.5194/npg-26-211-2019, 2019
Short summary
Short summary
This study investigates non-Gaussian statistics of the data from a 10240-member ensemble Kalman filter. The large ensemble size can resolve the detailed structures of the probability density functions (PDFs) and indicates that the non-Gaussian PDF is caused by multimodality and outliers. While the outliers appear randomly, large multimodality corresponds well with large analysis error, mainly in the tropical regions and storm track regions where highly nonlinear processes appear frequently.
Frank Kwasniok
Nonlin. Processes Geophys., 26, 195–209, https://doi.org/10.5194/npg-26-195-2019, https://doi.org/10.5194/npg-26-195-2019, 2019
Short summary
Short summary
The stability properties as characterized by finite-time Lyapunov exponents are investigated in an intermediate-complexity atmospheric model. Firstly, the dominant patterns of collective excitation are identified by an empirical orthogonal function analysis of the fluctuation field of all of the finite-time Lyapunov exponents. Secondly, a large-deviation principle is established for all of the Lyapunov exponents and the large-deviation rate functions are estimated.
Ali Aydoğdu, Alberto Carrassi, Colin T. Guider, Chris K. R. T Jones, and Pierre Rampal
Nonlin. Processes Geophys., 26, 175–193, https://doi.org/10.5194/npg-26-175-2019, https://doi.org/10.5194/npg-26-175-2019, 2019
Short summary
Short summary
Computational models involving adaptive meshes can both evolve dynamically and be remeshed. Remeshing means that the state vector dimension changes in time and across ensemble members, making the ensemble Kalman filter (EnKF) unsuitable for assimilation of observational data. We develop a modification in which analysis is performed on a fixed uniform grid onto which the ensemble is mapped, with resolution relating to the remeshing criteria. The approach is successfully tested on two 1-D models.
Marc Bocquet, Julien Brajard, Alberto Carrassi, and Laurent Bertino
Nonlin. Processes Geophys., 26, 143–162, https://doi.org/10.5194/npg-26-143-2019, https://doi.org/10.5194/npg-26-143-2019, 2019
Short summary
Short summary
This paper describes an innovative way to use data assimilation to infer the dynamics of a physical system from its observation only. The method can operate with noisy and partial observation of the physical system. It acts as a deep learning technique specialised to dynamical models without the need for machine learning tools. The method is successfully tested on chaotic dynamical systems: the Lorenz-63, Lorenz-96, and Kuramoto–Sivashinski models and a two-scale Lorenz model.
Andrey A. Popov and Adrian Sandu
Nonlin. Processes Geophys., 26, 109–122, https://doi.org/10.5194/npg-26-109-2019, https://doi.org/10.5194/npg-26-109-2019, 2019
Short summary
Short summary
This work has to do with a small part of existing algorithms that are used in applications such as predicting the weather. We provide empirical evidence that our new technique works well on small but representative models. This might lead to creation of a better weather forecast and potentially save lives as in the case of hurricane prediction.
Sonja Totz, Stefan Petri, Jascha Lehmann, Erik Peukert, and Dim Coumou
Nonlin. Processes Geophys., 26, 1–12, https://doi.org/10.5194/npg-26-1-2019, https://doi.org/10.5194/npg-26-1-2019, 2019
Alban Farchi and Marc Bocquet
Nonlin. Processes Geophys., 25, 765–807, https://doi.org/10.5194/npg-25-765-2018, https://doi.org/10.5194/npg-25-765-2018, 2018
Short summary
Short summary
Data assimilation looks for an optimal way to learn from observations of a dynamical system to improve the quality of its predictions. The goal is to filter out the noise (both observation and model noise) to retrieve the true signal. Among all possible methods, particle filters are promising; the method is fast and elegant, and it allows for a Bayesian analysis. In this review paper, we discuss implementation techniques for (local) particle filters in high-dimensional systems.
Thomas Gastaldo, Virginia Poli, Chiara Marsigli, Pier Paolo Alberoni, and Tiziana Paccagnella
Nonlin. Processes Geophys., 25, 747–764, https://doi.org/10.5194/npg-25-747-2018, https://doi.org/10.5194/npg-25-747-2018, 2018
Short summary
Short summary
Accuracy of numerical weather prediction forecasts is strongly related to the quality of initial conditions employed. To improve them, it seems advantageous to use radar reflectivity observations because of their high spatial and temporal resolution. This is tested in a high-resolution model whose domain covers Italy. Results show that the employment of reflectivity observations improves precipitation forecast accuracy, but the positive impact is lost after a few hours of forecast.
Sangeetika Ruchi and Svetlana Dubinkina
Nonlin. Processes Geophys., 25, 731–746, https://doi.org/10.5194/npg-25-731-2018, https://doi.org/10.5194/npg-25-731-2018, 2018
Short summary
Short summary
Accurate estimation of subsurface geological parameters is essential for the oil industry. This is done by combining observations with an estimation from a model. Ensemble Kalman filter is a widely used method for inverse modeling, while ensemble transform particle filtering is a recently developed method that has been applied to estimate only a small number of parameters and in fluids. We show that for a high-dimensional inverse problem it is superior to an ensemble Kalman filter.
Massimo Bonavita, Peter Lean, and Elias Holm
Nonlin. Processes Geophys., 25, 713–729, https://doi.org/10.5194/npg-25-713-2018, https://doi.org/10.5194/npg-25-713-2018, 2018
Short summary
Short summary
This paper deals with the effects of nonlinearity in a state-of-the-art atmospheric global data assimilation system. It is shown that these effects have become increasingly important over the years due to increased model resolution and use of nonlinear observations. The ability to deal with nonlinearities has thus become a crucial asset of data assimilation algorithms. At ECMWF this is done in a perturbative fashion. Advantages and limitations of this technique are discussed.
Linlin Zhang, Bin Mu, Shijin Yuan, and Feifan Zhou
Nonlin. Processes Geophys., 25, 693–712, https://doi.org/10.5194/npg-25-693-2018, https://doi.org/10.5194/npg-25-693-2018, 2018
Short summary
Short summary
We propose a novel approach to solve conditional nonlinear optimal perturbation for identifying sensitive areas for tropical cyclone adaptive observations. This method is free of adjoint models and overcomes two obstacles, not having adjoint models and having dimensions higher than the problem space. All experimental results prove that it is a meaningful and effective method for solving CNOP and provides a new way for such research. This work aims to solve CNOP and identify sensitive areas.
Colin Grudzien, Alberto Carrassi, and Marc Bocquet
Nonlin. Processes Geophys., 25, 633–648, https://doi.org/10.5194/npg-25-633-2018, https://doi.org/10.5194/npg-25-633-2018, 2018
Short summary
Short summary
Using the framework Lyapunov vectors, we analyze the asymptotic properties of ensemble based Kalman filters and how these are influenced by dynamical chaos, especially in the context of random model errors and small ensemble sizes. Particularly, we show a novel derivation of the evolution of forecast uncertainty for ensemble-based Kalman filters with weakly-nonlinear error growth, and discuss its impact for filter design in geophysical models.
Mohamed Jardak and Olivier Talagrand
Nonlin. Processes Geophys., 25, 565–587, https://doi.org/10.5194/npg-25-565-2018, https://doi.org/10.5194/npg-25-565-2018, 2018
Short summary
Short summary
Ensemble variational assimilation (EnsVAR) has been implemented on two small-dimension non-linear chaotic toy models, as well as on a linearized version of those models. In the linear case, EnsVAR is exactly Bayesian and produced
highly reliable ensembles. In the non-linear case, EnsVAR, implemented on temporal windows on the order of magnitude of the predictability time of the systems, shows as good performance as in the exactly linear case. EnsVar is as good an estimator as EnKF and PF.
Mohamed Jardak and Olivier Talagrand
Nonlin. Processes Geophys., 25, 589–604, https://doi.org/10.5194/npg-25-589-2018, https://doi.org/10.5194/npg-25-589-2018, 2018
Short summary
Short summary
EnsVAR is fundamentally successful in that, even in conditions where Bayesianity cannot be expected, it produces ensembles which possess a high degree of statistical reliability. In non-linear strong-constraint cases, EnsVAR has been successful here only through the use of quasi-static variational assimilation. In the weak-constraint case, without QSVA, EnsVAR provided new evidence as to the favourable effect.
Ali Aydoğdu, Timothy J. Hoar, Tomislava Vukicevic, Jeffrey L. Anderson, Nadia Pinardi, Alicia Karspeck, Jonathan Hendricks, Nancy Collins, Francesca Macchia, and Emin Özsoy
Nonlin. Processes Geophys., 25, 537–551, https://doi.org/10.5194/npg-25-537-2018, https://doi.org/10.5194/npg-25-537-2018, 2018
Short summary
Short summary
This study presents, to our knowledge, the first data assimilation experiments in the Sea of Marmara. We propose a FerryBox network for monitoring the state of the sea and show that assimilation of the temperature and salinity improves the forecasts in the basin. The flow of the Bosphorus helps to propagate the error reduction. The study can be taken as a step towards a marine forecasting system in the Sea of Marmara that will help to improve the forecasts in the adjacent Black and Aegean seas.
Olivier Pannekoucke, Marc Bocquet, and Richard Ménard
Nonlin. Processes Geophys., 25, 481–495, https://doi.org/10.5194/npg-25-481-2018, https://doi.org/10.5194/npg-25-481-2018, 2018
Short summary
Short summary
The forecast of weather prediction uncertainty is a real challenge and is crucial for risk management. However, uncertainty prediction is beyond the capacity of supercomputers, and improvements of the technology may not solve this issue. A new uncertainty prediction method is introduced which takes advantage of fluid equations to predict simple quantities which approximate real uncertainty but at a low numerical cost. A proof of concept is shown by an academic model derived from fluid dynamics.
Victor Shutyaev, Francois-Xavier Le Dimet, and Eugene Parmuzin
Nonlin. Processes Geophys., 25, 429–439, https://doi.org/10.5194/npg-25-429-2018, https://doi.org/10.5194/npg-25-429-2018, 2018
Short summary
Short summary
The problem of variational data assimilation for a nonlinear evolution model is formulated as an optimal control problem to find unknown parameters of the model. The observation data, and hence the optimal solution, may contain uncertainties. A response function is considered as a functional of the optimal solution after assimilation. The sensitivity of the response function to the observation data is studied. The results are relevant for monitoring and prediction of sea and ocean states.
Lesley De Cruz, Sebastian Schubert, Jonathan Demaeyer, Valerio Lucarini, and Stéphane Vannitsem
Nonlin. Processes Geophys., 25, 387–412, https://doi.org/10.5194/npg-25-387-2018, https://doi.org/10.5194/npg-25-387-2018, 2018
Short summary
Short summary
The predictability of weather models is limited largely by the initial state error growth or decay rates. We have computed these rates for PUMA, a global model for the atmosphere, and MAOOAM, a more simplified, coupled model which includes the ocean. MAOOAM has processes at distinct timescales, whereas PUMA surprisingly does not. We propose a new programme to compute the natural directions along the flow that correspond to the growth or decay rates, to learn which components play a role.
Matthias Morzfeld, Jesse Adams, Spencer Lunderman, and Rafael Orozco
Nonlin. Processes Geophys., 25, 355–374, https://doi.org/10.5194/npg-25-355-2018, https://doi.org/10.5194/npg-25-355-2018, 2018
Short summary
Short summary
Many applications in science require that computational models and data be combined. In a Bayesian framework, this is usually done by defining likelihoods based on the mismatch of model outputs and data. However, matching model outputs and data in this way can be unnecessary or impossible. This issue can be addressed by selecting features of the data, and defining likelihoods based on the features, rather than by the usual mismatch of model output and data.
Anthony Fillion, Marc Bocquet, and Serge Gratton
Nonlin. Processes Geophys., 25, 315–334, https://doi.org/10.5194/npg-25-315-2018, https://doi.org/10.5194/npg-25-315-2018, 2018
Short summary
Short summary
This study generalizes a paper by Pires et al. (1996) to state-of-the-art data assimilation techniques, such as the iterative ensemble Kalman smoother (IEnKS). We show that the longer the time window over which observations are assimilated, the better the accuracy of the IEnKS. Beyond a critical time length that we estimate, we show that this accuracy finally degrades. We show that the use of the quasi-static minimizations but generalized to the IEnKS yields a significantly improved accuracy.
Guo-Yuan Lien, Daisuke Hotta, Eugenia Kalnay, Takemasa Miyoshi, and Tse-Chun Chen
Nonlin. Processes Geophys., 25, 129–143, https://doi.org/10.5194/npg-25-129-2018, https://doi.org/10.5194/npg-25-129-2018, 2018
Short summary
Short summary
The ensemble forecast sensitivity to observation (EFSO) method can efficiently clarify under what conditions observations are beneficial or detrimental for assimilation. Based on EFSO, an offline assimilation method is proposed to accelerate the development of data selection strategies for new observing systems. The usefulness of this method is demonstrated with the assimilation of global satellite precipitation data.
Nelson Feyeux, Arthur Vidard, and Maëlle Nodet
Nonlin. Processes Geophys., 25, 55–66, https://doi.org/10.5194/npg-25-55-2018, https://doi.org/10.5194/npg-25-55-2018, 2018
Short summary
Short summary
In geophysics, numerical models are generally initialized through so-called data assimilation methods. They require computation of a distance between model fields and physical observations. The most common choice is the Euclidian distance. However, due to its local nature it is not well suited for capturing position errors. This papers investigates theoretical aspects of the use of the optimal transport-based Wasserstein distance in this context and shows that it is able to capture such errors.
Nozomi Sugiura
Nonlin. Processes Geophys., 24, 701–712, https://doi.org/10.5194/npg-24-701-2017, https://doi.org/10.5194/npg-24-701-2017, 2017
Short summary
Short summary
The optimisation of simulation paths is sometimes misleading. We can find a path with the highest probability by the method of least squares. However, it is not necessarily the route where the paths are most concentrated. This paper clarifies how we can find the mode of a distribution of paths by optimisation.
Yuxin Zhao, Xiong Deng, Shaoqing Zhang, Zhengyu Liu, Chang Liu, Gabriel Vecchi, Guijun Han, and Xinrong Wu
Nonlin. Processes Geophys., 24, 681–694, https://doi.org/10.5194/npg-24-681-2017, https://doi.org/10.5194/npg-24-681-2017, 2017
Short summary
Short summary
Here with a simple coupled model that simulates typical scale interactions in the climate system, we study the optimal OTWs for the coupled media so that climate signals can be most accurately recovered by CDA. Results show that an optimal OTW determined from the de-correlation timescale provides maximal observational information that best fits the characteristic variability of the coupled medium during the data blending process.
Jordi Isern-Fontanet, Joaquim Ballabrera-Poy, Antonio Turiel, and Emilio García-Ladona
Nonlin. Processes Geophys., 24, 613–643, https://doi.org/10.5194/npg-24-613-2017, https://doi.org/10.5194/npg-24-613-2017, 2017
Short summary
Short summary
Ocean currents play a key role in Earth’s climate – they are of major importance for navigation and human activities at sea and impact almost all processes that take place in the ocean. Nevertheless, their observation and forecasting are still difficult. Here, we review the main techniques used to derive surface currents from satellite measurements and the existing approaches to assimilate this information into ocean models.
Hazuki Arakida, Takemasa Miyoshi, Takeshi Ise, Shin-ichiro Shima, and Shunji Kotsuki
Nonlin. Processes Geophys., 24, 553–567, https://doi.org/10.5194/npg-24-553-2017, https://doi.org/10.5194/npg-24-553-2017, 2017
Short summary
Short summary
This is the first study assimilating the satellite-based leaf area index observations every 4 days into a numerical model simulating the growth and death of individual plants. The newly developed data assimilation system successfully reduced the uncertainties of the model parameters related to phenology and carbon dynamics. It also provides better estimates of the present vegetation structure which can be used as the initial states for the simulation of the future vegetation change.
Bertrand Bonan, Nancy K. Nichols, Michael J. Baines, and Dale Partridge
Nonlin. Processes Geophys., 24, 515–534, https://doi.org/10.5194/npg-24-515-2017, https://doi.org/10.5194/npg-24-515-2017, 2017
Short summary
Short summary
We develop data assimilation techniques for numerical models using moving mesh methods. Moving meshes are valuable for explicitly tracking interfaces and boundaries in evolving systems. The application of the techniques is demonstrated on a one-dimensional
model of an ice sheet. It is shown, using various types of observations, that
the techniques predict the evolution of the edges of the ice sheet and its height accurately and efficiently.
Ranil Basnayake, Erik Bollt, Nicholas Tufillaro, Jie Sun, and Michelle Gierach
Nonlin. Processes Geophys., 24, 367–378, https://doi.org/10.5194/npg-24-367-2017, https://doi.org/10.5194/npg-24-367-2017, 2017
Geoffrey Gebbie and Tsung-Lin Hsieh
Nonlin. Processes Geophys., 24, 351–366, https://doi.org/10.5194/npg-24-351-2017, https://doi.org/10.5194/npg-24-351-2017, 2017
Short summary
Short summary
The best reconstructions of the past ocean state involve the statistical combination of numerical models and observations; however, the computationally efficient method that produces physically interpretable fields is thought to not be applicable to chaotic dynamical systems, such as ocean models with eddies. Here we use a model of the chaotic, forced pendulum to show that the most popular existing method is successful so long as there are enough uncertain boundary conditions through time.
Guocan Wu and Xiaogu Zheng
Nonlin. Processes Geophys., 24, 329–341, https://doi.org/10.5194/npg-24-329-2017, https://doi.org/10.5194/npg-24-329-2017, 2017
Short summary
Short summary
The accuracy of the assimilation results crucially relies on the estimate accuracy of forecast error covariance matrix in data assimilation. Ensemble Kalman filter estimates the forecast error covariance matrix as the sampling covariance matrix of the ensemble forecast states, which need to be further inflated. The experiment results on the Lorenz-96 model show that the analysis error is reduced and the analysis sensitivity to observations is improved using the proposed inflation technique.
Feng Liu and Xin Li
Nonlin. Processes Geophys., 24, 279–291, https://doi.org/10.5194/npg-24-279-2017, https://doi.org/10.5194/npg-24-279-2017, 2017
Short summary
Short summary
This is the first mathematical definitions of the spatial scale and its transformation based on Lebesgue measure. An Ito process-formed geophysical variable with respect to scale was also provided. The stochastic calculus for data assimilation discovered the new expressions of error caused by spatial scale transformation. The results improve the ability to understand the spatial scale transformation and related uncertainties in Earth observation, modelling and data assimilation.
Cited articles
Anderson, J. L.: An adaptive covariance inflation error correction algorithm for ensemble filters, Tellus A, 59, 210–224, 2007.
Anderson, J. L. and Anderson, S. L.: A Monte Carlo Implementation of the Nonlinear Filtering Problem to Produce Ensemble Assimilations and Forecasts, Mon. Weather Rev., 127, 2741–2758, 1999.
Bishop, C. H., Etherton, B. J., and Majumdar, S. J.: Adaptive Sampling with the Ensemble Transform Kalman Filter. Part I: Theoretical Aspects, Mon. Weather Rev., 129, 420–436, 2001.
Bishop, C. M. (Ed.): Pattern Recognition and Machine Learning, Springer-Verlag New-York Inc, 2006.
Bocquet, M.: Ensemble Kalman filtering without the intrinsic need for inflation, Nonlin. Processes Geophys., 18, 735–750, https://doi.org/10.5194/npg-18-735-2011, 2011.
Bocquet, M. and Sakov, P.: Combining inflation-free and iterative ensemble Kalman filters for strongly nonlinear systems, Nonlin. Processes Geophys., 19, 383–399, https://doi.org/10.5194/npg-19-383-2012, 2012.
Bocquet, M. and Sakov, P.: Joint state and parameter estimation with an iterative ensemble Kalman smoother, Nonlin. Processes Geophys., 20, 803–818, https://doi.org/10.5194/npg-20-803-2013, 2013.
Bocquet, M. and Sakov, P.: An iterative ensemble Kalman smoother, Q. J. Roy. Meteor. Soc., 140, 1521–1535, 2014.
Brankart, J.-M., Cosme, E., Testut, C.-E., Brasseur, P., and Verron, J.: Efficient adaptive error parameterization for square root or ensemble Kalman filters: application to the control of ocean mesoscale signals, Mon. Weather Rev., 138, 932–950, 2010.
Buehner, M.: Ensemble-derived stationary and flow-dependent background-error covariances: Evaluation in a quasi-operational NWP setting, Q. J. Roy. Meteor. Soc., 131, 1013–1043, 2005.
Evensen, G.: Data Assimilation: The Ensemble Kalman Filter, 2nd Edn., Springer-Verlag Berlin Heildelberg, 2009.
Fletcher, S. J. and Zupanski, M.: A data assimilation method for log-normally distributed observational errors, Q. J. Roy. Meteor. Soc., 132, 2505–2519, 2006.
Furrer, R. and Bengtsson, T.: Estimation of high-dimensional prior and posterior covariance matrices in Kalman filter variants, J. Multivariate Anal., 98, 227–255, 2007.
Gelman, A., Carlin, J. B., Stern, H. S., Dunson, D. B., Vehtari, A., and Rubin, D. B.: Bayesian data analysis, 3rd Edn., Taylor & Francis, Boca Raton, 2014.
Gurumoorthy, K. S., Grudzien, C., Apte, A., Carrassi, A., and Jones, C. K. R. T.: Rank deficiency of Kalman error covariance matrices in linear perfect model, preprint, arXiv:1503.05029, 2015.
Hamill, T. M. and Snyder, C.: A Hybrid Ensemble Kalman Filter–3D Variational Analysis Scheme, Mon. Weather Rev., 128, 2905–2919, 2000.
Hamill, T. M., Whitaker, J. S., and Snyder, C.: Distance-dependent filtering of background error covariance estimates in an ensemble Kalman filter, Mon. Weather Rev., 129, 2776–2790, 2001.
Hannart, A. and Naveau, P.: Estimating high dimensional covariance matrices: A new look at the Gaussian conjugate framework, J. Multivariate Anal., 131, 149–162, 2014.
Houtekamer, P. L. and Mitchell, H. L.: A sequential ensemble Kalman filter for atmospheric data assimilation, Mon. Weather Rev., 129, 123–137, 2001.
Hunt, B. R., Kostelich, E. J., and Szunyogh, I.: Efficient data assimilation for spatiotemporal chaos: A local ensemble transform Kalman filter, Physica D, 230, 112–126, 2007.
Kuramato, Y. and Tsuzuki, T.: On the formation of dissipative structures in reaction-diffusion systems: Reductive Perturbation Approach, Progress of Theoretical Physics, 54, 687–699, 1975.
Li, H., Kalnay, E., and Miyoshi, T.: Simultaneous estimation of covariance inflation and observation errors within an ensemble Kalman filter, Q. J. Roy. Meteor. Soc., 135, 523–533, 2009.
Liang, X., Zheng, X., Zhang, S., Wu, G., Dai, Y., and Li, Y.: Maximum likelihood estimation of inflation factors on error covariance matrices for ensemble Kalman filter assimilation, Q. J. Roy. Meteor. Soc., 138, 263–273, 2012.
Lorenc, A. C.: The potential of the ensemble Kalman filter for NWP – a comparison with 4D-Var, Q. J. Roy. Meteor. Soc., 118, 3183–3203, 2003.
Lorenz, E. N.: Deterministic nonperiodic flow, J. Atmos. Sci., 20, 130–141, 1963.
Lorenz, E. N.: Designing Chaotic Models, J. Atmos. Sci., 62, 1574–1587, 2005.
Lorenz, E. N. and Emanuel, K. E.: Optimal sites for supplementary weather observations: simulation with a small model, J. Atmos. Sci., 55, 399–414, 1998.
Miyoshi, T.: The Gaussian Approach to Adaptive Covariance inflation and Its Implementation with the Local Ensemble Transform Kalman Filter, Mon. Weather Rev., 139, 1519–1535, 2011.
Myrseth, I. and Omre, H.: Hierarchical Ensemble Kalman Filter, SPE J., 15, 569–580, 2010.
Ng, G.-H. C., McLaughlin, D., Entekhabi, D., and Ahanin, A.: The role of model dynamics in ensemble Kalman filter performance for chaotic systems, Tellus A, 63, 958–977, 2011.
Ott, E., Hunt, B. R., Szunyogh, I., Zimin, A. V., Kostelich, E. J., Corazza, M., Kalnay, E., Patil, D. J., and Yorke, A.: A local ensemble Kalman filter for atmospheric data assimilation, Tellus A, 56, 415–428, 2004.
Palatella, L. and Trevisan, A.: Interaction of Lyapunov vectors in the formulation of the nonlinear extension of the Kalman fiter, Phys. Rev. E, 91, 042905, https://doi.org/10.1103/PhysRevE.91.042905, 2015.
Pham, D. T., Verron, J., and Roubaud, M.: A Singular Evolutive Extended Kalman Filter for Data Assimilation in Oceanography, J. Marine Syst., 16, 323–340, 1998.
Raanes, P. N., Carrassi, A., and Bertino, L.: Extending the square root method to account for additive forecast noise in ensemble methods, Mon. Weather Rev., 143, 3857–38730, 2015.
Sacher, W. and Bartello, P.: Sampling Errors in Ensemble Kalman Filtering. Part I: Theory, Mon. Weather Rev., 136, 3035–3049, 2008.
Sakov, P. and Bertino, L.: Relation between two common localisation methods for the EnKF, Comput. Geosci., 15, 225–237, 2011.
Sakov, P. and Oke, P. R.: Implications of the Form of the Ensemble Transformation in the Ensemble Square Root Filters, Mon. Weather Rev., 136, 1042–1053, 2008.
Sivashinsky, G. I.: Nonlinear analysis of hydrodynamic instability in laminar flames – I. Derivation of basic equations, Acta Astronaut., 4, 1177–1206, 1977.
van Leeuwen, P. J.: Comment on Data Assimilation Using an Ensemble Kalman Filter Technique, Mon. Weather Rev., 127, 1374–1377, 1999.
Wang, X. and Bishop, C. H.: A Comparison of Breeding and Ensemble Transform Kalman Filter Ensemble Forecast Schemes, J. Atmos. Sci., 60, 1140–1158, 2003.
Wang, X., Hamill, T. M., and Bishop, C. H.: A comparison of Hybrid Ensemble Transform Kalman-Optimum Interpolation and Ensemble Square Root Filter Analysis Schemes, Mon. Weather. Rev., 135, 1055–1076, 2007a.
Wang, X., Snyder, C., and Hamill, T. M.: On the Theoretical Equivalence of Differently Proposed Ensemble-3DVAR Hybrid Analysis Schemes, Mon. Weather Rev., 135, 222–227, 2007b.
Whitaker, J. S. and Hamill, T. M.: Evaluating Methods to Account for System Errors in Ensemble Data Assimilation, Mon. Weather. Rev., 140, 3078–3089, 2012.
Ying, M. and Zhang, F.: An adaptive covariance relaxation method for ensemble data assimilation, Q. J. Roy. Meteor. Soc., https://doi.org/10.1002/qj.2576, online first, 2015.
Zheng, X. G.: An adaptive estimation of forecast error covariance parameters for Kalman filtering data assimilation, Adv. Atmos. Sci., 26, 154–160, 2009.
Zinn-Justin, J.: Quantum Field Theory and Critical Phenomena, International Series of Monographs on Physics, Clarendon Press, Oxford, 2002.
Zupanski, M.: Maximum Likelihood Ensemble Filter: Theoretical Aspects, Mon. Weather Rev., 133, 1710–1726, 2005.
Short summary
The popular data assimilation technique known as the ensemble Kalman filter (EnKF) suffers from sampling errors due to the limited size of the ensemble. This deficiency is usually cured by inflating the sampled error covariances and by using localization. This paper further develops and discusses the finite-size EnKF, or EnKF-N, a variant of the EnKF that does not require inflation. It expands the use of the EnKF-N to a wider range of dynamical regimes.
The popular data assimilation technique known as the ensemble Kalman filter (EnKF) suffers from...
