Articles | Volume 30, issue 4
https://doi.org/10.5194/npg-30-457-2023
© Author(s) 2023. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/npg-30-457-2023
© Author(s) 2023. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Research article
| 
23 Oct 2023
Research article |
| 23 Oct 2023
| 23 Oct 2023
Comparative study of strongly and weakly coupled data assimilation with a global land–atmosphere coupled model
Kenta Kurosawa
CORRESPONDING AUTHOR
Data Assimilation Research Team, RIKEN Center for Computational Science, Kobe, Japan
Department of Atmospheric and Oceanic Science, University of Maryland, College Park, Maryland, USA
Shunji Kotsuki
CORRESPONDING AUTHOR
Data Assimilation Research Team, RIKEN Center for Computational Science, Kobe, Japan
Center for Center for Environmental Remote Sensing, Chiba University, Chiba, Japan
PRESTO, Japan Science and Technology Agency, Chiba, Japan
RIKEN Interdisciplinary Theoretical and Mathematical Sciences Program, Kobe, Japan
Prediction Science Laboratory, RIKEN Cluster for Pioneering Research, Kobe, Japan
Takemasa Miyoshi
Data Assimilation Research Team, RIKEN Center for Computational Science, Kobe, Japan
Department of Atmospheric and Oceanic Science, University of Maryland, College Park, Maryland, USA
RIKEN Interdisciplinary Theoretical and Mathematical Sciences Program, Kobe, Japan
Prediction Science Laboratory, RIKEN Cluster for Pioneering Research, Kobe, Japan
Japan Agency for Marine-Earth Science and Technology, Yokohama, Japan
Related authors
No articles found.
Yuka Muto and Shunji Kotsuki
Hydrol. Earth Syst. Sci., 28, 5401–5417, https://doi.org/10.5194/hess-28-5401-2024, https://doi.org/10.5194/hess-28-5401-2024, 2024
Short summary
Short summary
It is crucial to improve global precipitation estimates to understand water-related disasters and water resources. This study proposes a new methodology to interpolate global precipitation fields from ground rain gauge observations using ensemble data assimilation and the precipitation of a numerical weather prediction model. Our estimates agree better with independent rain gauge observations than existing precipitation estimates, especially in mountainous or rain-gauge-sparse regions.
Rikuto Nagai, Yang Bai, Masaki Ogura, Shunji Kotsuki, and Naoki Wakamiya
Nonlin. Processes Geophys. Discuss., https://doi.org/10.5194/npg-2024-26, https://doi.org/10.5194/npg-2024-26, 2024
Preprint under review for NPG
Short summary
Short summary
Controlling chaotic systems is a key step toward weather control. The Control Simulation Experiment (CSE) modifies weather systems using small perturbations, as shown in studies with the Lorenz-63 model. However, the effectiveness of CSE compared to other methods is unclear. This study evaluates CSE against Model Predictive Control (MPC). Simulations reveal that MPC achieves higher success rates with less effort under certain conditions, linking control theory and atmospheric science.
Shunji Kotsuki, Kenta Shiraishi, and Atsushi Okazaki
EGUsphere, https://doi.org/10.48550/arXiv.2407.17781, https://doi.org/10.48550/arXiv.2407.17781, 2024
Short summary
Short summary
Artificial intelligence (AI) is playing a bigger role in weather forecasting, often competing with physical models. However, combining AI models with data assimilation, a process that improves weather forecasts by incorporating observation data, is still relatively unexplored. This study explored coupling ensemble data assimilation with an AI weather prediction model ClimaX, succeeded in employing weather forecasts stably by applying techniques conventionally used for physical models.
Fumitoshi Kawasaki and Shunji Kotsuki
Nonlin. Processes Geophys., 31, 319–333, https://doi.org/10.5194/npg-31-319-2024, https://doi.org/10.5194/npg-31-319-2024, 2024
Short summary
Short summary
Recently, scientists have been looking into ways to control the weather to lead to a desirable direction for mitigating weather-induced disasters caused by torrential rainfall and typhoons. This study proposes using the model predictive control (MPC), an advanced control method, to control a chaotic system. Through numerical experiments using a low-dimensional chaotic system, we demonstrate that the system can be successfully controlled with shorter forecasts compared to previous studies.
Toshiyuki Ohtsuka, Atsushi Okazaki, Masaki Ogura, and Shunji Kotsuki
EGUsphere, https://doi.org/10.48550/arXiv.2405.19546, https://doi.org/10.48550/arXiv.2405.19546, 2024
Preprint withdrawn
Short summary
Short summary
We utilize weather forecasts in the reverse direction and determine how much we should change the temperature or humidity of the atmosphere at a certain time to change the future rainfall as desired. Even though a weather phenomenon is complicated, we can superimpose the effects of small changes in the atmosphere and find suitable small changes to realize desirable rainfall by solving an optimization problem. We examine this idea on a realistic weather simulator and show it is promising.
Shunji Kotsuki, Fumitoshi Kawasaki, and Masanao Ohashi
Nonlin. Processes Geophys., 31, 237–245, https://doi.org/10.5194/npg-31-237-2024, https://doi.org/10.5194/npg-31-237-2024, 2024
Short summary
Short summary
In Earth science, data assimilation plays an important role in integrating real-world observations with numerical simulations for improving subsequent predictions. To overcome the time-consuming computations of conventional data assimilation methods, this paper proposes using quantum annealing machines. Using the D-Wave quantum annealer, the proposed method found solutions with comparable accuracy to conventional approaches and significantly reduced computational time.
Mao Ouyang, Keita Tokuda, and Shunji Kotsuki
Nonlin. Processes Geophys., 30, 183–193, https://doi.org/10.5194/npg-30-183-2023, https://doi.org/10.5194/npg-30-183-2023, 2023
Short summary
Short summary
This research found that weather control would change the chaotic behavior of an atmospheric model. We proposed to introduce chaos theory in the weather control. Experimental results demonstrated that the proposed approach reduced the manipulations, including the control times and magnitudes, which throw light on the weather control in a real atmospheric model.
Qiwen Sun, Takemasa Miyoshi, and Serge Richard
Nonlin. Processes Geophys., 30, 117–128, https://doi.org/10.5194/npg-30-117-2023, https://doi.org/10.5194/npg-30-117-2023, 2023
Short summary
Short summary
This paper is a follow-up of a work by Miyoshi and Sun which was published in NPG Letters in 2022. The control simulation experiment is applied to the Lorenz-96 model for avoiding extreme events. The results show that extreme events of this partially and imperfectly observed chaotic system can be avoided by applying pre-designed small perturbations. These investigations may be extended to more realistic numerical weather prediction models.
Tobias Necker, David Hinger, Philipp Johannes Griewank, Takemasa Miyoshi, and Martin Weissmann
Nonlin. Processes Geophys., 30, 13–29, https://doi.org/10.5194/npg-30-13-2023, https://doi.org/10.5194/npg-30-13-2023, 2023
Short summary
Short summary
This study investigates vertical localization based on a convection-permitting 1000-member ensemble simulation. We derive an empirical optimal localization (EOL) that minimizes sampling error in 40-member sub-sample correlations assuming 1000-member correlations as truth. The results will provide guidance for localization in convective-scale ensemble data assimilation systems.
Shun Ohishi, Takemasa Miyoshi, and Misako Kachi
Geosci. Model Dev., 15, 9057–9073, https://doi.org/10.5194/gmd-15-9057-2022, https://doi.org/10.5194/gmd-15-9057-2022, 2022
Short summary
Short summary
An adaptive observation error inflation (AOEI) method was proposed for atmospheric data assimilation to mitigate erroneous analysis updates caused by large observation-minus-forecast differences for satellite brightness temperature around clear- and cloudy-sky boundaries. This study implemented the AOEI with an ocean data assimilation system, leading to an improvement of analysis accuracy and dynamical balance around the frontal regions with large meridional temperature differences.
Shun Ohishi, Tsutomu Hihara, Hidenori Aiki, Joji Ishizaka, Yasumasa Miyazawa, Misako Kachi, and Takemasa Miyoshi
Geosci. Model Dev., 15, 8395–8410, https://doi.org/10.5194/gmd-15-8395-2022, https://doi.org/10.5194/gmd-15-8395-2022, 2022
Short summary
Short summary
We develop an ensemble-Kalman-filter-based regional ocean data assimilation system in which satellite and in situ observations are assimilated at a daily frequency. We find the best setting for dynamical balance and accuracy based on sensitivity experiments focused on how to inflate the ensemble spread and how to apply the analysis update to the model evolution. This study has a broader impact on more general data assimilation systems in which the initial shocks are a significant issue.
Shunji Kotsuki, Takemasa Miyoshi, Keiichi Kondo, and Roland Potthast
Geosci. Model Dev., 15, 8325–8348, https://doi.org/10.5194/gmd-15-8325-2022, https://doi.org/10.5194/gmd-15-8325-2022, 2022
Short summary
Short summary
Data assimilation plays an important part in numerical weather prediction (NWP) in terms of combining forecasted states and observations. While data assimilation methods in NWP usually assume the Gaussian error distribution, some variables in the atmosphere, such as precipitation, are known to have non-Gaussian error statistics. This study extended a widely used ensemble data assimilation algorithm to enable the assimilation of more non-Gaussian observations.
Takemasa Miyoshi and Qiwen Sun
Nonlin. Processes Geophys., 29, 133–139, https://doi.org/10.5194/npg-29-133-2022, https://doi.org/10.5194/npg-29-133-2022, 2022
Short summary
Short summary
The weather is chaotic and hard to predict, but the chaos implies an effective control where a small control signal grows rapidly to make a big difference. This study proposes a control simulation experiment where we apply a small signal to control
naturein a computational simulation. Idealized experiments with a low-order chaotic system show successful results by small control signals of only 3 % of the observation error. This is the first step toward realistic weather simulations.
Juan Ruiz, Guo-Yuan Lien, Keiichi Kondo, Shigenori Otsuka, and Takemasa Miyoshi
Nonlin. Processes Geophys., 28, 615–626, https://doi.org/10.5194/npg-28-615-2021, https://doi.org/10.5194/npg-28-615-2021, 2021
Short summary
Short summary
Effective use of observations with numerical weather prediction models, also known as data assimilation, is a key part of weather forecasting systems. For precise prediction at the scales of thunderstorms, fast nonlinear processes pose a grand challenge because most data assimilation systems are based on linear processes and normal distribution errors. We investigate how, every 30 s, weather radar observations can help reduce the effect of nonlinear processes and nonnormal distributions.
Keiichi Kondo and Takemasa Miyoshi
Nonlin. Processes Geophys., 26, 211–225, https://doi.org/10.5194/npg-26-211-2019, https://doi.org/10.5194/npg-26-211-2019, 2019
Short summary
Short summary
This study investigates non-Gaussian statistics of the data from a 10240-member ensemble Kalman filter. The large ensemble size can resolve the detailed structures of the probability density functions (PDFs) and indicates that the non-Gaussian PDF is caused by multimodality and outliers. While the outliers appear randomly, large multimodality corresponds well with large analysis error, mainly in the tropical regions and storm track regions where highly nonlinear processes appear frequently.
Atsushi Okazaki, Takumi Honda, Shunji Kotsuki, Moeka Yamaji, Takuji Kubota, Riko Oki, Toshio Iguchi, and Takemasa Miyoshi
Atmos. Meas. Tech., 12, 3985–3996, https://doi.org/10.5194/amt-12-3985-2019, https://doi.org/10.5194/amt-12-3985-2019, 2019
Short summary
Short summary
The JAXA is surveying the feasibility of a potential satellite mission equipped with a precipitation radar on a geostationary orbit, as a successor of the GPM Core Observatory. We investigate what kind of observation data will be available from the radar using simulation techniques. Although the quality of the observation depends on the radar specifications and the position of precipitation systems, the results demonstrate that it would be possible to obtain three-dimensional precipitation data.
Guo-Yuan Lien, Daisuke Hotta, Eugenia Kalnay, Takemasa Miyoshi, and Tse-Chun Chen
Nonlin. Processes Geophys., 25, 129–143, https://doi.org/10.5194/npg-25-129-2018, https://doi.org/10.5194/npg-25-129-2018, 2018
Short summary
Short summary
The ensemble forecast sensitivity to observation (EFSO) method can efficiently clarify under what conditions observations are beneficial or detrimental for assimilation. Based on EFSO, an offline assimilation method is proposed to accelerate the development of data selection strategies for new observing systems. The usefulness of this method is demonstrated with the assimilation of global satellite precipitation data.
Hazuki Arakida, Takemasa Miyoshi, Takeshi Ise, Shin-ichiro Shima, and Shunji Kotsuki
Nonlin. Processes Geophys., 24, 553–567, https://doi.org/10.5194/npg-24-553-2017, https://doi.org/10.5194/npg-24-553-2017, 2017
Short summary
Short summary
This is the first study assimilating the satellite-based leaf area index observations every 4 days into a numerical model simulating the growth and death of individual plants. The newly developed data assimilation system successfully reduced the uncertainties of the model parameters related to phenology and carbon dynamics. It also provides better estimates of the present vegetation structure which can be used as the initial states for the simulation of the future vegetation change.
Stephen G. Penny and Takemasa Miyoshi
Nonlin. Processes Geophys., 23, 391–405, https://doi.org/10.5194/npg-23-391-2016, https://doi.org/10.5194/npg-23-391-2016, 2016
Short summary
Short summary
Particle filters in their basic form have been shown to be unusable for large geophysical systems because the number of required particles grows exponentially with the size of the system. We have applied the ideas of localized analyses at each model grid point and use ensemble weight smoothing to blend each local analysis with its neighbors. This new local particle filter (LPF) makes large geophysical applications tractable for particle filters and is competitive with a popular EnKF alternative.
Hisashi Yashiro, Koji Terasaki, Takemasa Miyoshi, and Hirofumi Tomita
Geosci. Model Dev., 9, 2293–2300, https://doi.org/10.5194/gmd-9-2293-2016, https://doi.org/10.5194/gmd-9-2293-2016, 2016
Short summary
Short summary
We propose the design and implementation of an ensemble data assimilation framework for weather prediction at a high resolution and with a large ensemble size. We consider the deployment of this framework on the data throughput of file I/O and multi-node communication. With regard to high-performance computing systems, where data throughput performance increases at a slower rate than computational performance, our new framework promises drastic reduction of total execution time.
X. Han, X. Li, G. He, P. Kumbhar, C. Montzka, S. Kollet, T. Miyoshi, R. Rosolem, Y. Zhang, H. Vereecken, and H.-J. H. Franssen
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmdd-8-7395-2015, https://doi.org/10.5194/gmdd-8-7395-2015, 2015
Revised manuscript not accepted
Short summary
Short summary
DasPy is a ready to use open source parallel multivariate land data assimilation framework with joint state and parameter estimation using Local Ensemble Transform Kalman Filter. The Community Land Model (4.5) was integrated as model operator. The Community Microwave Emission Modelling platform, COsmic-ray Soil Moisture Interaction Code and the Two-Source Formulation were integrated as observation operators for the multivariate assimilation of soil moisture and soil temperature, respectively.
S. G. Penny, E. Kalnay, J. A. Carton, B. R. Hunt, K. Ide, T. Miyoshi, and G. A. Chepurin
Nonlin. Processes Geophys., 20, 1031–1046, https://doi.org/10.5194/npg-20-1031-2013, https://doi.org/10.5194/npg-20-1031-2013, 2013
Related subject area
Subject: Predictability, probabilistic forecasts, data assimilation, inverse problems | Topic: Climate, atmosphere, ocean, hydrology, cryosphere, biosphere | Techniques: Simulation
A comparison of two nonlinear data assimilation methods
Leading the Lorenz 63 system toward the prescribed regime by model predictive control coupled with data assimilation
Quantum data assimilation: a new approach to solving data assimilation on quantum annealers
Reducing manipulations in a control simulation experiment based on instability vectors with the Lorenz-63 model
Control simulation experiments of extreme events with the Lorenz-96 model
A range of outcomes: the combined effects of internal variability and anthropogenic forcing on regional climate trends over Europe
Using a hybrid optimal interpolation–ensemble Kalman filter for the Canadian Precipitation Analysis
Control simulation experiment with Lorenz's butterfly attractor
Reduced non-Gaussianity by 30 s rapid update in convective-scale numerical weather prediction
A study of capturing Atlantic meridional overturning circulation (AMOC) regime transition through observation-constrained model parameters
Fast hybrid tempered ensemble transform filter formulation for Bayesian elliptical problems via Sinkhorn approximation
Simulating model uncertainty of subgrid-scale processes by sampling model errors at convective scales
Data-driven versus self-similar parameterizations for stochastic advection by Lie transport and location uncertainty
Generalization properties of feed-forward neural networks trained on Lorenz systems
Vivian A. Montiforte, Hans E. Ngodock, and Innocent Souopgui
Nonlin. Processes Geophys., 31, 463–476, https://doi.org/10.5194/npg-31-463-2024, https://doi.org/10.5194/npg-31-463-2024, 2024
Short summary
Short summary
Advanced data assimilation methods are complex and computationally expensive. We compare two simpler methods, diffusive back-and-forth nudging and concave–convex nonlinearity, which account for change over time with the potential of providing accurate results with a reduced computational cost. We evaluate the accuracy of the two methods by implementing them within simple chaotic models. We conclude that the length and frequency of observations impact which method is better suited for a problem.
Fumitoshi Kawasaki and Shunji Kotsuki
Nonlin. Processes Geophys., 31, 319–333, https://doi.org/10.5194/npg-31-319-2024, https://doi.org/10.5194/npg-31-319-2024, 2024
Short summary
Short summary
Recently, scientists have been looking into ways to control the weather to lead to a desirable direction for mitigating weather-induced disasters caused by torrential rainfall and typhoons. This study proposes using the model predictive control (MPC), an advanced control method, to control a chaotic system. Through numerical experiments using a low-dimensional chaotic system, we demonstrate that the system can be successfully controlled with shorter forecasts compared to previous studies.
Shunji Kotsuki, Fumitoshi Kawasaki, and Masanao Ohashi
Nonlin. Processes Geophys., 31, 237–245, https://doi.org/10.5194/npg-31-237-2024, https://doi.org/10.5194/npg-31-237-2024, 2024
Short summary
Short summary
In Earth science, data assimilation plays an important role in integrating real-world observations with numerical simulations for improving subsequent predictions. To overcome the time-consuming computations of conventional data assimilation methods, this paper proposes using quantum annealing machines. Using the D-Wave quantum annealer, the proposed method found solutions with comparable accuracy to conventional approaches and significantly reduced computational time.
Mao Ouyang, Keita Tokuda, and Shunji Kotsuki
Nonlin. Processes Geophys., 30, 183–193, https://doi.org/10.5194/npg-30-183-2023, https://doi.org/10.5194/npg-30-183-2023, 2023
Short summary
Short summary
This research found that weather control would change the chaotic behavior of an atmospheric model. We proposed to introduce chaos theory in the weather control. Experimental results demonstrated that the proposed approach reduced the manipulations, including the control times and magnitudes, which throw light on the weather control in a real atmospheric model.
Qiwen Sun, Takemasa Miyoshi, and Serge Richard
Nonlin. Processes Geophys., 30, 117–128, https://doi.org/10.5194/npg-30-117-2023, https://doi.org/10.5194/npg-30-117-2023, 2023
Short summary
Short summary
This paper is a follow-up of a work by Miyoshi and Sun which was published in NPG Letters in 2022. The control simulation experiment is applied to the Lorenz-96 model for avoiding extreme events. The results show that extreme events of this partially and imperfectly observed chaotic system can be avoided by applying pre-designed small perturbations. These investigations may be extended to more realistic numerical weather prediction models.
Clara Deser and Adam S. Phillips
Nonlin. Processes Geophys., 30, 63–84, https://doi.org/10.5194/npg-30-63-2023, https://doi.org/10.5194/npg-30-63-2023, 2023
Short summary
Short summary
Past and future climate change at regional scales is a result of both human influences and natural (internal) variability. Here, we provide an overview of recent advances in climate modeling and physical understanding that has led to new insights into their respective roles, illustrated with original results for the European climate. Our findings highlight the confounding role of internal variability in attribution, climate model evaluation, and accuracy of future projections.
Dikraa Khedhaouiria, Stéphane Bélair, Vincent Fortin, Guy Roy, and Franck Lespinas
Nonlin. Processes Geophys., 29, 329–344, https://doi.org/10.5194/npg-29-329-2022, https://doi.org/10.5194/npg-29-329-2022, 2022
Short summary
Short summary
This study introduces a well-known use of hybrid methods in data assimilation (DA) algorithms that has not yet been explored for precipitation analyses. Our approach combined an ensemble-based DA approach with an existing deterministically based DA. Both DA scheme families have desirable aspects that can be leveraged if combined. The DA hybrid method showed better precipitation analyses in regions with a low rate of assimilated surface observations, which is typically the case in winter.
Takemasa Miyoshi and Qiwen Sun
Nonlin. Processes Geophys., 29, 133–139, https://doi.org/10.5194/npg-29-133-2022, https://doi.org/10.5194/npg-29-133-2022, 2022
Short summary
Short summary
The weather is chaotic and hard to predict, but the chaos implies an effective control where a small control signal grows rapidly to make a big difference. This study proposes a control simulation experiment where we apply a small signal to control
naturein a computational simulation. Idealized experiments with a low-order chaotic system show successful results by small control signals of only 3 % of the observation error. This is the first step toward realistic weather simulations.
Juan Ruiz, Guo-Yuan Lien, Keiichi Kondo, Shigenori Otsuka, and Takemasa Miyoshi
Nonlin. Processes Geophys., 28, 615–626, https://doi.org/10.5194/npg-28-615-2021, https://doi.org/10.5194/npg-28-615-2021, 2021
Short summary
Short summary
Effective use of observations with numerical weather prediction models, also known as data assimilation, is a key part of weather forecasting systems. For precise prediction at the scales of thunderstorms, fast nonlinear processes pose a grand challenge because most data assimilation systems are based on linear processes and normal distribution errors. We investigate how, every 30 s, weather radar observations can help reduce the effect of nonlinear processes and nonnormal distributions.
Zhao Liu, Shaoqing Zhang, Yang Shen, Yuping Guan, and Xiong Deng
Nonlin. Processes Geophys., 28, 481–500, https://doi.org/10.5194/npg-28-481-2021, https://doi.org/10.5194/npg-28-481-2021, 2021
Short summary
Short summary
A general methodology is introduced to capture regime transitions of the Atlantic meridional overturning circulation (AMOC). The assimilation models with different parameters simulate different paths for the AMOC to switch between equilibrium states. Constraining model parameters with observations can significantly mitigate the model deviations, thus capturing AMOC regime transitions. This simple model study serves as a guideline for improving coupled general circulation models.
Sangeetika Ruchi, Svetlana Dubinkina, and Jana de Wiljes
Nonlin. Processes Geophys., 28, 23–41, https://doi.org/10.5194/npg-28-23-2021, https://doi.org/10.5194/npg-28-23-2021, 2021
Short summary
Short summary
To infer information of an unknown quantity that helps to understand an associated system better and to predict future outcomes, observations and a physical model that connects the data points to the unknown parameter are typically used as information sources. Yet this problem is often very challenging due to the fact that the unknown is generally high dimensional, the data are sparse and the model can be non-linear. We propose a novel approach to address these challenges.
Michiel Van Ginderachter, Daan Degrauwe, Stéphane Vannitsem, and Piet Termonia
Nonlin. Processes Geophys., 27, 187–207, https://doi.org/10.5194/npg-27-187-2020, https://doi.org/10.5194/npg-27-187-2020, 2020
Short summary
Short summary
A generic methodology is developed to estimate the model error and simulate the model uncertainty related to a specific physical process. The method estimates the model error by comparing two different representations of the physical process in otherwise identical models. The found model error can then be used to perturb the model and simulate the model uncertainty. When applying this methodology to deep convection an improvement in the probabilistic skill of the ensemble forecast is found.
Valentin Resseguier, Wei Pan, and Baylor Fox-Kemper
Nonlin. Processes Geophys., 27, 209–234, https://doi.org/10.5194/npg-27-209-2020, https://doi.org/10.5194/npg-27-209-2020, 2020
Short summary
Short summary
Geophysical flows span a broader range of temporal and spatial scales than can be resolved numerically. One way to alleviate the ensuing numerical errors is to combine simulations with measurements, taking account of the accuracies of these two sources of information. Here we quantify the distribution of numerical simulation errors without relying on high-resolution numerical simulations. Specifically, small-scale random vortices are added to simulations while conserving energy or circulation.
Sebastian Scher and Gabriele Messori
Nonlin. Processes Geophys., 26, 381–399, https://doi.org/10.5194/npg-26-381-2019, https://doi.org/10.5194/npg-26-381-2019, 2019
Short summary
Short summary
Neural networks are a technique that is widely used to predict the time evolution of physical systems. For this the past evolution of the system is shown to the neural network – it is
trained– and then can be used to predict the evolution in the future. We show some limitations in this approach for certain systems that are important to consider when using neural networks for climate- and weather-related applications.
Cited articles
Arakawa, A. and Schubert, W. H.: Interaction of a Cumulus Cloud Ensemble with the Large-Scale Environment, Part I, J. Atmos. Sci., 31, 674–701, https://doi.org/10.1175/1520-0469(1974)031<0674:IOACCE>2.0.CO;2, 1974.
Bateni, S. M. and Entekhabi, D.: Relative efficiency of land surface energy balance components, Water Resour. Res., 48, W04510, https://doi.org/10.1029/2011WR011357, 2012.
Berry, E.: Cloud Droplet Growth by Collection, J. Atmos. Sci., 24, 688–701, https://doi.org/10.1175/1520-0469(1967)024<0688:CDGBC>2.0.CO;2, 1967.
Betts, A. K.: Land-Surface-Atmosphere Coupling in Observations and Models, J. Adv. Model. Earth Syst., 1, 4, https://doi.org/10.3894/JAMES.2009.1.4, 2009.
Bi, H., Ma, J., Zheng, W., and Zeng, J.: Comparison of soil moisture in GLDAS model simulations and in situ observations over the Tibetan Plateau, J. Geophys. Res.-Atmos., 121, 2658–2678, https://doi.org/10.1002/2015JD024131, 2016.
Bindlish, R., Cosh, M. H., Jackson, T. J., Koike, T., Fujii, H., Chan, S. K., Asanuma, J., Berg, A. A., Bosch, D. D., Caldwell, T. G., Collins, C. H., McNairn, H., Martinez-Fernandez, J., Prueger, J. H., Rowlandson, T., Seyfried, M., Starks, P. J., Thibeault, M., Van Der Velde, R., Walker, J. P., and Coopersmith, E. J.: GCOM-W AMSR2 soil moisture product validation using core validation sites, IEEE J. Sel. Top. Appl., 11, 209–219, https://doi.org/10.1109/JSTARS.2017.2754293, 2018.
Bishop, C., Etherton, B., and Majumdar, S.: Adaptive Sampling with the Ensemble Transform Kalman Filter. Part I: Theoretical Aspects, Mon. Weather Rev., 129, 420–436, https://doi.org/10.1175/1520-0493(2001)129<0420:ASWTET>2.0.CO;2, 2001.
Bosilovich, M., Radakovich, J., Silva, A., Todling, R., and Verter, F.: Skin Temperature Analysis and Bias Correction in a Coupled Land-Atmosphere Data Assimilation System, J. Meteorol. Soc. Jpn. II, 85A, 205–228, 2007.
Browne, P.A., de Rosnay, P., Zuo, H., Bennett, A., and Dawson, A.: Weakly Coupled Ocean–Atmosphere Data Assimilation in the ECMWF NWP System, Remote Sens., 11, 234, https://doi.org/10.3390/rs11030234, 2019.
Chen, F., Mitchell, K., Schaake, J., Xue, Y., Pan, H.-L., Koren, V., Duan, Q. Y., Ek, M., and Betts, A.: Modeling of land surface evaporation by four schemes and comparison with FIFE observations, J. Geophys. Res., 101, 7251–7268, https://doi.org/10.1029/95JD02165, 1996.
Dee, D. P.: Bias and data assimilation, Q. J. Roy. Meteor. Soc., 131, 3323–3343, https://doi.org/10.1256/qj.05.137, 2005.
De Lannoy, G. J. M., Reichle, R. H., Houser, P. R., Pauwels, V. R. N., and Verhoest, N. E. C.: Correcting for forecast bias in soil moisture assimilation with the ensemble Kalman filter, Water Resour. Res., 43, W09410, https://doi.org/10.1029/2006WR005449, 2007.
Derber, J. C., Parrish, D. F., and Lord, S. J.: The New Global Operational Analysis System at the National Meteorological Center, Weather Forecast., 6, 538–547, https://doi.org/10.1175/1520-0434(1991)006<0538:TNGOAS>2.0.CO;2, 1991.
de Rosnay, P., Drusch, M., Vasiljevic, D., Balsamo, G., Albergel, C., and Isaksen L.: A simplified extended Kalman filter for the global operational soil moisture analysis at ECMWF, Q. J. Roy. Meteor. Soc., 139, 1199–1213, https://doi.org/10.1002/qj.2023, 2012.
de Rosnay, P., Balsamo, G., Albergel, C., Muñoz-Sabater, J., and Isaksen, L.: Initialisation of Land Surface Variables for Numerical Weather Prediction, Surv. Geophys., 35, 607–621, 2014.
Desroziers, G., Berre, L., Chapnik, B., and Poli, P.: Diagnosis of observation, background and analysis-error statistics in observation space, Q. J. Roy. Meteor. Soc., 131, 3385–3396, https://doi.org/10.1256/qj.05.108, 2005.
Dirmeyer, P. A.: Using a Global Soil Wetness Dataset to Improve Seasonal Climate Simulation, J. Climate, 13, 2900–2922, https://doi.org/10.1175/1520-0442(2000)013<2900:UAGSWD>2.0.CO;2, 2000.
Dirmeyer, P. A. and Halder, S.: Sensitivity of Numerical Weather Forecasts to Initial Soil Moisture Variations in CFSv2, Weather Forecast., 31, 1973–1983, https://doi.org/10.1175/WAF-D-16-0049.1, 2016.
Douville, H. and Chauvin, F.: Relevance of soil moisture for seasonal climate prediction: A preliminary study, Clim. Dynam., 16, 719–736, https://doi.org/10.1007/s003820000080, 2000.
Draper, C. and Reichle, R.H.: Assimilation of Satellite Soil Moisture for Improved Atmospheric Reanalyses, Mon. Weather Rev., 147, 2163–2188, https://doi.org/10.1175/MWR-D-18-0393.1, 2019.
Draper, C. S.: Accounting for Land Model Uncertainty in Numerical Weather Prediction Ensemble Systems: Toward Ensemble-Based Coupled Land–Atmosphere Data Assimilation, J. Hydrometeorol., 22, 2089–2104, 2021.
Drusch, M.: Initializing numerical weather prediction models with satellite-derived surface soil moisture: Data assimilation experiments with ECMWF's Integrated Forecast System and the TMI soil moisture data set, J. Geophys. Res., 112, D03102, https://doi.org/10.1029/2006JD007478, 2007.
Drusch, M. and Viterbo, P.: Assimilation of Screen-Level Variables in ECMWF's Integrated Forecast System: A Study on the Impact on the Forecast Quality and Analyzed Soil Moisture, Mon. Weather Rev., 135, 300–314, https://doi.org/10.1175/MWR3309.1, 2007.
Evensen G.: The Ensemble Kalman Filter: Theoretical formulation and practical implementation, Ocean Dynam., 53, 343–367, https://doi.org/10.1007/s10236-003-0036-9, 2003.
Fairbairn, D., de Rosnay, P., and Browne, P. A.: The New Stand-Alone Surface Analysis at ECMWF: Implications for Land–Atmosphere DA Coupling, J. Hydrometeorol., 20, 2023–2042, 2019.
Frolov, S., Bishop, C., Holt, T., Cummings, D., and Kuhl, D.: Facilitating Strongly Coupled Ocean-Atmosphere Data Assimilation with an Interface Solver, Mon. Weather Rev., 144, 150923131613008, https://doi.org/10.1175/MWR-D-15-0041.1, 2016.
Fujii, Y., Nakaegawa, T., Matsumoto, S., Yasuda, T., Yamanaka, G., and Kamachi, M.: Coupled climate simulation by constraining ocean fields in a coupled model with ocean data, J. Climate, 22, 5541–5557, https://doi.org/10.1175/2009JCLI2814.1, 2009.
Gómez, B., Charlton-Pérez, CL., Lewis, H., and Candy, B.: The Met Office Operational Soil Moisture Analysis System, Remote Sens., 12, 3691, https://doi.org/10.3390/rs12223691, 2020.
Hauser, M., Orth, R., and Seneviratne, S. I.: Investigating soil moisture–climate interactions with prescribed soil moisture experiments: an assessment with the Community Earth System Model (version 1.2), Geosci. Model Dev., 10, 1665–1677, https://doi.org/10.5194/gmd-10-1665-2017, 2017.
Hersbach, H., Bell, B., Berrisford, P., Hirahara, S., Horányi, A., Muñoz-Sabater, J., Nicolas, J., Peubey, C., Radu, R., Schepers, D., Simmons, A., Soci, C., Abdalla, S., Abellan, X., Balsamo, G., Bechtold, P., Biavati, G., Bidlot, J., Bonavita, M., De Chiara, G., Dahlgren, P., Dee, D., Diamantakis, M., Dragani, R., Flemming, J., Forbes, R., Fuentes, M., Geer, A., Haimberger, L., Healy, S., Hogan, R. J., Hólm, E., Janisková, M., Keeley, S., Laloyaux, P., Lopez, P., Lupu, C., Radnoti, G., de Rosnay, P., Rozum, I., Vamborg, F., Villaume, S., and Thépaut, J.-N.: The ERA5 global reanalysis, Q. J. Roy. Meteor. Soc., 146, 1999–2049, https://doi.org/10.1002/qj.3803, 2020.
Honda, T., Miyoshi, T., Lien, G., Nishizawa, S., Yoshida, R., Adachi, S. A., Terasaki, K., Okamoto, K., Tomita, H., and Bessho, K.: Assimilating All-Sky Himawari-8 Satellite Infrared Radiances: A Case of Typhoon Soudelor (2015), Mon. Weather Rev., 146, 213–229, 2018.
Hoover, B. T. and Langland, R. H.: Forecast and observation impact experiments in the Navy Global Environmental Model with assimilation of ECWMF analysis data in the global domain, J. Meteorol. Soc. Jpn., 95, 369–389, https://doi.org/10.2151/jmsj.2017-023, 2017.
Hunt, B. R., Kostelich, E. J., and Szunyogh, I.: Efficient data assimilation for spatiotemporal chaos: A local ensemble transform Kalman filter, Phys. D, 230, 112–126, https://doi.org/10.1016/j.physd.2006.11.008, 2007.
Kang, J.-S., Kalnay, E., Liu, J., Fung, I., Miyoshi, T., and Ide, K.: “Variable localization” in an ensemble Kalman filter: Application to the carbon cycle data assimilation, J. Geophys. Res., 116, D09110, https://doi.org/10.1029/2010JD014673, 2011.
Kikuchi, K., Kodama, C., Nasuno, T., Nakano, M., Miura, H., Satoh, M., Noda, A. T., and Yamada, Y.: Tropical intraseasonal oscillation simulated in an AMIP-type experiment by NICAM, Clim. Dynam., 48, 2507–2528, https://doi.org/10.1007/s00382-016-3219-z, 2017.
Kodama, C., Yamada, Y., Noda, A. T., Kikuchi, K., Kajikawa, Y., Nasuno, T., Tomita, T., Yamaura, T., Takahashi, T. G., Hara, M., Kawatani, Y., Satoh, M., and Sugi, M.: A 20-year climatology of a NICAM AMIP-type simulation, J. Meteorol. Soc. Jpn., 93, 393–424, https://doi.org/10.2151/jmsj.2015-024, 2015.
Koren, V., Schaake, J., Mitchell, K., Duan, Q. Y., Chen, F., and Baker, J. M.: A parameterization of snowpack and frozen ground intended for NCEP weather and climate models, J. Geophys. Res., 104, 19569–19585, https://doi.org/10.1029/1999JD900232, 1999.
Koster, R. D., Dirmeyer, P. A., Guo, Z., Bonan, G., Chan, E., Cox, P., Gordon, C. T., Kanae, S., Kowalczyk, E., Lawrence, D., Liu, P., Lu, C. H., Malyshev, S., McAvaney, B., Mitchell, K., Mocko, D., Oki, T., Oleson, K., Pitman, A., Sud, Y. C., Taylor, C. M., Verseghy, D., Vasic, R., Xue, Y., and Yamada, T.: Regions of strong coupling between soil moisture and precipitation, Science, 305, 1138–1140, https://doi.org/10.1126/science.1100217, 2004.
Kotsuki, S., Miyoshi, T., Terasaki, K., Lien, G.-Y., and Kalnay, E.: Assimilating the global satellite mapping of precipitation data with the Nonhydrostatic Icosahedral Atmospheric Model (NICAM), J. Geophys. Res., 122, 631–650, https://doi.org/10.1002/2016JD025355, 2017a.
Kotsuki, S., Ota, Y., and Miyoshi, T.: Adaptive covariance relaxation methods for ensemble data assimilation: experiments in the real atmosphere, Q. J. Roy. Meteor. Soc., 143, 2001–2015, https://doi.org/10.1002/qj.3060, 2017b.
Kotsuki, S., Terasaki, K., Yashiro, H., Tomita, H., Satoh, M., and Miyoshi, T.: Online Model Parameter Estimation with Ensemble Data Assimilation in the Real Global Atmosphere: A Case with the Nonhydrostatic Icosahedral Atmospheric Model (NICAM) and the Global Satellite Mapping of Precipitation Data, J. Geophys. Res., 123, 7375–7392, https://doi.org/10.1029/2017JD028092, 2018.
Kotsuki, S., Kurosawa, K., and Miyoshi, T.: On the properties of ensemble forecast sensitivity to observations, Q. J. Roy. Meteor. Soc., 145, 1897–1914, https://doi.org/10.1002/qj.3534, 2019a.
Kotsuki, S., Kurosawa, K., Otsuka, S., Terasaki, K., and Miyoshi, T.: Global Precipitation Forecasts by Merging Extrapolation-based Nowcast and Numerical Weather Prediction with Locally-optimized Weights, Weather Forecast., 34, 701–714, https://doi.org/10.1175/WAF-D-18-0164.1, 2019b.
Kotsuki, S., Terasaki, K., Kanemaru, K., Satoh, M., Kubota, T., and Miyoshi, T.: Predictability of Record-Breaking Rainfall in Japan in July 2018: Ensemble Forecast Experiments with the Near-real-time Global Atmospheric Data Assimilation System NEXRA, SOLA, 15A, 1–7, https://doi.org/10.2151/sola.15A-001, 2019c.
Laloyaux, P., Balmaseda, M., Dee, D., Mogensen, K., and Janssen, P.: A coupled data assimilation system for climate reanalysis, Q. J. Roy. Meteor. Soc., 142, 65–78, https://doi.org/10.1002/qj.2629, 2016.
Lea, D. J., Mirouze, I., Martin, M. J., King, R. R., Hines, A., Walters, D., and Thurlow, M.: Assessing a New Coupled Data Assimilation System Based on the Met Office Coupled Atmosphere–Land–Ocean–Sea Ice Model, Mon. Weather Rev., 143, 4678–4694, https://doi.org/10.1175/MWR-D-15-0174.1, 2015.
Lin, L. and Pu, Z.: Examining the Impact of SMAP Soil Moisture Retrievals on Short-Range Weather Prediction under Weakly and Strongly Coupled Data Assimilation with WRF-Noah, Mon. Weather Rev., 147, 4345–4366, https://doi.org/10.1175/MWR-D-19-0017.1, 2019.
Lin, L. and Pu, Z.: Improving Near-Surface Short-Range Weather Forecasts Using Strongly Coupled Land-Atmosphere Data Assimilation with GSI-EnKF, Mon. Weather Rev., 148, 2863–2888, https://doi.org/10.1175/MWR-D-19-0370.1, 2020.
Mahfouf, J., Viterbo, P., Douville, H., Beljaars, A., and Saarinen, S.: A Revised land-surface analysis scheme in the Integrated Forecasting System, ECMWF Newsletter, Summer–Autumn, 2000.
Ménard, R., Yang, Y., and Rochon, Y.: Convergence and stability ofestimated error variances derived from assimilation residuals in observa-tion space, Proceedings of ECMWF Workshop on Diagnostics of Data Assimilation System Performance, 15–17 June 2009, Reading, UK, 2009.
Miyoshi, T. and Yamane, S.: Local Ensemble Transform Kalman Filtering with an AGCM at a T159/L48 Resolution, Mon. Weather Rev., 135, 3841–3861, https://doi.org/10.1175/2007MWR1873.1, 2007.
Penny, S. and Hamill, T.: Coupled Data Assimilation for Integrated Earth System Analysis and Prediction, B. Am. Meteorol. Soc., 98, ES169–ES172, https://www.jstor.org/stable/26243775 (last access: 14 October 2023), 2017.
Penny, S. G., Bach, E., Bhargava, K., Chang, C.-C., Da, C., Sun, L., and Yoshida, T.: Strongly coupled data assimilation in multiscale media: Experiments using a quasi-geostrophic coupled model, J. Adv. Model. Earth Syst., 11, 1803–1829, 2019.
Reichle, R. H. and Koster, R. D.: Bias reduction in short records of satellite soil moisture, Geophys. Res. Lett., 31, L19501, https://doi.org/10.1029/2004GL020938, 2004.
Reichle, R. H., McLaughlin, D. B., and Entekhabi, D.: Hydrologic Data Assimilation with the Ensemble Kalman Filter, Mon. Weather Rev., 130, 103–114, https://doi.org/10.1175/1520-0493(2002)130<0103:HDAWTE>2.0.CO;2, 2002.
Reichle, R. H., Kumar, S. V., Mahanama, S. P. P., Koster, R. D., and Liu, Q.: Assimilation of Satellite-Derived Skin Temperature Observations into Land Surface Models, J. Hydrometeorol., 11, 1103–1122, 2010.
Rodell, M., Houser, P. R., Jambor, U., Gottschalck, J., Mitchell, K., Meng, C., Arsenault, K., Cosgrove, B., Radakovich, J., Bosilovich, M., Entin, J. K., Walker, J. P., Lohmann, D., and Toll, D.: The Global Land Data Assimilation System, B. Am. Meteorol. Soc., 85, 381–394, https://doi.org/10.1175/BAMS-85-3-381, 2004.
Rodríguez-Fernández, N., de Rosnay, P., Albergel, C., Richaume, P., Aires, F., Prigent, C., and Kerr, Y.: SMOS Neural Network Soil Moisture Data Assimilation in a Land Surface Model and Atmospheric Impact, Remote Sens., 11, 1334, https://doi.org/10.3390/rs11111334, 2019.
Santanello, J. A., Lawston, P., Kumar, S., and Dennis, E.: Understanding the impacts of soil moisture initial conditions on NWP in the context of land–atmosphere coupling, J. Hydrometeorol., 20, 793–819, https://doi.org/10.1175/JHM-D-18-0186.1, 2019.
Satoh, M., Matsuno, T., Tomita, H., Miura, H., Nasuno, T., and Iga, S.: Nonhydrostatic icosahedral atmospheric model (NICAM) for global cloud resolving simulations, J. Comput, Phys., 227, 3486–3514, https://doi.org/10.1016/j.jcp.2007.02.006, 2008.
Satoh, M., Tomita, H., Yashiro, H., Miura, H., Kodama, C., Seiki, T., Noda, A., Yamada, Y., Goto, D., Sawada, M., Miyoshi, T., Niwa, Y., Hara, M., Ohno, Y., Iga, S., Arakawa, T., Inoue, T., and Kubokawa, H.: The Non-hydrostatic Icosahedral Atmospheric Model: description and development, Prog. Earth Planet. Sci., 1, 18, https://doi.org/10.1186/s40645-014-0018-1, 2014.
Sawada, Y., Nakaegawa, T., and Miyoshi, T.: Hydrometeorology as an inversion problem: Can river discharge observations improve the atmosphere by ensemble data assimilation?, J. Geophys. Res.-Atmos., 123, 848–860, https://doi.org/10.1002/2017JD027531, 2018.
Sluka, T. C., Penny, S. G., Kalnay, E., and Miyoshi, T.: Assimilating atmospheric observations into the ocean using strongly coupled ensemble data assimilation, Geophys. Res. Lett., 43, 752–759, https://doi.org/10.1002/2015GL067238, 2016.
Sugiura, N., Awaji, T., Masuda, S., Mochizuki, T., Toyoda, T., Miyama, T., Igarashi, H., and Ishikawa, Y.: Development of a four-dimensional variational coupled data assimilation system for enhanced analysis and prediction of seasonal to interannual climate variations, J. Geophys. Res., 113, C10017, https://doi.org/10.1029/2008JC004741, 2008.
Suzuki, K., Zupanski, M., and Zupanski, D.: A case study involving single observation experiments performed over snowy Siberia using a coupled atmosphere-land modelling system, Atmos. Sci. Lett, 18, 106–111, https://doi.org/10.1002/asl.730, 2017.
Takata, K., Emori, S., and Watanabe, T.: Development of the minimal advanced treatments of surface interaction and runoff, Global Planet. Chang., 38, 209–222, https://doi.org/10.1016/S0921-8181(03)00030-4, 2003.
Tang, Q., Mu, L., Goessling, H. F., Semmler, T., and Nerger, L.: Strongly coupled data assimilation of ocean observations into an ocean-atmosphere model, Geophys. Res. Lett., 48, e2021GL094941, https://doi.org/10.1029/2021GL094941, 2021.
Terasaki, K. and Miyoshi, T.: Assimilating AMSU-A Radiances with the NICAM-LETKF, J. Meteorol. Soc. Jpn., 95, 433–446, https://doi.org/10.2151/jmsj.2017-028, 2017.
Terasaki, K., Sawada, M., and Miyoshi, T.: Local Ensemble Transform Kalman Filter Experiments with the Nonhydrostatic Icosahedral Atmospheric Model NICAM, SOLA, 11, 23–26, https://doi.org/10.2151/sola.2015-006, 2015.
Terasaki, K., Kotsuki, S., and Miyoshi, T.: Multi-year analysis using the NICAM-LETKF data assimilation system, SOLA, 15, 41–46, https://doi.org/10.2151/sola.2019-009, 2019.
Whitaker, J. S. and Hamill, T. M.: Evaluating Methods to Account for System Errors in Ensemble Data Assimilation, Mon. Weather Rev., 140, 3078–3089, https://doi.org/10.1175/MWR-D-11-00276.1, 2012.
Zhang, S., Harrison, M. J., Rosati, A., and Wittenberg, A.: System Design and Evaluation of Coupled Ensemble Data Assimilation for Global Oceanic Climate Studies, Mon. Weather Rev.,135, 3541–3564, https://doi.org/10.1175/MWR3466.1, 2007.
Short summary
This study aimed to enhance weather and hydrological forecasts by integrating soil moisture data into a global weather model. By assimilating atmospheric observations and soil moisture data, the accuracy of forecasts was improved, and certain biases were reduced. The method was found to be particularly beneficial in areas like the Sahel and equatorial Africa, where precipitation patterns vary seasonally. This new approach has the potential to improve the precision of weather predictions.
This study aimed to enhance weather and hydrological forecasts by integrating soil moisture data...
