Articles | Volume 25, issue 1
https://doi.org/10.5194/npg-25-129-2018
© Author(s) 2018. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/npg-25-129-2018
© Author(s) 2018. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Research article
| 
01 Mar 2018
Research article |
| 01 Mar 2018
| 01 Mar 2018
Accelerating assimilation development for new observing systems using EFSO
Department of Atmospheric and Oceanic Science, University of Maryland,
College Park, Maryland, 20742, USA
RIKEN Advanced Institute for Computational Science, Kobe, 650-0047,
Japan
Daisuke Hotta
Meteorological Research Institute, Japan Meteorological Agency,
Tsukuba, 305-0052, Japan
Department of Atmospheric and Oceanic Science, University of Maryland,
College Park, Maryland, 20742, USA
Eugenia Kalnay
Department of Atmospheric and Oceanic Science, University of Maryland,
College Park, Maryland, 20742, USA
Takemasa Miyoshi
RIKEN Advanced Institute for Computational Science, Kobe, 650-0047,
Japan
Department of Atmospheric and Oceanic Science, University of Maryland,
College Park, Maryland, 20742, USA
Japan Agency for Marine-Earth Science and Technology (JAMSTEC),
Yokohama, 236-0001, Japan
Tse-Chun Chen
Department of Atmospheric and Oceanic Science, University of Maryland,
College Park, Maryland, 20742, USA
Related authors
Juan Ruiz, Guo-Yuan Lien, Keiichi Kondo, Shigenori Otsuka, and Takemasa Miyoshi
Nonlin. Processes Geophys., 28, 615–626, https://doi.org/10.5194/npg-28-615-2021, https://doi.org/10.5194/npg-28-615-2021, 2021
Short summary
Short summary
Effective use of observations with numerical weather prediction models, also known as data assimilation, is a key part of weather forecasting systems. For precise prediction at the scales of thunderstorms, fast nonlinear processes pose a grand challenge because most data assimilation systems are based on linear processes and normal distribution errors. We investigate how, every 30 s, weather radar observations can help reduce the effect of nonlinear processes and nonnormal distributions.
Michael Goodliff and Takemasa Miyoshi
EGUsphere, https://doi.org/10.5194/egusphere-2025-933, https://doi.org/10.5194/egusphere-2025-933, 2025
Short summary
Short summary
Data-driven models (DDMs) learn from large datasets to make predictions, but data limitations affect reliability. Data assimilation (DA) improves accuracy by combining real-world observations with computational models. This research explores how DA enhances DDMs despite limited data. We propose an algorithm using DA to refine DDM training iteratively. This work has broad implications for fields like meteorology, engineering, and environmental science, where accurate prediction is critical.
Daisuke Hotta, Katrin Lonitz, and Sean Healy
Atmos. Meas. Tech., 17, 1075–1089, https://doi.org/10.5194/amt-17-1075-2024, https://doi.org/10.5194/amt-17-1075-2024, 2024
Short summary
Short summary
Global Navigation Satellite System (GNSS) polarimetric radio occultation (PRO) is a new type of GNSS observations that can detect heavy precipitation along the ray path between the emitter and receiver satellites. As a first step towards using these observations in numerical weather prediction (NWP), we developed a computer code that simulates GNSS-PRO observations from forecast fields produced by an NWP model. The quality of the developed simulator is evaluated with a number of case studies.
Kenta Kurosawa, Shunji Kotsuki, and Takemasa Miyoshi
Nonlin. Processes Geophys., 30, 457–479, https://doi.org/10.5194/npg-30-457-2023, https://doi.org/10.5194/npg-30-457-2023, 2023
Short summary
Short summary
This study aimed to enhance weather and hydrological forecasts by integrating soil moisture data into a global weather model. By assimilating atmospheric observations and soil moisture data, the accuracy of forecasts was improved, and certain biases were reduced. The method was found to be particularly beneficial in areas like the Sahel and equatorial Africa, where precipitation patterns vary seasonally. This new approach has the potential to improve the precision of weather predictions.
Eugenia Kalnay, Travis Sluka, Takuma Yoshida, Cheng Da, and Safa Mote
Nonlin. Processes Geophys., 30, 217–236, https://doi.org/10.5194/npg-30-217-2023, https://doi.org/10.5194/npg-30-217-2023, 2023
Short summary
Short summary
Strongly coupled data assimilation (SCDA) generates coherent integrated Earth system analyses by assimilating the full Earth observation set into all Earth components. We describe SCDA based on the ensemble Kalman filter with a hierarchy of coupled models, from a coupled Lorenz to the Climate Forecast System v2. SCDA with a sufficiently large ensemble can provide more accurate coupled analyses compared to weakly coupled DA. The correlation-cutoff method can compensate for a small ensemble size.
Qiwen Sun, Takemasa Miyoshi, and Serge Richard
Nonlin. Processes Geophys., 30, 117–128, https://doi.org/10.5194/npg-30-117-2023, https://doi.org/10.5194/npg-30-117-2023, 2023
Short summary
Short summary
This paper is a follow-up of a work by Miyoshi and Sun which was published in NPG Letters in 2022. The control simulation experiment is applied to the Lorenz-96 model for avoiding extreme events. The results show that extreme events of this partially and imperfectly observed chaotic system can be avoided by applying pre-designed small perturbations. These investigations may be extended to more realistic numerical weather prediction models.
Zhiqiang Liu, Ning Zeng, Yun Liu, Eugenia Kalnay, Ghassem Asrar, Qixiang Cai, and Pengfei Han
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2023-15, https://doi.org/10.5194/gmd-2023-15, 2023
Revised manuscript not accepted
Short summary
Short summary
We introduced a novel algorithm that assimilates a better a priori knowledge to improve the estimation of global surface carbon flux. The algorithm aims at separating the first-order systematic biases in the a priori "bottom-up" flux estimations out of the inversion framework from a comprehensive data assimilation perspective.
Tobias Necker, David Hinger, Philipp Johannes Griewank, Takemasa Miyoshi, and Martin Weissmann
Nonlin. Processes Geophys., 30, 13–29, https://doi.org/10.5194/npg-30-13-2023, https://doi.org/10.5194/npg-30-13-2023, 2023
Short summary
Short summary
This study investigates vertical localization based on a convection-permitting 1000-member ensemble simulation. We derive an empirical optimal localization (EOL) that minimizes sampling error in 40-member sub-sample correlations assuming 1000-member correlations as truth. The results will provide guidance for localization in convective-scale ensemble data assimilation systems.
Shun Ohishi, Takemasa Miyoshi, and Misako Kachi
Geosci. Model Dev., 15, 9057–9073, https://doi.org/10.5194/gmd-15-9057-2022, https://doi.org/10.5194/gmd-15-9057-2022, 2022
Short summary
Short summary
An adaptive observation error inflation (AOEI) method was proposed for atmospheric data assimilation to mitigate erroneous analysis updates caused by large observation-minus-forecast differences for satellite brightness temperature around clear- and cloudy-sky boundaries. This study implemented the AOEI with an ocean data assimilation system, leading to an improvement of analysis accuracy and dynamical balance around the frontal regions with large meridional temperature differences.
Shun Ohishi, Tsutomu Hihara, Hidenori Aiki, Joji Ishizaka, Yasumasa Miyazawa, Misako Kachi, and Takemasa Miyoshi
Geosci. Model Dev., 15, 8395–8410, https://doi.org/10.5194/gmd-15-8395-2022, https://doi.org/10.5194/gmd-15-8395-2022, 2022
Short summary
Short summary
We develop an ensemble-Kalman-filter-based regional ocean data assimilation system in which satellite and in situ observations are assimilated at a daily frequency. We find the best setting for dynamical balance and accuracy based on sensitivity experiments focused on how to inflate the ensemble spread and how to apply the analysis update to the model evolution. This study has a broader impact on more general data assimilation systems in which the initial shocks are a significant issue.
Shunji Kotsuki, Takemasa Miyoshi, Keiichi Kondo, and Roland Potthast
Geosci. Model Dev., 15, 8325–8348, https://doi.org/10.5194/gmd-15-8325-2022, https://doi.org/10.5194/gmd-15-8325-2022, 2022
Short summary
Short summary
Data assimilation plays an important part in numerical weather prediction (NWP) in terms of combining forecasted states and observations. While data assimilation methods in NWP usually assume the Gaussian error distribution, some variables in the atmosphere, such as precipitation, are known to have non-Gaussian error statistics. This study extended a widely used ensemble data assimilation algorithm to enable the assimilation of more non-Gaussian observations.
Chu-Chun Chang and Eugenia Kalnay
Nonlin. Processes Geophys., 29, 317–327, https://doi.org/10.5194/npg-29-317-2022, https://doi.org/10.5194/npg-29-317-2022, 2022
Short summary
Short summary
This study introduces a new approach for enhancing the ensemble data assimilation (DA), a technique that combines observations and forecasts to improve numerical weather predictions. Our method uses the prescribed correlations to suppress spurious errors, improving the accuracy of DA. The experiments on the simplified atmosphere model show that our method has comparable performance to the traditional method but is superior in the early stage and is more computationally efficient.
Zhiqiang Liu, Ning Zeng, Yun Liu, Eugenia Kalnay, Ghassem Asrar, Bo Wu, Qixiang Cai, Di Liu, and Pengfei Han
Geosci. Model Dev., 15, 5511–5528, https://doi.org/10.5194/gmd-15-5511-2022, https://doi.org/10.5194/gmd-15-5511-2022, 2022
Short summary
Short summary
We described the application of a constrained ensemble Kalman filter (CEnKF) in a joint CO2 and surface carbon fluxes estimation study. By assimilating the pseudo-surface and OCO-2 observations, the annual global flux estimation is significantly biased without mass conservation. With the additional CEnKF process, the CO2 mass is strictly constrained, and the estimation of annual fluxes is significantly improved.
Takemasa Miyoshi and Qiwen Sun
Nonlin. Processes Geophys., 29, 133–139, https://doi.org/10.5194/npg-29-133-2022, https://doi.org/10.5194/npg-29-133-2022, 2022
Short summary
Short summary
The weather is chaotic and hard to predict, but the chaos implies an effective control where a small control signal grows rapidly to make a big difference. This study proposes a control simulation experiment where we apply a small signal to control
naturein a computational simulation. Idealized experiments with a low-order chaotic system show successful results by small control signals of only 3 % of the observation error. This is the first step toward realistic weather simulations.
Juan Ruiz, Guo-Yuan Lien, Keiichi Kondo, Shigenori Otsuka, and Takemasa Miyoshi
Nonlin. Processes Geophys., 28, 615–626, https://doi.org/10.5194/npg-28-615-2021, https://doi.org/10.5194/npg-28-615-2021, 2021
Short summary
Short summary
Effective use of observations with numerical weather prediction models, also known as data assimilation, is a key part of weather forecasting systems. For precise prediction at the scales of thunderstorms, fast nonlinear processes pose a grand challenge because most data assimilation systems are based on linear processes and normal distribution errors. We investigate how, every 30 s, weather radar observations can help reduce the effect of nonlinear processes and nonnormal distributions.
Keiichi Kondo and Takemasa Miyoshi
Nonlin. Processes Geophys., 26, 211–225, https://doi.org/10.5194/npg-26-211-2019, https://doi.org/10.5194/npg-26-211-2019, 2019
Short summary
Short summary
This study investigates non-Gaussian statistics of the data from a 10240-member ensemble Kalman filter. The large ensemble size can resolve the detailed structures of the probability density functions (PDFs) and indicates that the non-Gaussian PDF is caused by multimodality and outliers. While the outliers appear randomly, large multimodality corresponds well with large analysis error, mainly in the tropical regions and storm track regions where highly nonlinear processes appear frequently.
Atsushi Okazaki, Takumi Honda, Shunji Kotsuki, Moeka Yamaji, Takuji Kubota, Riko Oki, Toshio Iguchi, and Takemasa Miyoshi
Atmos. Meas. Tech., 12, 3985–3996, https://doi.org/10.5194/amt-12-3985-2019, https://doi.org/10.5194/amt-12-3985-2019, 2019
Short summary
Short summary
The JAXA is surveying the feasibility of a potential satellite mission equipped with a precipitation radar on a geostationary orbit, as a successor of the GPM Core Observatory. We investigate what kind of observation data will be available from the radar using simulation techniques. Although the quality of the observation depends on the radar specifications and the position of precipitation systems, the results demonstrate that it would be possible to obtain three-dimensional precipitation data.
Yun Liu, Eugenia Kalnay, Ning Zeng, Ghassem Asrar, Zhaohui Chen, and Binghao Jia
Geosci. Model Dev., 12, 2899–2914, https://doi.org/10.5194/gmd-12-2899-2019, https://doi.org/10.5194/gmd-12-2899-2019, 2019
Short summary
Short summary
We developed a new carbon data assimilation system to estimate the surface carbon fluxes using the LETKF and GEOS-Chem model, which uses a new scheme with a short
assimilation windowand a long
observation window. The analysis is more accurate using the short assimilation window and is exposed to the future observations that accelerate the spin-up. In OSSE, the system reduces the analysis error significantly, suggesting that this method could be used for other data assimilation problems.
Yun Liu, Eugenia Kalnay, Ning Zeng, Ghassem Asrar, Zhaohui Chen, and Binghao Jia
Atmos. Chem. Phys. Discuss., https://doi.org/10.5194/acp-2017-888, https://doi.org/10.5194/acp-2017-888, 2017
Preprint withdrawn
Short summary
Short summary
We developed a new Carbon data assimilation system to estimate the surface carbon fluxes using the LETKF and GEOS-Chem model, which uses a new scheme with a short
assimilation windowand a long
observation window. The analysis is more accurate with the short assimilation window and is exposed to the future observations accelerating the spin up. In OSSE, the system reduces significantly the analysis error, suggesting that this method could be used in other data assimilation problems.
Hazuki Arakida, Takemasa Miyoshi, Takeshi Ise, Shin-ichiro Shima, and Shunji Kotsuki
Nonlin. Processes Geophys., 24, 553–567, https://doi.org/10.5194/npg-24-553-2017, https://doi.org/10.5194/npg-24-553-2017, 2017
Short summary
Short summary
This is the first study assimilating the satellite-based leaf area index observations every 4 days into a numerical model simulating the growth and death of individual plants. The newly developed data assimilation system successfully reduced the uncertainties of the model parameters related to phenology and carbon dynamics. It also provides better estimates of the present vegetation structure which can be used as the initial states for the simulation of the future vegetation change.
Stephen G. Penny and Takemasa Miyoshi
Nonlin. Processes Geophys., 23, 391–405, https://doi.org/10.5194/npg-23-391-2016, https://doi.org/10.5194/npg-23-391-2016, 2016
Short summary
Short summary
Particle filters in their basic form have been shown to be unusable for large geophysical systems because the number of required particles grows exponentially with the size of the system. We have applied the ideas of localized analyses at each model grid point and use ensemble weight smoothing to blend each local analysis with its neighbors. This new local particle filter (LPF) makes large geophysical applications tractable for particle filters and is competitive with a popular EnKF alternative.
Fang Zhao, Ning Zeng, Ghassem Asrar, Pierre Friedlingstein, Akihiko Ito, Atul Jain, Eugenia Kalnay, Etsushi Kato, Charles D. Koven, Ben Poulter, Rashid Rafique, Stephen Sitch, Shijie Shu, Beni Stocker, Nicolas Viovy, Andy Wiltshire, and Sonke Zaehle
Biogeosciences, 13, 5121–5137, https://doi.org/10.5194/bg-13-5121-2016, https://doi.org/10.5194/bg-13-5121-2016, 2016
Short summary
Short summary
The increasing seasonality of atmospheric CO2 is strongly linked with enhanced land vegetation activities in the last 5 decades, for which the importance of increasing CO2, climate and land use/cover change was evaluated in single model studies (Zeng et al., 2014; Forkel et al., 2016). Here we examine the relative importance of these factors in multiple models. Our results highlight models can show similar results in some benchmarks with different underlying regional dynamics.
Hisashi Yashiro, Koji Terasaki, Takemasa Miyoshi, and Hirofumi Tomita
Geosci. Model Dev., 9, 2293–2300, https://doi.org/10.5194/gmd-9-2293-2016, https://doi.org/10.5194/gmd-9-2293-2016, 2016
Short summary
Short summary
We propose the design and implementation of an ensemble data assimilation framework for weather prediction at a high resolution and with a large ensemble size. We consider the deployment of this framework on the data throughput of file I/O and multi-node communication. With regard to high-performance computing systems, where data throughput performance increases at a slower rate than computational performance, our new framework promises drastic reduction of total execution time.
Erin Lynch, Daniel Kaufman, A. Surjalal Sharma, Eugenia Kalnay, and Kayo Ide
Nonlin. Processes Geophys., 23, 137–141, https://doi.org/10.5194/npg-23-137-2016, https://doi.org/10.5194/npg-23-137-2016, 2016
Short summary
Short summary
In this article, bred vectors are computed from a single time series data using time-delay embedding, with a new technique, nearest-neighbor breeding. Since the dynamical properties of the nearest-neighbor bred vectors are shown to be similar to bred vectors computed using evolution equations, this provides a new and novel way to model and predict sudden transitions in systems represented by time series data alone.
X. Han, X. Li, G. He, P. Kumbhar, C. Montzka, S. Kollet, T. Miyoshi, R. Rosolem, Y. Zhang, H. Vereecken, and H.-J. H. Franssen
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmdd-8-7395-2015, https://doi.org/10.5194/gmdd-8-7395-2015, 2015
Revised manuscript not accepted
Short summary
Short summary
DasPy is a ready to use open source parallel multivariate land data assimilation framework with joint state and parameter estimation using Local Ensemble Transform Kalman Filter. The Community Land Model (4.5) was integrated as model operator. The Community Microwave Emission Modelling platform, COsmic-ray Soil Moisture Interaction Code and the Two-Source Formulation were integrated as observation operators for the multivariate assimilation of soil moisture and soil temperature, respectively.
S. G. Penny, E. Kalnay, J. A. Carton, B. R. Hunt, K. Ide, T. Miyoshi, and G. A. Chepurin
Nonlin. Processes Geophys., 20, 1031–1046, https://doi.org/10.5194/npg-20-1031-2013, https://doi.org/10.5194/npg-20-1031-2013, 2013
Related subject area
Subject: Predictability, probabilistic forecasts, data assimilation, inverse problems | Topic: Climate, atmosphere, ocean, hydrology, cryosphere, biosphere
Dynamic-Statistic Combined Ensemble Prediction and Impact Factors on China’s Summer Precipitation
Inferring flow energy, space scales, and timescales: freely drifting vs. fixed-point observations
Multilevel Monte Carlo methods for ensemble variational data assimilation
Explaining the high skill of Reservoir Computing methods in El Niño prediction
A comparison of two nonlinear data assimilation methods
On Process-Oriented Conditional Targeted Covariance Inflation (TCI) for 3D-Volume Radar Data Assimilation
Prognostic assumed-probability-density-function (distribution density function) approach: further generalization and demonstrations
Bridging classical data assimilation and optimal transport: the 3D-Var case
Leading the Lorenz 63 system toward the prescribed regime by model predictive control coupled with data assimilation
Selecting and weighting dynamical models using data-driven approaches
Improving ensemble data assimilation through Probit-space Ensemble Size Expansion for Gaussian Copulas (PESE-GC)
A quest for precipitation attractors in weather radar archives
Quantum data assimilation: a new approach to solving data assimilation on quantum annealers
Evolution of small-scale turbulence at large Richardson numbers
Robust weather-adaptive post-processing using model output statistics random forests
Comparative study of strongly and weakly coupled data assimilation with a global land–atmosphere coupled model
How far can the statistical error estimation problem be closed by collocated data?
Using orthogonal vectors to improve the ensemble space of the ensemble Kalman filter and its effect on data assimilation and forecasting
Review article: Towards strongly coupled ensemble data assimilation with additional improvements from machine learning
Reducing manipulations in a control simulation experiment based on instability vectors with the Lorenz-63 model
Control simulation experiments of extreme events with the Lorenz-96 model
Toward a multivariate formulation of the parametric Kalman filter assimilation: application to a simplified chemical transport model
Data-driven reconstruction of partially observed dynamical systems
A range of outcomes: the combined effects of internal variability and anthropogenic forcing on regional climate trends over Europe
Extending ensemble Kalman filter algorithms to assimilate observations with an unknown time offset
Guidance on how to improve vertical covariance localization based on a 1000-member ensemble
Weather pattern dynamics over western Europe under climate change: predictability, information entropy and production
Using a hybrid optimal interpolation–ensemble Kalman filter for the Canadian Precipitation Analysis
Applying prior correlations for ensemble-based spatial localization
A stochastic covariance shrinkage approach to particle rejuvenation in the ensemble transform particle filter
Control simulation experiment with Lorenz's butterfly attractor
Ensemble Riemannian data assimilation: towards large-scale dynamical systems
Inferring the instability of a dynamical system from the skill of data assimilation exercises
Reduced non-Gaussianity by 30 s rapid update in convective-scale numerical weather prediction
Multivariate localization functions for strongly coupled data assimilation in the bivariate Lorenz 96 system
A study of capturing Atlantic meridional overturning circulation (AMOC) regime transition through observation-constrained model parameters
Calibrated ensemble forecasts of the height of new snow using quantile regression forests and ensemble model output statistics
Enhancing geophysical flow machine learning performance via scale separation
Improving the potential accuracy and usability of EURO-CORDEX estimates of future rainfall climate using frequentist model averaging
Ensemble Riemannian data assimilation over the Wasserstein space
An early warning sign of critical transition in the Antarctic ice sheet – a data-driven tool for a spatiotemporal tipping point
Training a convolutional neural network to conserve mass in data assimilation
Behavior of the iterative ensemble-based variational method in nonlinear problems
Fast hybrid tempered ensemble transform filter formulation for Bayesian elliptical problems via Sinkhorn approximation
A methodology to obtain model-error covariances due to the discretization scheme from the parametric Kalman filter perspective
A method for predicting the uncompleted climate transition process
Statistical postprocessing of ensemble forecasts for severe weather at Deutscher Wetterdienst
Data-driven predictions of a multiscale Lorenz 96 chaotic system using machine-learning methods: reservoir computing, artificial neural network, and long short-term memory network
From research to applications – examples of operational ensemble post-processing in France using machine learning
Correcting for model changes in statistical postprocessing – an approach based on response theory
Xiaojuan Wang, Zihan Yang, Shuai Li, Qingquan Li, and Guolin Feng
EGUsphere, https://doi.org/10.5194/egusphere-2024-3762, https://doi.org/10.5194/egusphere-2024-3762, 2024
Short summary
Short summary
This study presents the Unequal-Weighted Ensemble prediction (UWE) of the dynamic-statistic schemes in order to enhance summer precipitation prediction in China. The analysis also includes an examination of factors that may impact the prediction skill of UWE, such as grid-based and station-based prediction, the calculation of prediction skill, and the influence of sample dispersion on prediction accuracy.
Aurelien Luigi Serge Ponte, Lachlan C. Astfalck, Matthew D. Rayson, Andrew P. Zulberti, and Nicole L. Jones
Nonlin. Processes Geophys., 31, 571–586, https://doi.org/10.5194/npg-31-571-2024, https://doi.org/10.5194/npg-31-571-2024, 2024
Short summary
Short summary
We propose a novel method for the estimation of ocean surface flow properties in terms of its energy and spatial and temporal scales. The method relies on flow observations collected either at a fixed location or along the flow, as would be inferred from the trajectory of freely drifting platforms. The accuracy of the method is quantified in several experimental configurations. We innovatively demonstrate that freely drifting platforms, even in isolation, can be used to capture flow properties.
Mayeul Destouches, Paul Mycek, Selime Gürol, Anthony T. Weaver, Serge Gratton, and Ehouarn Simon
EGUsphere, https://doi.org/10.5194/egusphere-2024-3628, https://doi.org/10.5194/egusphere-2024-3628, 2024
Short summary
Short summary
We explore the potential of Multilevel Monte Carlo methods to improve ensemble-variational data assimilation without increasing the computational cost. By shifting part of the ensemble generation cost to coarser simulation grids, larger sample sizes and smaller sampling errors become affordable, while keeping the final estimate unbiased. Numerical experiments with a quasi-geostrophic model demonstrate the potential of the approach and highlight the challenges towards operational implementation.
Francesco Guardamagna, Claudia Wieners, and Henk Dijkstra
Nonlin. Processes Geophys. Discuss., https://doi.org/10.5194/npg-2024-24, https://doi.org/10.5194/npg-2024-24, 2024
Revised manuscript accepted for NPG
Short summary
Short summary
Artificial intelligence (AI) has recently shown promising results in ENSO (El Niño Southern Oscillation) forecasting, outperforming traditional models. Yet, AI models deliver accurate predictions without showing the underlying mechanisms. Our study examines a specific AI model, the Reservoir Computer (RC). Our results show that the RC is less sensitive to initial perturbations than the traditional Zebiak and Cane (ZC) model. This reduced sensitivity can explain the RC's superior skills.
Vivian A. Montiforte, Hans E. Ngodock, and Innocent Souopgui
Nonlin. Processes Geophys., 31, 463–476, https://doi.org/10.5194/npg-31-463-2024, https://doi.org/10.5194/npg-31-463-2024, 2024
Short summary
Short summary
Advanced data assimilation methods are complex and computationally expensive. We compare two simpler methods, diffusive back-and-forth nudging and concave–convex nonlinearity, which account for change over time with the potential of providing accurate results with a reduced computational cost. We evaluate the accuracy of the two methods by implementing them within simple chaotic models. We conclude that the length and frequency of observations impact which method is better suited for a problem.
Klaus Vobig, Roland Potthast, and Klaus Stephan
EGUsphere, https://doi.org/10.5194/egusphere-2024-2876, https://doi.org/10.5194/egusphere-2024-2876, 2024
Short summary
Short summary
We present a novel approach to targeted covariance inflation (TCI) which aims to improve the assimilation of 3D radar reflectivity and, eventually, the short-term forecast of reflectivity and precipitation.
Using an operational numerical weather prediction framework, our numerical results show that TCI makes the system accurately generate new reflectivity cells and significantly improves the fractional skill score of forecasts over lead times of up to six hours by up to 10 %.
Jun-Ichi Yano
Nonlin. Processes Geophys., 31, 359–380, https://doi.org/10.5194/npg-31-359-2024, https://doi.org/10.5194/npg-31-359-2024, 2024
Short summary
Short summary
A methodology for directly predicting the time evolution of the assumed parameters for the distribution densities based on the Liouville equation, as proposed earlier, is extended to multidimensional cases and to cases in which the systems are constrained by integrals over a part of the variable range. The extended methodology is tested against a convective energy-cycle system as well as the Lorenz strange attractor.
Marc Bocquet, Pierre J. Vanderbecken, Alban Farchi, Joffrey Dumont Le Brazidec, and Yelva Roustan
Nonlin. Processes Geophys., 31, 335–357, https://doi.org/10.5194/npg-31-335-2024, https://doi.org/10.5194/npg-31-335-2024, 2024
Short summary
Short summary
A novel approach, optimal transport data assimilation (OTDA), is introduced to merge DA and OT concepts. By leveraging OT's displacement interpolation in space, it minimises mislocation errors within DA applied to physical fields, such as water vapour, hydrometeors, and chemical species. Its richness and flexibility are showcased through one- and two-dimensional illustrations.
Fumitoshi Kawasaki and Shunji Kotsuki
Nonlin. Processes Geophys., 31, 319–333, https://doi.org/10.5194/npg-31-319-2024, https://doi.org/10.5194/npg-31-319-2024, 2024
Short summary
Short summary
Recently, scientists have been looking into ways to control the weather to lead to a desirable direction for mitigating weather-induced disasters caused by torrential rainfall and typhoons. This study proposes using the model predictive control (MPC), an advanced control method, to control a chaotic system. Through numerical experiments using a low-dimensional chaotic system, we demonstrate that the system can be successfully controlled with shorter forecasts compared to previous studies.
Pierre Le Bras, Florian Sévellec, Pierre Tandeo, Juan Ruiz, and Pierre Ailliot
Nonlin. Processes Geophys., 31, 303–317, https://doi.org/10.5194/npg-31-303-2024, https://doi.org/10.5194/npg-31-303-2024, 2024
Short summary
Short summary
The goal of this paper is to weight several dynamic models in order to improve the representativeness of a system. It is illustrated using a set of versions of an idealized model describing the Atlantic Meridional Overturning Circulation. The low-cost method is based on data-driven forecasts. It enables model performance to be evaluated on their dynamics. Taking into account both model performance and codependency, the derived weights outperform benchmarks in reconstructing a model distribution.
Man-Yau Chan
Nonlin. Processes Geophys., 31, 287–302, https://doi.org/10.5194/npg-31-287-2024, https://doi.org/10.5194/npg-31-287-2024, 2024
Short summary
Short summary
Forecasts have uncertainties. It is thus essential to reduce these uncertainties. Such reduction requires uncertainty quantification, which often means running costly models multiple times. The cost limits the number of model runs and thus the quantification’s accuracy. This study proposes a technique that utilizes users’ knowledge of forecast uncertainties to improve uncertainty quantification. Tests show that this technique improves uncertainty reduction.
Loris Foresti, Bernat Puigdomènech Treserras, Daniele Nerini, Aitor Atencia, Marco Gabella, Ioannis V. Sideris, Urs Germann, and Isztar Zawadzki
Nonlin. Processes Geophys., 31, 259–286, https://doi.org/10.5194/npg-31-259-2024, https://doi.org/10.5194/npg-31-259-2024, 2024
Short summary
Short summary
We compared two ways of defining the phase space of low-dimensional attractors describing the evolution of radar precipitation fields. The first defines the phase space by the domain-scale statistics of precipitation fields, such as their mean, spatial and temporal correlations. The second uses principal component analysis to account for the spatial distribution of precipitation. To represent different climates, radar archives over the United States and the Swiss Alpine region were used.
Shunji Kotsuki, Fumitoshi Kawasaki, and Masanao Ohashi
Nonlin. Processes Geophys., 31, 237–245, https://doi.org/10.5194/npg-31-237-2024, https://doi.org/10.5194/npg-31-237-2024, 2024
Short summary
Short summary
In Earth science, data assimilation plays an important role in integrating real-world observations with numerical simulations for improving subsequent predictions. To overcome the time-consuming computations of conventional data assimilation methods, this paper proposes using quantum annealing machines. Using the D-Wave quantum annealer, the proposed method found solutions with comparable accuracy to conventional approaches and significantly reduced computational time.
Lev Ostrovsky, Irina Soustova, Yuliya Troitskaya, and Daria Gladskikh
Nonlin. Processes Geophys., 31, 219–227, https://doi.org/10.5194/npg-31-219-2024, https://doi.org/10.5194/npg-31-219-2024, 2024
Short summary
Short summary
The nonstationary kinetic model of turbulence is used to describe the evolution and structure of the upper turbulent layer with the parameters taken from in situ observations. As an example, we use a set of data for three cruises made in different areas of the world ocean. With the given profiles of current shear and buoyancy frequency, the theory yields results that satisfactorily agree with the measurements of the turbulent dissipation rate.
Thomas Muschinski, Georg J. Mayr, Achim Zeileis, and Thorsten Simon
Nonlin. Processes Geophys., 30, 503–514, https://doi.org/10.5194/npg-30-503-2023, https://doi.org/10.5194/npg-30-503-2023, 2023
Short summary
Short summary
Statistical post-processing is necessary to generate probabilistic forecasts from physical numerical weather prediction models. To allow for more flexibility, there has been a shift in post-processing away from traditional parametric regression models towards modern machine learning methods. By fusing these two approaches, we developed model output statistics random forests, a new post-processing method that is highly flexible but at the same time also very robust and easy to interpret.
Kenta Kurosawa, Shunji Kotsuki, and Takemasa Miyoshi
Nonlin. Processes Geophys., 30, 457–479, https://doi.org/10.5194/npg-30-457-2023, https://doi.org/10.5194/npg-30-457-2023, 2023
Short summary
Short summary
This study aimed to enhance weather and hydrological forecasts by integrating soil moisture data into a global weather model. By assimilating atmospheric observations and soil moisture data, the accuracy of forecasts was improved, and certain biases were reduced. The method was found to be particularly beneficial in areas like the Sahel and equatorial Africa, where precipitation patterns vary seasonally. This new approach has the potential to improve the precision of weather predictions.
Annika Vogel and Richard Ménard
Nonlin. Processes Geophys., 30, 375–398, https://doi.org/10.5194/npg-30-375-2023, https://doi.org/10.5194/npg-30-375-2023, 2023
Short summary
Short summary
Accurate estimation of the error statistics required for data assimilation remains an ongoing challenge, as statistical assumptions are required to solve the estimation problem. This work provides a conceptual view of the statistical error estimation problem in light of the increasing number of available datasets. We found that the total number of required assumptions increases with the number of overlapping datasets, but the relative number of error statistics that can be estimated increases.
Yung-Yun Cheng, Shu-Chih Yang, Zhe-Hui Lin, and Yung-An Lee
Nonlin. Processes Geophys., 30, 289–297, https://doi.org/10.5194/npg-30-289-2023, https://doi.org/10.5194/npg-30-289-2023, 2023
Short summary
Short summary
In the ensemble Kalman filter, the ensemble space may not fully capture the forecast errors due to the limited ensemble size and systematic model errors, which affect the accuracy of analysis and prediction. This study proposes a new algorithm to use cost-free pseudomembers to expand the ensemble space effectively and improve analysis accuracy during the analysis step, without increasing the ensemble size during forecasting.
Eugenia Kalnay, Travis Sluka, Takuma Yoshida, Cheng Da, and Safa Mote
Nonlin. Processes Geophys., 30, 217–236, https://doi.org/10.5194/npg-30-217-2023, https://doi.org/10.5194/npg-30-217-2023, 2023
Short summary
Short summary
Strongly coupled data assimilation (SCDA) generates coherent integrated Earth system analyses by assimilating the full Earth observation set into all Earth components. We describe SCDA based on the ensemble Kalman filter with a hierarchy of coupled models, from a coupled Lorenz to the Climate Forecast System v2. SCDA with a sufficiently large ensemble can provide more accurate coupled analyses compared to weakly coupled DA. The correlation-cutoff method can compensate for a small ensemble size.
Mao Ouyang, Keita Tokuda, and Shunji Kotsuki
Nonlin. Processes Geophys., 30, 183–193, https://doi.org/10.5194/npg-30-183-2023, https://doi.org/10.5194/npg-30-183-2023, 2023
Short summary
Short summary
This research found that weather control would change the chaotic behavior of an atmospheric model. We proposed to introduce chaos theory in the weather control. Experimental results demonstrated that the proposed approach reduced the manipulations, including the control times and magnitudes, which throw light on the weather control in a real atmospheric model.
Qiwen Sun, Takemasa Miyoshi, and Serge Richard
Nonlin. Processes Geophys., 30, 117–128, https://doi.org/10.5194/npg-30-117-2023, https://doi.org/10.5194/npg-30-117-2023, 2023
Short summary
Short summary
This paper is a follow-up of a work by Miyoshi and Sun which was published in NPG Letters in 2022. The control simulation experiment is applied to the Lorenz-96 model for avoiding extreme events. The results show that extreme events of this partially and imperfectly observed chaotic system can be avoided by applying pre-designed small perturbations. These investigations may be extended to more realistic numerical weather prediction models.
Antoine Perrot, Olivier Pannekoucke, and Vincent Guidard
Nonlin. Processes Geophys., 30, 139–166, https://doi.org/10.5194/npg-30-139-2023, https://doi.org/10.5194/npg-30-139-2023, 2023
Short summary
Short summary
This work is a theoretical contribution that provides equations for understanding uncertainty prediction applied in air quality where multiple chemical species can interact. A simplified minimal test bed is introduced that shows the ability of our equations to reproduce the statistics estimated from an ensemble of forecasts. While the latter estimation is the state of the art, solving equations is numerically less costly, depending on the number of chemical species, and motivates this research.
Pierre Tandeo, Pierre Ailliot, and Florian Sévellec
Nonlin. Processes Geophys., 30, 129–137, https://doi.org/10.5194/npg-30-129-2023, https://doi.org/10.5194/npg-30-129-2023, 2023
Short summary
Short summary
The goal of this paper is to obtain probabilistic predictions of a partially observed dynamical system without knowing the model equations. It is illustrated using the three-dimensional Lorenz system, where only two components are observed. The proposed data-driven procedure is low-cost, is easy to implement, uses linear and Gaussian assumptions and requires only a small amount of data. It is based on an iterative linear Kalman smoother with a state augmentation.
Clara Deser and Adam S. Phillips
Nonlin. Processes Geophys., 30, 63–84, https://doi.org/10.5194/npg-30-63-2023, https://doi.org/10.5194/npg-30-63-2023, 2023
Short summary
Short summary
Past and future climate change at regional scales is a result of both human influences and natural (internal) variability. Here, we provide an overview of recent advances in climate modeling and physical understanding that has led to new insights into their respective roles, illustrated with original results for the European climate. Our findings highlight the confounding role of internal variability in attribution, climate model evaluation, and accuracy of future projections.
Elia Gorokhovsky and Jeffrey L. Anderson
Nonlin. Processes Geophys., 30, 37–47, https://doi.org/10.5194/npg-30-37-2023, https://doi.org/10.5194/npg-30-37-2023, 2023
Short summary
Short summary
Older observations of the Earth system sometimes lack information about the time they were taken, posing problems for analyses of past climate. To begin to ameliorate this problem, we propose new methods of varying complexity, including methods to estimate the distribution of the offsets between true and reported observation times. The most successful method accounts for the nonlinearity in the system, but even the less expensive ones can improve data assimilation in the presence of time error.
Tobias Necker, David Hinger, Philipp Johannes Griewank, Takemasa Miyoshi, and Martin Weissmann
Nonlin. Processes Geophys., 30, 13–29, https://doi.org/10.5194/npg-30-13-2023, https://doi.org/10.5194/npg-30-13-2023, 2023
Short summary
Short summary
This study investigates vertical localization based on a convection-permitting 1000-member ensemble simulation. We derive an empirical optimal localization (EOL) that minimizes sampling error in 40-member sub-sample correlations assuming 1000-member correlations as truth. The results will provide guidance for localization in convective-scale ensemble data assimilation systems.
Stéphane Vannitsem
Nonlin. Processes Geophys., 30, 1–12, https://doi.org/10.5194/npg-30-1-2023, https://doi.org/10.5194/npg-30-1-2023, 2023
Short summary
Short summary
The impact of climate change on weather pattern dynamics over the North Atlantic is explored through the lens of information theory. These tools allow the predictability of the succession of weather patterns and the irreversible nature of the dynamics to be clarified. It is shown that the predictability is increasing in the observations, while the opposite trend is found in model projections. The irreversibility displays an overall increase in time in both the observations and the model runs.
Dikraa Khedhaouiria, Stéphane Bélair, Vincent Fortin, Guy Roy, and Franck Lespinas
Nonlin. Processes Geophys., 29, 329–344, https://doi.org/10.5194/npg-29-329-2022, https://doi.org/10.5194/npg-29-329-2022, 2022
Short summary
Short summary
This study introduces a well-known use of hybrid methods in data assimilation (DA) algorithms that has not yet been explored for precipitation analyses. Our approach combined an ensemble-based DA approach with an existing deterministically based DA. Both DA scheme families have desirable aspects that can be leveraged if combined. The DA hybrid method showed better precipitation analyses in regions with a low rate of assimilated surface observations, which is typically the case in winter.
Chu-Chun Chang and Eugenia Kalnay
Nonlin. Processes Geophys., 29, 317–327, https://doi.org/10.5194/npg-29-317-2022, https://doi.org/10.5194/npg-29-317-2022, 2022
Short summary
Short summary
This study introduces a new approach for enhancing the ensemble data assimilation (DA), a technique that combines observations and forecasts to improve numerical weather predictions. Our method uses the prescribed correlations to suppress spurious errors, improving the accuracy of DA. The experiments on the simplified atmosphere model show that our method has comparable performance to the traditional method but is superior in the early stage and is more computationally efficient.
Andrey A. Popov, Amit N. Subrahmanya, and Adrian Sandu
Nonlin. Processes Geophys., 29, 241–253, https://doi.org/10.5194/npg-29-241-2022, https://doi.org/10.5194/npg-29-241-2022, 2022
Short summary
Short summary
Numerical weather prediction requires the melding of both computational model and data obtained from sensors such as satellites. We focus on one algorithm to accomplish this. We aim to aid its use by additionally supplying it with data obtained from separate models that describe the average behavior of the computational model at any given time. We show that our approach outperforms the standard approaches to this problem.
Takemasa Miyoshi and Qiwen Sun
Nonlin. Processes Geophys., 29, 133–139, https://doi.org/10.5194/npg-29-133-2022, https://doi.org/10.5194/npg-29-133-2022, 2022
Short summary
Short summary
The weather is chaotic and hard to predict, but the chaos implies an effective control where a small control signal grows rapidly to make a big difference. This study proposes a control simulation experiment where we apply a small signal to control
naturein a computational simulation. Idealized experiments with a low-order chaotic system show successful results by small control signals of only 3 % of the observation error. This is the first step toward realistic weather simulations.
Sagar K. Tamang, Ardeshir Ebtehaj, Peter Jan van Leeuwen, Gilad Lerman, and Efi Foufoula-Georgiou
Nonlin. Processes Geophys., 29, 77–92, https://doi.org/10.5194/npg-29-77-2022, https://doi.org/10.5194/npg-29-77-2022, 2022
Short summary
Short summary
The outputs from Earth system models are optimally combined with satellite observations to produce accurate forecasts through a process called data assimilation. Many existing data assimilation methodologies have some assumptions regarding the shape of the probability distributions of model output and observations, which results in forecast inaccuracies. In this paper, we test the effectiveness of a newly proposed methodology that relaxes such assumptions about high-dimensional models.
Yumeng Chen, Alberto Carrassi, and Valerio Lucarini
Nonlin. Processes Geophys., 28, 633–649, https://doi.org/10.5194/npg-28-633-2021, https://doi.org/10.5194/npg-28-633-2021, 2021
Short summary
Short summary
Chaotic dynamical systems are sensitive to the initial conditions, which are crucial for climate forecast. These properties are often used to inform the design of data assimilation (DA), a method used to estimate the exact initial conditions. However, obtaining the instability properties is burdensome for complex problems, both numerically and analytically. Here, we suggest a different viewpoint. We show that the skill of DA can be used to infer the instability properties of a dynamical system.
Juan Ruiz, Guo-Yuan Lien, Keiichi Kondo, Shigenori Otsuka, and Takemasa Miyoshi
Nonlin. Processes Geophys., 28, 615–626, https://doi.org/10.5194/npg-28-615-2021, https://doi.org/10.5194/npg-28-615-2021, 2021
Short summary
Short summary
Effective use of observations with numerical weather prediction models, also known as data assimilation, is a key part of weather forecasting systems. For precise prediction at the scales of thunderstorms, fast nonlinear processes pose a grand challenge because most data assimilation systems are based on linear processes and normal distribution errors. We investigate how, every 30 s, weather radar observations can help reduce the effect of nonlinear processes and nonnormal distributions.
Zofia Stanley, Ian Grooms, and William Kleiber
Nonlin. Processes Geophys., 28, 565–583, https://doi.org/10.5194/npg-28-565-2021, https://doi.org/10.5194/npg-28-565-2021, 2021
Short summary
Short summary
In weather forecasting, observations are incorporated into a model of the atmosphere through a process called data assimilation. Sometimes observations in one location may impact the weather forecast in another faraway location in undesirable ways. The impact of distant observations on the forecast is mitigated through a process called localization. We propose a new method for localization when a model has multiple length scales, as in a model spanning both the ocean and the atmosphere.
Zhao Liu, Shaoqing Zhang, Yang Shen, Yuping Guan, and Xiong Deng
Nonlin. Processes Geophys., 28, 481–500, https://doi.org/10.5194/npg-28-481-2021, https://doi.org/10.5194/npg-28-481-2021, 2021
Short summary
Short summary
A general methodology is introduced to capture regime transitions of the Atlantic meridional overturning circulation (AMOC). The assimilation models with different parameters simulate different paths for the AMOC to switch between equilibrium states. Constraining model parameters with observations can significantly mitigate the model deviations, thus capturing AMOC regime transitions. This simple model study serves as a guideline for improving coupled general circulation models.
Guillaume Evin, Matthieu Lafaysse, Maxime Taillardat, and Michaël Zamo
Nonlin. Processes Geophys., 28, 467–480, https://doi.org/10.5194/npg-28-467-2021, https://doi.org/10.5194/npg-28-467-2021, 2021
Short summary
Short summary
Forecasting the height of new snow is essential for avalanche hazard surveys, road and ski resort management, tourism attractiveness, etc. Météo-France operates a probabilistic forecasting system using a numerical weather prediction system and a snowpack model. It provides better forecasts than direct diagnostics but exhibits significant biases. Post-processing methods can be applied to provide automatic forecasting products from this system.
Davide Faranda, Mathieu Vrac, Pascal Yiou, Flavio Maria Emanuele Pons, Adnane Hamid, Giulia Carella, Cedric Ngoungue Langue, Soulivanh Thao, and Valerie Gautard
Nonlin. Processes Geophys., 28, 423–443, https://doi.org/10.5194/npg-28-423-2021, https://doi.org/10.5194/npg-28-423-2021, 2021
Short summary
Short summary
Machine learning approaches are spreading rapidly in climate sciences. They are of great help in many practical situations where using the underlying equations is difficult because of the limitation in computational power. Here we use a systematic approach to investigate the limitations of the popular echo state network algorithms used to forecast the long-term behaviour of chaotic systems, such as the weather. Our results show that noise and intermittency greatly affect the performances.
Stephen Jewson, Giuliana Barbato, Paola Mercogliano, Jaroslav Mysiak, and Maximiliano Sassi
Nonlin. Processes Geophys., 28, 329–346, https://doi.org/10.5194/npg-28-329-2021, https://doi.org/10.5194/npg-28-329-2021, 2021
Short summary
Short summary
Climate model simulations are uncertain. In some cases this makes it difficult to know how to use them. Significance testing is often used to deal with this issue but has various shortcomings. We describe two alternative ways to manage uncertainty in climate model simulations that avoid these shortcomings. We test them on simulations of future rainfall over Europe and show they produce more accurate projections than either using unadjusted climate model output or statistical testing.
Sagar K. Tamang, Ardeshir Ebtehaj, Peter J. van Leeuwen, Dongmian Zou, and Gilad Lerman
Nonlin. Processes Geophys., 28, 295–309, https://doi.org/10.5194/npg-28-295-2021, https://doi.org/10.5194/npg-28-295-2021, 2021
Short summary
Short summary
Data assimilation aims to improve hydrologic and weather forecasts by combining available information from Earth system models and observations. The classical approaches to data assimilation usually proceed with some preconceived assumptions about the shape of their probability distributions. As a result, when such assumptions are invalid, the forecast accuracy suffers. In the proposed methodology, we relax such assumptions and demonstrate improved performance.
Abd AlRahman AlMomani and Erik Bollt
Nonlin. Processes Geophys., 28, 153–166, https://doi.org/10.5194/npg-28-153-2021, https://doi.org/10.5194/npg-28-153-2021, 2021
Short summary
Short summary
This paper introduces a tool for data-driven discovery of early warning signs of critical transitions in ice shelves from remote sensing data. Our directed spectral clustering method considers an asymmetric affinity matrix along with the associated directed graph Laplacian. We applied our approach to reprocessing the ice velocity data and remote sensing satellite images of the Larsen C ice shelf.
Yvonne Ruckstuhl, Tijana Janjić, and Stephan Rasp
Nonlin. Processes Geophys., 28, 111–119, https://doi.org/10.5194/npg-28-111-2021, https://doi.org/10.5194/npg-28-111-2021, 2021
Short summary
Short summary
The assimilation of observations using standard algorithms can lead to a violation of physical laws (e.g. mass conservation), which is shown to have a detrimental impact on the system's forecast. We use a neural network (NN) to correct this mass violation, using training data generated from expensive algorithms that can constrain such physical properties. We found that, in an idealized set-up, the NN can match the performance of these expensive algorithms at negligible computational costs.
Shin'ya Nakano
Nonlin. Processes Geophys., 28, 93–109, https://doi.org/10.5194/npg-28-93-2021, https://doi.org/10.5194/npg-28-93-2021, 2021
Short summary
Short summary
The ensemble-based variational method is a method for solving nonlinear data assimilation problems by using an ensemble of multiple simulation results. Although this method is derived based on a linear approximation, highly uncertain problems, in which system nonlinearity is significant, can also be solved by applying this method iteratively. This paper reformulated this iterative algorithm to analyze its behavior in high-dimensional nonlinear problems and discuss the convergence.
Sangeetika Ruchi, Svetlana Dubinkina, and Jana de Wiljes
Nonlin. Processes Geophys., 28, 23–41, https://doi.org/10.5194/npg-28-23-2021, https://doi.org/10.5194/npg-28-23-2021, 2021
Short summary
Short summary
To infer information of an unknown quantity that helps to understand an associated system better and to predict future outcomes, observations and a physical model that connects the data points to the unknown parameter are typically used as information sources. Yet this problem is often very challenging due to the fact that the unknown is generally high dimensional, the data are sparse and the model can be non-linear. We propose a novel approach to address these challenges.
Olivier Pannekoucke, Richard Ménard, Mohammad El Aabaribaoune, and Matthieu Plu
Nonlin. Processes Geophys., 28, 1–22, https://doi.org/10.5194/npg-28-1-2021, https://doi.org/10.5194/npg-28-1-2021, 2021
Short summary
Short summary
Numerical weather prediction involves numerically solving the mathematical equations, which describe the geophysical flow, by transforming them so that they can be computed. Through this transformation, it appears that the equations actually solved by the machine are then a modified version of the original equations, introducing an error that contributes to the model error. This work helps to characterize the covariance of the model error that is due to this modification of the equations.
Pengcheng Yan, Guolin Feng, Wei Hou, and Ping Yang
Nonlin. Processes Geophys., 27, 489–500, https://doi.org/10.5194/npg-27-489-2020, https://doi.org/10.5194/npg-27-489-2020, 2020
Short summary
Short summary
A system transiting from one stable state to another has to experience a period. Can we predict the end moment (state) if the process has not been completed? This paper presents a method to solve this problem. This method is based on the quantitative relationship among the parameters, which is used to describe the transition process of the abrupt change. By using the historical data, we extract some parameters for predicting the uncompleted climate transition process.
Reinhold Hess
Nonlin. Processes Geophys., 27, 473–487, https://doi.org/10.5194/npg-27-473-2020, https://doi.org/10.5194/npg-27-473-2020, 2020
Short summary
Short summary
Forecasts of ensemble systems are statistically aligned to synoptic observations at DWD in order to provide support for warning decision management. Motivation and design consequences for extreme and rare meteorological events are presented. Especially for probabilities of severe wind gusts global logistic parameterisations are developed that generate robust statistical forecasts for extreme events, while local characteristics are preserved.
Ashesh Chattopadhyay, Pedram Hassanzadeh, and Devika Subramanian
Nonlin. Processes Geophys., 27, 373–389, https://doi.org/10.5194/npg-27-373-2020, https://doi.org/10.5194/npg-27-373-2020, 2020
Short summary
Short summary
The performance of three machine-learning methods for data-driven modeling of a multiscale chaotic Lorenz 96 system is examined. One of the methods is found to be able to predict the future evolution of the chaotic system well from just knowing the past observations of the large-scale component of the multiscale state vector. Potential applications to data-driven and data-assisted surrogate modeling of complex dynamical systems such as weather and climate are discussed.
Maxime Taillardat and Olivier Mestre
Nonlin. Processes Geophys., 27, 329–347, https://doi.org/10.5194/npg-27-329-2020, https://doi.org/10.5194/npg-27-329-2020, 2020
Short summary
Short summary
Statistical post-processing of ensemble forecasts is now a well-known procedure in order to correct biased and misdispersed ensemble weather predictions. But practical application in European national weather services is in its infancy. Different applications of ensemble post-processing using machine learning at an industrial scale are presented. Forecast quality and value are improved compared to the raw ensemble, but several facilities have to be made to adjust to operational constraints.
Jonathan Demaeyer and Stéphane Vannitsem
Nonlin. Processes Geophys., 27, 307–327, https://doi.org/10.5194/npg-27-307-2020, https://doi.org/10.5194/npg-27-307-2020, 2020
Short summary
Short summary
Postprocessing schemes used to correct weather forecasts are no longer efficient when the model generating the forecasts changes. An approach based on response theory to take the change into account without having to recompute the parameters based on past forecasts is presented. It is tested on an analytical model and a simple model of atmospheric variability. We show that this approach is effective and discuss its potential application for an operational environment.
Cited articles
Bauer, P., Ohring, G., Kummerow, C., and Auligne, T.: Assimilating satellite
observations of clouds and precipitation into NWP models, B. Am. Meteor. Soc.,
92, ES25–ES28, https://doi.org/10.1175/2011BAMS3182.1, 2011.
Cardinali, C.: Monitoring the observation impact on the short-range forecast,
Q. J. Roy. Meteor. Soc., 135, 239–250, https://doi.org/10.1002/qj.366, 2009.
Ehrendorfer, M., Errico, R. M., and Raeder, K. D.: Singular-vector
perturbation growth in a primitive equation model with moist physics, J.
Atmos. Sci., 56, 1627–1648, https://doi.org/10.1175/1520-0469(1999)056>1627:SVPGIA<2.0.CO;21999.
Errico, R. M., Bauer, P., and Mahfouf, J.-F.: Issues regarding the
assimilation of cloud and precipitation data, J. Atmos. Sci., 64,
3785–3798, https://doi.org/10.1175/2006JAS2044.1, 2007.
Geer, A. J.: Significance of changes in medium-range forecast scores, Tellus
A, 68, 30229, https://doi.org/10.3402/tellusa.v68.30229, 2016.
Gelaro, R. and Zhu, Y.: Examination of observation impacts derived from
observing system experiments (OSEs) and adjoint models, Tellus A, 61,
179–193, https://doi.org/10.1111/j.1600-0870.2008.00388.x, 2009.
Gelaro, R., Langland, R. H., Pellerin, S., and Todling, R.: The THORPEX
observation impact intercomparison experiment, Mon. Weather Rev., 138,
4009–4025, https://doi.org/10.1175/2010MWR3393.1, 2010.
Hotta, D., Chen, T.-C., Kalnay, E., Ota, Y., and Miyoshi, T.: Proactive QC: a
fully flow-dependent quality control scheme based on EFSO, Mon. Weather Rev.,
145, 3331–3354, https://doi.org/10.1175/MWR-D-16-0290.1, 2017a.
Hotta, D., Kalnay, E., Ota, Y., and Miyoshi, T.: EFSR: Ensemble forecast
sensitivity to observation error covariance, Mon. Weather Rev., 145,
5015–5031, https://doi.org/10.1175/MWR-D-17-0122.1, 2017b.
Huffman, G. J., Bolvin, D. T., Nelkin, E. J., Wolff, D. B., Adler, R. F., Gu,
G., Hong, Y., Bowman, K. P., and Stocker, E. F.: The TRMM Multisatellite
Precipitation Analysis (TMPA): Quasi-global, multiyear, combined-sensor
precipitation estimates at fine scales, J. Hydrometeorol., 8, 38–55,
https://doi.org/10.1175/JHM560.1, 2007.
Huffman, G. J., Adler, R., Bolvin, D., and Nelkin, E.: The TRMM
Multi-Satellite Precipitation Analysis (TMPA), in Satellite Rainfall
Applications for Surface Hydrology, edited by: Gebremichael, M. and Hossain,
F., 3–22, Springer Netherlands, 2010.
Hunt, B. R., Kostelich, E. J., and Szunyogh, I.: Efficient data assimilation
for spatiotemporal chaos: A local ensemble transform Kalman filter, Physica D,
230, 112–126, https://doi.org/10.1016/j.physd.2006.11.008, 2007.
Ishibashi, T.: Optimization of error covariance matrices and estimation of
observation data impact in the JMA global 4D-Var system, CAS/JSC WGNE
Research Activities in Atmospheric and Oceanic Modelling, available at:
http://wgne.meteoinfo.ru/publications/wgne-blue-book/ , 40, 1–11, 2010.
Janiskova, M. and Cardinali, C.: On the impact of the diabatic component in
the Forecast Sensitivity Observation Impact diagnostics, Tech. Memo. 786,
ECMWF, 18 pp., 2016.
Kalnay, E., Ota, Y., Miyoshi, T., and Liu, J.: A simpler formulation of
forecast sensitivity to observations: application to ensemble Kalman filters,
Tellus A, 64, 18462, https://doi.org/10.3402/tellusa.v64i0.18462, 2012.
Kotsuki, S., Miyoshi, T., Terasaki, K., Lien, G.-Y., and Kalnay, E.:
Assimilating the global satellite mapping of precipitation data with the
Nonhydrostatic Icosahedral Atmospheric Model (NICAM), J. Geophys. Res.
Atmos., 122, 631–650, https://doi.org/10.1002/2016JD025355, 2017.
Langland, R. H. and Baker, N. L.: Estimation of observation impact using the
NRL atmospheric variational data assimilation adjoint system, Tellus, 56A,
189–201, 2004.
Li, H., Liu, J. and Kalnay, E.: Correction of “Estimating observation impact
without adjoint model in an ensemble Kalman filter”, Q. J. Roy. Meteor.
Soc., 136, 1652–1654, https://doi.org/10.1002/qj.658, 2010.
Lien, G.-Y., Kalnay, E., and Miyoshi, T.: Effective assimilation of global
precipitation: Simulation experiments, Tellus A, 65, 19915,
https://doi.org/10.3402/tellusa.v65i0.19915, 2013.
Lien, G.-Y., Kalnay, E., Miyoshi, T., and Huffman, G. J.: Statistical
properties of global precipitation in the NCEP GFS model and TMPA
observations for data assimilation, Mon. Weather Rev., 144, 663–679,
https://doi.org/10.1175/MWR-D-15-0150.1, 2016a.
Lien, G.-Y., Miyoshi, T., and Kalnay, E.: Assimilation of TRMM Multisatellite
Precipitation Analysis with a low-resolution NCEP Global Forecast System,
Mon. Weather Rev., 144, 643–661, https://doi.org/10.1175/MWR-D-15-0149.1, 2016b.
Liu, J. and Kalnay, E.: Estimating observation impact without adjoint model
in an ensemble Kalman filter, Q. J. Roy. Meteor. Soc., 134, 1327–1335,
https://doi.org/10.1002/qj.280, 2008.
Lorenc, A. C. and Marriott, R. T.: Forecast sensitivity to observations in
the Met Office Global numerical weather prediction system, Q. J. Roy.
Meteor. Soc., 140, 209–224, https://doi.org/10.1002/qj.2122, 2014.
Ota, Y., Derber, J. C., Miyoshi, T., and Kalnay, E.: Ensemble-based
observation impact estimates using the NCEP GFS, Tellus A, 65, 20038, https://doi.org/10.3402/tellusa.v65i0.20038, 2013.
Sommer, M. and Weissmann, M.: Observation impact in a convective-scale
localized ensemble transform Kalman filter, Q. J. Roy. Meteor. Soc., 140,
2672–2679, https://doi.org/10.1002/qj.2343, 2014.
Sommer, M. and Weissmann, M.: Ensemble-based approximation of observation
impact using an observation-based verification metric, Tellus A, 68,
27885, https://doi.org/10.3402/tellusa.v68.27885,
2016.
Todling, R.: Comparing two approaches for assessing observation impact, Mon.
Weather Rev., 141, 1484–1505, https://doi.org/10.1175/MWR-D-12-00100.1, 2013.
Tsuyuki, T. and Miyoshi, T.: Recent progress of data assimilation methods in
meteorology, J. Meteor. Soc. Jpn., 85B, 331–361, https://doi.org/10.2151/jmsj.85B.331,
2007.
Zhang, X., Wang, H., Huang, X.-Y., Gao, F., and Jacobs, N. A.: Using
adjoint-based forecast sensitivity method to evaluate TAMDAR data impacts on
regional forecasts, Adv. Meteorol., 2015, 427616, https://doi.org/10.1155/2015/427616, 2015.
Short summary
The ensemble forecast sensitivity to observation (EFSO) method can efficiently clarify under what conditions observations are beneficial or detrimental for assimilation. Based on EFSO, an offline assimilation method is proposed to accelerate the development of data selection strategies for new observing systems. The usefulness of this method is demonstrated with the assimilation of global satellite precipitation data.
The ensemble forecast sensitivity to observation (EFSO) method can efficiently clarify under...
