Articles | Volume 22, issue 1
https://doi.org/10.5194/npg-22-33-2015
© Author(s) 2015. This work is distributed under
the Creative Commons Attribution 3.0 License.
the Creative Commons Attribution 3.0 License.
Special issue:
https://doi.org/10.5194/npg-22-33-2015
© Author(s) 2015. This work is distributed under
the Creative Commons Attribution 3.0 License.
the Creative Commons Attribution 3.0 License.
Research article
| 
13 Jan 2015
Research article |
| 13 Jan 2015
On the data-driven inference of modulatory networks in climate science: an application to West African rainfall
D. L. González II
North Carolina State University, Raleigh, NC 27695-8206, USA
Oak Ridge National Laboratory, P.O. Box 2008, Oak Ridge, TN 37831, USA
M. P. Angus
North Carolina State University, Raleigh, NC 27695-8206, USA
I. K. Tetteh
North Carolina State University, Raleigh, NC 27695-8206, USA
G. A. Bello
North Carolina State University, Raleigh, NC 27695-8206, USA
Oak Ridge National Laboratory, P.O. Box 2008, Oak Ridge, TN 37831, USA
K. Padmanabhan
North Carolina State University, Raleigh, NC 27695-8206, USA
Oak Ridge National Laboratory, P.O. Box 2008, Oak Ridge, TN 37831, USA
S. V. Pendse
North Carolina State University, Raleigh, NC 27695-8206, USA
Oak Ridge National Laboratory, P.O. Box 2008, Oak Ridge, TN 37831, USA
S. Srinivas
North Carolina State University, Raleigh, NC 27695-8206, USA
Oak Ridge National Laboratory, P.O. Box 2008, Oak Ridge, TN 37831, USA
J. Yu
North Carolina State University, Raleigh, NC 27695-8206, USA
F. Semazzi
North Carolina State University, Raleigh, NC 27695-8206, USA
V. Kumar
University of Minnesota, Minneapolis, MN 55455, USA
N. F. Samatova
CORRESPONDING AUTHOR
North Carolina State University, Raleigh, NC 27695-8206, USA
Oak Ridge National Laboratory, P.O. Box 2008, Oak Ridge, TN 37831, USA
Related authors
No articles found.
A. R. Ganguly, E. A. Kodra, A. Agrawal, A. Banerjee, S. Boriah, Sn. Chatterjee, So. Chatterjee, A. Choudhary, D. Das, J. Faghmous, P. Ganguli, S. Ghosh, K. Hayhoe, C. Hays, W. Hendrix, Q. Fu, J. Kawale, D. Kumar, V. Kumar, W. Liao, S. Liess, R. Mawalagedara, V. Mithal, R. Oglesby, K. Salvi, P. K. Snyder, K. Steinhaeuser, D. Wang, and D. Wuebbles
Nonlin. Processes Geophys., 21, 777–795, https://doi.org/10.5194/npg-21-777-2014, https://doi.org/10.5194/npg-21-777-2014, 2014
Related subject area
Subject: Time series, machine learning, networks, stochastic processes, extreme events | Topic: Climate, atmosphere, ocean, hydrology, cryosphere, biosphere
Evaluation of forecasts by a global data-driven weather model with and without probabilistic post-processing at Norwegian stations
Characterisation of Dansgaard-Oeschger events in palaeoclimate time series using the Matrix Profile
The sampling method for optimal precursors of El Niño–Southern Oscillation events
A comparison of two causal methods in the context of climate analyses
A two-fold deep-learning strategy to correct and downscale winds over mountains
Downscaling of surface wind forecasts using convolutional neural networks
Superstatistical analysis of sea surface currents in the Gulf of Trieste, measured by high-frequency radar, and its relation to wind regimes using the maximum-entropy principle
Representation learning with unconditional denoising diffusion models for dynamical systems
Physically constrained covariance inflation from location uncertainty
Data-driven methods to estimate the committor function in conceptual ocean models
Exploring meteorological droughts' spatial patterns across Europe through complex network theory
Rain process models and convergence to point processes
Integrated hydrodynamic and machine learning models for compound flooding prediction in a data-scarce estuarine delta
Empirical adaptive wavelet decomposition (EAWD): an adaptive decomposition for the variability analysis of observation time series in atmospheric science
Predicting sea surface temperatures with coupled reservoir computers
Lévy noise versus Gaussian-noise-induced transitions in the Ghil–Sellers energy balance model
Using neural networks to improve simulations in the gray zone
Direct Bayesian model reduction of smaller scale convective activity conditioned on large-scale dynamics
A waveform skewness index for measuring time series nonlinearity and its applications to the ENSO–Indian monsoon relationship
The blessing of dimensionality for the analysis of climate data
Empirical evidence of a fluctuation theorem for the wind mechanical power input into the ocean
Producing realistic climate data with generative adversarial networks
Identification of droughts and heatwaves in Germany with regional climate networks
Recurrence analysis of extreme event-like data
Extracting statistically significant eddy signals from large Lagrangian datasets using wavelet ridge analysis, with application to the Gulf of Mexico
Improvements to the use of the Trajectory-Adaptive Multilevel Sampling algorithm for the study of rare events
Ensemble-based statistical interpolation with Gaussian anamorphosis for the spatial analysis of precipitation
Applications of matrix factorization methods to climate data
Beyond univariate calibration: verifying spatial structure in ensembles of forecast fields
Simulation-based comparison of multivariate ensemble post-processing methods
Detecting dynamical anomalies in time series from different palaeoclimate proxy archives using windowed recurrence network analysis
Vertical profiles of wind gust statistics from a regional reanalysis using multivariate extreme value theory
Remember the past: a comparison of time-adaptive training schemes for non-homogeneous regression
On fluctuating momentum exchange in idealised models of air–sea interaction
A prototype stochastic parameterization of regime behaviour in the stably stratified atmospheric boundary layer
Statistical post-processing of ensemble forecasts of the height of new snow
Unravelling the spatial diversity of Indian precipitation teleconnections via a non-linear multi-scale approach
Statistical hypothesis testing in wavelet analysis: theoretical developments and applications to Indian rainfall
Comparison of stochastic parameterizations in the framework of a coupled ocean–atmosphere model
Idealized models of the joint probability distribution of wind speeds
Nonlinear analysis of the occurrence of hurricanes in the Gulf of Mexico and the Caribbean Sea
A general theory on frequency and time–frequency analysis of irregularly sampled time series based on projection methods – Part 1: Frequency analysis
A general theory on frequency and time–frequency analysis of irregularly sampled time series based on projection methods – Part 2: Extension to time–frequency analysis
Tipping point analysis of ocean acoustic noise
On the intrinsic timescales of temporal variability in measurements of the surface solar radiation
Optimal heavy tail estimation – Part 1: Order selection
Network-based study of Lagrangian transport and mixing
Multi-scale event synchronization analysis for unravelling climate processes: a wavelet-based approach
Fractional Brownian motion, the Matérn process, and stochastic modeling of turbulent dispersion
A matrix clustering method to explore patterns of land-cover transitions in satellite-derived maps of the Brazilian Amazon
John Bjørnar Bremnes, Thomas N. Nipen, and Ivar A. Seierstad
Nonlin. Processes Geophys., 31, 247–257, https://doi.org/10.5194/npg-31-247-2024, https://doi.org/10.5194/npg-31-247-2024, 2024
Short summary
Short summary
During the last 2 years, tremendous progress has been made in global data-driven weather models trained on reanalysis data. In this study, the Pangu-Weather model is compared to several numerical weather prediction models with and without probabilistic post-processing for temperature and wind speed forecasting. The results confirm that global data-driven models are promising for operational weather forecasting and that post-processing can improve these forecasts considerably.
Susana Barbosa, Maria Eduarda Silva, and Denis-Didier Rousseau
Nonlin. Processes Geophys. Discuss., https://doi.org/10.5194/npg-2024-13, https://doi.org/10.5194/npg-2024-13, 2024
Revised manuscript accepted for NPG
Short summary
Short summary
The characterisation of abrupt transitions in palaeoclimate records allows the understanding of millennial climate variability and of potential tipping points in the context of current climate change. In our study an algorithmic method, the matrix profile, is employed to characterise abrupt warmings designated as Dansgaard-Oeschger (DO) events and to identify the most similar transitions in the palaeoclimate time series.
Bin Shi and Junjie Ma
Nonlin. Processes Geophys., 31, 165–174, https://doi.org/10.5194/npg-31-165-2024, https://doi.org/10.5194/npg-31-165-2024, 2024
Short summary
Short summary
Different from traditional deterministic optimization algorithms, we implement the sampling method to compute the conditional nonlinear optimal perturbations (CNOPs) in the realistic and predictive coupled ocean–atmosphere model, which reduces the first-order information to the zeroth-order one, avoiding the high-cost computation of the gradient. The numerical performance highlights the importance of stochastic optimization algorithms to compute CNOPs and capture initial optimal precursors.
David Docquier, Giorgia Di Capua, Reik V. Donner, Carlos A. L. Pires, Amélie Simon, and Stéphane Vannitsem
Nonlin. Processes Geophys., 31, 115–136, https://doi.org/10.5194/npg-31-115-2024, https://doi.org/10.5194/npg-31-115-2024, 2024
Short summary
Short summary
Identifying causes of specific processes is crucial in order to better understand our climate system. Traditionally, correlation analyses have been used to identify cause–effect relationships in climate studies. However, correlation does not imply causation, which justifies the need to use causal methods. We compare two independent causal methods and show that these are superior to classical correlation analyses. We also find some interesting differences between the two methods.
Louis Le Toumelin, Isabelle Gouttevin, Clovis Galiez, and Nora Helbig
Nonlin. Processes Geophys., 31, 75–97, https://doi.org/10.5194/npg-31-75-2024, https://doi.org/10.5194/npg-31-75-2024, 2024
Short summary
Short summary
Forecasting wind fields over mountains is of high importance for several applications and particularly for understanding how wind erodes and disperses snow. Forecasters rely on operational wind forecasts over mountains, which are currently only available on kilometric scales. These forecasts can also be affected by errors of diverse origins. Here we introduce a new strategy based on artificial intelligence to correct large-scale wind forecasts in mountains and increase their spatial resolution.
Florian Dupuy, Pierre Durand, and Thierry Hedde
Nonlin. Processes Geophys., 30, 553–570, https://doi.org/10.5194/npg-30-553-2023, https://doi.org/10.5194/npg-30-553-2023, 2023
Short summary
Short summary
Forecasting near-surface winds over complex terrain requires high-resolution numerical weather prediction models, which drastically increase the duration of simulations and hinder them in running on a routine basis. A faster alternative is statistical downscaling. We explore different ways of calculating near-surface wind speed and direction using artificial intelligence algorithms based on various convolutional neural networks in order to find the best approach for wind downscaling.
Sofia Flora, Laura Ursella, and Achim Wirth
Nonlin. Processes Geophys., 30, 515–525, https://doi.org/10.5194/npg-30-515-2023, https://doi.org/10.5194/npg-30-515-2023, 2023
Short summary
Short summary
An increasing amount of data allows us to move from low-order moments of fluctuating observations to their PDFs. We found the analytical fat-tailed PDF form (a combination of Gaussian and two-exponential convolutions) for 2 years of sea surface current increments in the Gulf of Trieste, using superstatistics and the maximum-entropy principle twice: on short and longer timescales. The data from different wind regimes follow the same analytical PDF, pointing towards a universal behaviour.
Tobias Sebastian Finn, Lucas Disson, Alban Farchi, Marc Bocquet, and Charlotte Durand
EGUsphere, https://doi.org/10.5194/egusphere-2023-2261, https://doi.org/10.5194/egusphere-2023-2261, 2023
Short summary
Short summary
We train neural networks as denoising diffusion models for state generation in the Lorenz 1963 system and demonstrate that they learn an internal representation of the system. We make use of this learned representation and the pre-trained model in two downstream tasks: surrogate modelling and ensemble generation. For both tasks, the diffusion model can outperform other more common approaches. Thus, we see a potential of representation learning with diffusion models for dynamical systems.
Yicun Zhen, Valentin Resseguier, and Bertrand Chapron
Nonlin. Processes Geophys., 30, 237–251, https://doi.org/10.5194/npg-30-237-2023, https://doi.org/10.5194/npg-30-237-2023, 2023
Short summary
Short summary
This paper provides perspective that the displacement vector field of physical state fields should be determined by the tensor fields associated with the physical fields. The advantage of this perspective is that certain physical quantities can be conserved while applying a displacement vector field to transfer the original physical field. A direct application of this perspective is the physically constrained covariance inflation scheme proposed in this paper.
Valérian Jacques-Dumas, René M. van Westen, Freddy Bouchet, and Henk A. Dijkstra
Nonlin. Processes Geophys., 30, 195–216, https://doi.org/10.5194/npg-30-195-2023, https://doi.org/10.5194/npg-30-195-2023, 2023
Short summary
Short summary
Computing the probability of occurrence of rare events is relevant because of their high impact but also difficult due to the lack of data. Rare event algorithms are designed for that task, but their efficiency relies on a score function that is hard to compute. We compare four methods that compute this function from data and measure their performance to assess which one would be best suited to be applied to a climate model. We find neural networks to be most robust and flexible for this task.
Domenico Giaquinto, Warner Marzocchi, and Jürgen Kurths
Nonlin. Processes Geophys., 30, 167–181, https://doi.org/10.5194/npg-30-167-2023, https://doi.org/10.5194/npg-30-167-2023, 2023
Short summary
Short summary
Despite being among the most severe climate extremes, it is still challenging to assess droughts’ features for specific regions. In this paper we study meteorological droughts in Europe using concepts derived from climate network theory. By exploring the synchronization in droughts occurrences across the continent we unveil regional clusters which are individually examined to identify droughts’ geographical propagation and source–sink systems, which could potentially support droughts’ forecast.
Scott Hottovy and Samuel N. Stechmann
Nonlin. Processes Geophys., 30, 85–100, https://doi.org/10.5194/npg-30-85-2023, https://doi.org/10.5194/npg-30-85-2023, 2023
Short summary
Short summary
Rainfall is erratic and difficult to predict. Thus, random models are often used to describe rainfall events. Since many of these random models are based more on statistics than physical laws, it is desirable to develop connections between the random statistical models and the underlying physics of rain. Here, a physics-based model is shown to converge to a statistics-based model, which helps to provide a physical basis for the statistics-based model.
Joko Sampurno, Valentin Vallaeys, Randy Ardianto, and Emmanuel Hanert
Nonlin. Processes Geophys., 29, 301–315, https://doi.org/10.5194/npg-29-301-2022, https://doi.org/10.5194/npg-29-301-2022, 2022
Short summary
Short summary
In this study, we successfully built and evaluated machine learning models for predicting water level dynamics as a proxy for compound flooding hazards in a data-scarce delta. The issues that we tackled here are data scarcity and low computational resources for building flood forecasting models. The proposed approach is suitable for use by local water management agencies in developing countries that encounter these issues.
Olivier Delage, Thierry Portafaix, Hassan Bencherif, Alain Bourdier, and Emma Lagracie
Nonlin. Processes Geophys., 29, 265–277, https://doi.org/10.5194/npg-29-265-2022, https://doi.org/10.5194/npg-29-265-2022, 2022
Short summary
Short summary
The complexity of geophysics systems results in time series with fluctuations at all timescales. The analysis of their variability then consists in decomposing them into a set of basis signals. We developed here a new adaptive filtering method called empirical adaptive wavelet decomposition that optimizes the empirical-mode decomposition existing technique, overcoming its drawbacks using the rigour of wavelets as defined in the recently published empirical wavelet transform method.
Benjamin Walleshauser and Erik Bollt
Nonlin. Processes Geophys., 29, 255–264, https://doi.org/10.5194/npg-29-255-2022, https://doi.org/10.5194/npg-29-255-2022, 2022
Short summary
Short summary
As sea surface temperature (SST) is vital for understanding the greater climate of the Earth and is also an important variable in weather prediction, we propose a model that effectively capitalizes on the reduced complexity of machine learning models while still being able to efficiently predict over a large spatial domain. We find that it is proficient at predicting the SST at specific locations as well as over the greater domain of the Earth’s oceans.
Valerio Lucarini, Larissa Serdukova, and Georgios Margazoglou
Nonlin. Processes Geophys., 29, 183–205, https://doi.org/10.5194/npg-29-183-2022, https://doi.org/10.5194/npg-29-183-2022, 2022
Short summary
Short summary
In most of the investigations on metastable systems, the stochastic forcing is modulated by Gaussian noise. Lévy noise laws, which describe jump processes, have recently received a lot of attention, but much less is known. We study stochastic versions of the Ghil–Sellers energy balance model, and we highlight the fundamental difference between how transitions are performed between the competing warm and snowball states, depending on whether Gaussian or Lévy noise acts as forcing.
Raphael Kriegmair, Yvonne Ruckstuhl, Stephan Rasp, and George Craig
Nonlin. Processes Geophys., 29, 171–181, https://doi.org/10.5194/npg-29-171-2022, https://doi.org/10.5194/npg-29-171-2022, 2022
Short summary
Short summary
Our regional numerical weather prediction models run at kilometer-scale resolutions. Processes that occur at smaller scales not yet resolved contribute significantly to the atmospheric flow. We use a neural network (NN) to represent the unresolved part of physical process such as cumulus clouds. We test this approach on a simplified, yet representative, 1D model and find that the NN corrections vastly improve the model forecast up to a couple of days.
Robert Polzin, Annette Müller, Henning Rust, Peter Névir, and Péter Koltai
Nonlin. Processes Geophys., 29, 37–52, https://doi.org/10.5194/npg-29-37-2022, https://doi.org/10.5194/npg-29-37-2022, 2022
Short summary
Short summary
In this study, a recent algorithmic framework called Direct Bayesian Model Reduction (DBMR) is applied which provides a scalable probability-preserving identification of reduced models directly from data. The stochastic method is tested in a meteorological application towards a model reduction to latent states of smaller scale convective activity conditioned on large-scale atmospheric flow.
Justin Schulte, Frederick Policelli, and Benjamin Zaitchik
Nonlin. Processes Geophys., 29, 1–15, https://doi.org/10.5194/npg-29-1-2022, https://doi.org/10.5194/npg-29-1-2022, 2022
Short summary
Short summary
The skewness of a time series is commonly used to quantify the extent to which positive (negative) deviations from the mean are larger than negative (positive) ones. However, in some cases, traditional skewness may not provide reliable information about time series skewness, motivating the development of a waveform skewness index in this paper. The waveform skewness index is used to show that changes in the relationship strength between climate time series could arise from changes in skewness.
Bo Christiansen
Nonlin. Processes Geophys., 28, 409–422, https://doi.org/10.5194/npg-28-409-2021, https://doi.org/10.5194/npg-28-409-2021, 2021
Short summary
Short summary
In geophysics we often need to analyse large samples of high-dimensional fields. Fortunately but counterintuitively, such high dimensionality can be a blessing, and we demonstrate how this allows simple analytical results to be derived. These results include estimates of correlations between sample members and how the sample mean depends on the sample size. We show that the properties of high dimensionality with success can be applied to climate fields, such as those from ensemble modelling.
Achim Wirth and Bertrand Chapron
Nonlin. Processes Geophys., 28, 371–378, https://doi.org/10.5194/npg-28-371-2021, https://doi.org/10.5194/npg-28-371-2021, 2021
Short summary
Short summary
In non-equilibrium statistical mechanics, which describes forced-dissipative systems such as air–sea interaction, there is no universal probability density function (pdf). Some such systems have recently been demonstrated to exhibit a symmetry called a fluctuation theorem (FT), which strongly constrains the shape of the pdf. Using satellite data, the mechanical power input to the ocean by air–sea interaction following or not a FT is questioned. A FT is found to apply over specific ocean regions.
Camille Besombes, Olivier Pannekoucke, Corentin Lapeyre, Benjamin Sanderson, and Olivier Thual
Nonlin. Processes Geophys., 28, 347–370, https://doi.org/10.5194/npg-28-347-2021, https://doi.org/10.5194/npg-28-347-2021, 2021
Short summary
Short summary
This paper investigates the potential of a type of deep generative neural network to produce realistic weather situations when trained from the climate of a general circulation model. The generator represents the climate in a compact latent space. It is able to reproduce many aspects of the targeted multivariate distribution. Some properties of our method open new perspectives such as the exploration of the extremes close to a given state or how to connect two realistic weather states.
Gerd Schädler and Marcus Breil
Nonlin. Processes Geophys., 28, 231–245, https://doi.org/10.5194/npg-28-231-2021, https://doi.org/10.5194/npg-28-231-2021, 2021
Short summary
Short summary
We used regional climate networks (RCNs) to identify past heatwaves and droughts in Germany. RCNs provide information for whole areas and can provide many details of extreme events. The RCNs were constructed on the grid of the E-OBS data set. Time series correlation was used to construct the networks. Network metrics were compared to standard extreme indices and differed considerably between normal and extreme years. The results show that RCNs can identify severe and moderate extremes.
Abhirup Banerjee, Bedartha Goswami, Yoshito Hirata, Deniz Eroglu, Bruno Merz, Jürgen Kurths, and Norbert Marwan
Nonlin. Processes Geophys., 28, 213–229, https://doi.org/10.5194/npg-28-213-2021, https://doi.org/10.5194/npg-28-213-2021, 2021
Jonathan M. Lilly and Paula Pérez-Brunius
Nonlin. Processes Geophys., 28, 181–212, https://doi.org/10.5194/npg-28-181-2021, https://doi.org/10.5194/npg-28-181-2021, 2021
Short summary
Short summary
Long-lived eddies are an important part of the ocean circulation. Here a dataset for studying eddies in the Gulf of Mexico is created through the analysis of trajectories of drifting instruments. The method involves the identification of quasi-periodic signals, characteristic of particles trapped in eddies, from the displacement records, followed by the creation of a measure of statistical significance. It is expected that this dataset will be of use to other authors studying this region.
Pascal Wang, Daniele Castellana, and Henk A. Dijkstra
Nonlin. Processes Geophys., 28, 135–151, https://doi.org/10.5194/npg-28-135-2021, https://doi.org/10.5194/npg-28-135-2021, 2021
Short summary
Short summary
This paper proposes two improvements to the use of Trajectory-Adaptive Multilevel Sampling, a rare-event algorithm which computes noise-induced transition probabilities. The first improvement uses locally linearised dynamics in order to reduce the arbitrariness associated with defining what constitutes a transition. The second improvement uses empirical transition paths accumulated at high noise in order to formulate the score function which determines the performance of the algorithm.
Cristian Lussana, Thomas N. Nipen, Ivar A. Seierstad, and Christoffer A. Elo
Nonlin. Processes Geophys., 28, 61–91, https://doi.org/10.5194/npg-28-61-2021, https://doi.org/10.5194/npg-28-61-2021, 2021
Short summary
Short summary
An unprecedented amount of rainfall data is available nowadays, such as ensemble model output, weather radar estimates, and in situ observations from networks of both traditional and opportunistic sensors. Nevertheless, the exact amount of precipitation, to some extent, eludes our knowledge. The objective of our study is precipitation reconstruction through the combination of numerical model outputs with observations from multiple data sources.
Dylan Harries and Terence J. O'Kane
Nonlin. Processes Geophys., 27, 453–471, https://doi.org/10.5194/npg-27-453-2020, https://doi.org/10.5194/npg-27-453-2020, 2020
Short summary
Short summary
Different dimension reduction methods may produce profoundly different low-dimensional representations of multiscale systems. We perform a set of case studies to investigate these differences. When a clear scale separation is present, similar bases are obtained using all methods, but when this is not the case some methods may produce representations that are poorly suited for describing features of interest, highlighting the importance of a careful choice of method when designing analyses.
Josh Jacobson, William Kleiber, Michael Scheuerer, and Joseph Bellier
Nonlin. Processes Geophys., 27, 411–427, https://doi.org/10.5194/npg-27-411-2020, https://doi.org/10.5194/npg-27-411-2020, 2020
Short summary
Short summary
Most verification metrics for ensemble forecasts assess the representation of uncertainty at a particular location and time. We study a new diagnostic tool based on fractions of threshold exceedance (FTE) which evaluates an additional important attribute: the ability of ensemble forecast fields to reproduce the spatial structure of observed fields. The utility of this diagnostic tool is demonstrated through simulations and an application to ensemble precipitation forecasts.
Sebastian Lerch, Sándor Baran, Annette Möller, Jürgen Groß, Roman Schefzik, Stephan Hemri, and Maximiliane Graeter
Nonlin. Processes Geophys., 27, 349–371, https://doi.org/10.5194/npg-27-349-2020, https://doi.org/10.5194/npg-27-349-2020, 2020
Short summary
Short summary
Accurate models of spatial, temporal, and inter-variable dependencies are of crucial importance for many practical applications. We review and compare several methods for multivariate ensemble post-processing, where such dependencies are imposed via copula functions. Our investigations utilize simulation studies that mimic challenges occurring in practical applications and allow ready interpretation of the effects of different misspecifications of the numerical weather prediction ensemble.
Jaqueline Lekscha and Reik V. Donner
Nonlin. Processes Geophys., 27, 261–275, https://doi.org/10.5194/npg-27-261-2020, https://doi.org/10.5194/npg-27-261-2020, 2020
Julian Steinheuer and Petra Friederichs
Nonlin. Processes Geophys., 27, 239–252, https://doi.org/10.5194/npg-27-239-2020, https://doi.org/10.5194/npg-27-239-2020, 2020
Short summary
Short summary
Many applications require wind gust estimates at very different atmospheric altitudes, such as in the wind energy sector. However, numerical weather prediction models usually only derive estimates for gusts at 10 m above the land surface. We present a statistical model that gives the hourly peak wind speed. The model is trained based on a weather reanalysis and observations from the Hamburg Weather Mast. Reliable predictions are derived at up to 250 m, even at unobserved intermediate levels.
Moritz N. Lang, Sebastian Lerch, Georg J. Mayr, Thorsten Simon, Reto Stauffer, and Achim Zeileis
Nonlin. Processes Geophys., 27, 23–34, https://doi.org/10.5194/npg-27-23-2020, https://doi.org/10.5194/npg-27-23-2020, 2020
Short summary
Short summary
Statistical post-processing aims to increase the predictive skill of probabilistic ensemble weather forecasts by learning the statistical relation between historical pairs of observations and ensemble forecasts within a given training data set. This study compares four different training schemes and shows that including multiple years of data in the training set typically yields a more stable post-processing while it loses the ability to quickly adjust to temporal changes in the underlying data.
Achim Wirth
Nonlin. Processes Geophys., 26, 457–477, https://doi.org/10.5194/npg-26-457-2019, https://doi.org/10.5194/npg-26-457-2019, 2019
Short summary
Short summary
The conspicuous feature of the atmosphere–ocean system is the large difference in the masses of the two media. In this respect there is a strong analogy to Brownian motion, with light and fast molecules colliding with heavy and slow Brownian particles. I apply the tools of non-equilibrium statistical mechanics for studying Brownian motion to air–sea interaction.
Carsten Abraham, Amber M. Holdsworth, and Adam H. Monahan
Nonlin. Processes Geophys., 26, 401–427, https://doi.org/10.5194/npg-26-401-2019, https://doi.org/10.5194/npg-26-401-2019, 2019
Short summary
Short summary
Atmospheric stably stratified boundary layers display transitions between regimes of sustained and intermittent turbulence. These transitions are not well represented in numerical weather prediction and climate models. A prototype explicitly stochastic turbulence parameterization simulating regime dynamics is presented and tested in an idealized model. Results demonstrate that the approach can improve the regime representation in models.
Jari-Pekka Nousu, Matthieu Lafaysse, Matthieu Vernay, Joseph Bellier, Guillaume Evin, and Bruno Joly
Nonlin. Processes Geophys., 26, 339–357, https://doi.org/10.5194/npg-26-339-2019, https://doi.org/10.5194/npg-26-339-2019, 2019
Short summary
Short summary
Forecasting the height of new snow is crucial for avalanche hazard, road viability, ski resorts and tourism. The numerical models suffer from systematic and significant errors which are misleading for the final users. Here, we applied for the first time a state-of-the-art statistical method to correct ensemble numerical forecasts of the height of new snow from their statistical link with measurements in French Alps and Pyrenees. Thus the realism of automatic forecasts can be quickly improved.
Jürgen Kurths, Ankit Agarwal, Roopam Shukla, Norbert Marwan, Maheswaran Rathinasamy, Levke Caesar, Raghavan Krishnan, and Bruno Merz
Nonlin. Processes Geophys., 26, 251–266, https://doi.org/10.5194/npg-26-251-2019, https://doi.org/10.5194/npg-26-251-2019, 2019
Short summary
Short summary
We examined the spatial diversity of Indian rainfall teleconnection at different timescales, first by identifying homogeneous communities and later by computing non-linear linkages between the identified communities (spatial regions) and dominant climatic patterns, represented by climatic indices such as El Nino–Southern Oscillation, Indian Ocean Dipole, North Atlantic Oscillation, Pacific Decadal Oscillation and Atlantic Multi-Decadal Oscillation.
Justin A. Schulte
Nonlin. Processes Geophys., 26, 91–108, https://doi.org/10.5194/npg-26-91-2019, https://doi.org/10.5194/npg-26-91-2019, 2019
Short summary
Short summary
Statistical hypothesis tests in wavelet analysis are used to asses the likelihood that time series features are noise. The choice of test will determine which features emerge as a signal. Tests based on area do poorly at distinguishing abrupt fluctuations from periodic behavior, unlike tests based on arclength that do better. The application of the tests suggests that there are features in Indian rainfall time series that emerge from background noise.
Jonathan Demaeyer and Stéphane Vannitsem
Nonlin. Processes Geophys., 25, 605–631, https://doi.org/10.5194/npg-25-605-2018, https://doi.org/10.5194/npg-25-605-2018, 2018
Short summary
Short summary
We investigate the modeling of the effects of the unresolved scales on the large scales of the coupled ocean–atmosphere model MAOOAM. Two different physically based stochastic methods are considered and compared, in various configurations of the model. Both methods show remarkable performances and are able to model fundamental changes in the model dynamics. Ways to improve the parameterizations' implementation are also proposed.
Adam H. Monahan
Nonlin. Processes Geophys., 25, 335–353, https://doi.org/10.5194/npg-25-335-2018, https://doi.org/10.5194/npg-25-335-2018, 2018
Short summary
Short summary
Bivariate probability density functions (pdfs) of wind speed characterize the relationship between speeds at two different locations or times. This study develops such pdfs of wind speed from distributions of the components, following a well-established approach for univariate distributions. The ability of these models to characterize example observed datasets is assessed. The mathematical complexity of these models suggests further extensions of this line of reasoning may not be practical.
Berenice Rojo-Garibaldi, David Alberto Salas-de-León, María Adela Monreal-Gómez, Norma Leticia Sánchez-Santillán, and David Salas-Monreal
Nonlin. Processes Geophys., 25, 291–300, https://doi.org/10.5194/npg-25-291-2018, https://doi.org/10.5194/npg-25-291-2018, 2018
Short summary
Short summary
Hurricanes are complex systems that carry large amounts of energy. Its impact produces, most of the time, natural disasters involving the loss of human lives and of materials and infrastructure that is accounted for in billions of US dollars. Not everything is negative as hurricanes are the main source of rainwater for the regions where they develop. In this study we make a nonlinear analysis of the time series obtained from 1749 to 2012 of the hurricane occurrence in the Gulf of Mexico.
Guillaume Lenoir and Michel Crucifix
Nonlin. Processes Geophys., 25, 145–173, https://doi.org/10.5194/npg-25-145-2018, https://doi.org/10.5194/npg-25-145-2018, 2018
Short summary
Short summary
We develop a general framework for the frequency analysis of irregularly sampled time series. We also design a test of significance against a general background noise which encompasses the Gaussian white or red noise. Our results generalize and unify methods developed in the fields of geosciences, engineering, astronomy and astrophysics. All the analysis tools presented in this paper are available to the reader in the Python package WAVEPAL.
Guillaume Lenoir and Michel Crucifix
Nonlin. Processes Geophys., 25, 175–200, https://doi.org/10.5194/npg-25-175-2018, https://doi.org/10.5194/npg-25-175-2018, 2018
Short summary
Short summary
There is so far no general framework for handling the continuous wavelet transform when the time sampling is irregular. Here we provide such a framework with the Morlet wavelet, based on the results of part I of this study. We also design a test of significance against a general background noise which encompasses the Gaussian white or red noise. All the analysis tools presented in this article are available to the reader in the Python package WAVEPAL.
Valerie N. Livina, Albert Brouwer, Peter Harris, Lian Wang, Kostas Sotirakopoulos, and Stephen Robinson
Nonlin. Processes Geophys., 25, 89–97, https://doi.org/10.5194/npg-25-89-2018, https://doi.org/10.5194/npg-25-89-2018, 2018
Short summary
Short summary
We have applied tipping point analysis to a large record of ocean acoustic data to identify the main components of the acoustic dynamical system: long-term and seasonal trends, system states and fluctuations. We reconstructed a one-dimensional stochastic model equation to approximate the acoustic dynamical system. We have found a signature of El Niño events in the deep ocean acoustic data near the southwest Australian coast, which proves the investigative power of the tipping point methodology.
Marc Bengulescu, Philippe Blanc, and Lucien Wald
Nonlin. Processes Geophys., 25, 19–37, https://doi.org/10.5194/npg-25-19-2018, https://doi.org/10.5194/npg-25-19-2018, 2018
Short summary
Short summary
We employ the Hilbert–Huang transform to study the temporal variability in time series of daily means of the surface solar irradiance (SSI) at different locations around the world. The data have a significant spectral peak corresponding to the yearly variability cycle and feature quasi-stochastic high-frequency "weather noise", irrespective of the geographical location or of the local climate. Our findings can improve models for estimating SSI from satellite images or forecasts of the SSI.
Manfred Mudelsee and Miguel A. Bermejo
Nonlin. Processes Geophys., 24, 737–744, https://doi.org/10.5194/npg-24-737-2017, https://doi.org/10.5194/npg-24-737-2017, 2017
Short summary
Short summary
Risk analysis of extremes has high socioeconomic relevance. Of crucial interest is the tail probability, P, of the distribution of a variable, which is the chance of observing a value equal to or greater than a certain threshold value, x. Many variables in geophysical systems (e.g. climate) show heavy tail behaviour, where P may be rather large. In particular, P decreases with x as a power law that is described by a parameter, α. We present an improved method to estimate α on data.
Kathrin Padberg-Gehle and Christiane Schneide
Nonlin. Processes Geophys., 24, 661–671, https://doi.org/10.5194/npg-24-661-2017, https://doi.org/10.5194/npg-24-661-2017, 2017
Short summary
Short summary
Transport and mixing processes in fluid flows are crucially influenced by coherent structures, such as eddies, gyres, or jets in geophysical flows. We propose a very simple and computationally efficient approach for analyzing coherent behavior in fluid flows. The central object is a flow network constructed directly from particle trajectories. The network's local and spectral properties are shown to give a very good indication of coherent as well as mixing regions in the underlying flow.
Ankit Agarwal, Norbert Marwan, Maheswaran Rathinasamy, Bruno Merz, and Jürgen Kurths
Nonlin. Processes Geophys., 24, 599–611, https://doi.org/10.5194/npg-24-599-2017, https://doi.org/10.5194/npg-24-599-2017, 2017
Short summary
Short summary
Extreme events such as floods and droughts result from synchronization of different natural processes working at multiple timescales. Investigation on an observation timescale will not reveal the inherent underlying dynamics triggering these events. This paper develops a new method based on wavelets and event synchronization to unravel the hidden dynamics responsible for such sudden events. This method is tested with synthetic and real-world cases and the results are promising.
Jonathan M. Lilly, Adam M. Sykulski, Jeffrey J. Early, and Sofia C. Olhede
Nonlin. Processes Geophys., 24, 481–514, https://doi.org/10.5194/npg-24-481-2017, https://doi.org/10.5194/npg-24-481-2017, 2017
Short summary
Short summary
This work arose from a desire to understand the nature of particle motions in turbulence. We sought a simple conceptual model that could describe such motions, then realized that this model could be applicable to an array of other problems. The basic idea is to create a string of random numbers, called a stochastic process, that mimics the properties of particle trajectories. This model could be useful in making best use of data from freely drifting instruments tracking the ocean currents.
Finn Müller-Hansen, Manoel F. Cardoso, Eloi L. Dalla-Nora, Jonathan F. Donges, Jobst Heitzig, Jürgen Kurths, and Kirsten Thonicke
Nonlin. Processes Geophys., 24, 113–123, https://doi.org/10.5194/npg-24-113-2017, https://doi.org/10.5194/npg-24-113-2017, 2017
Short summary
Short summary
Deforestation and subsequent land uses in the Brazilian Amazon have huge impacts on greenhouse gas emissions, local climate and biodiversity. To better understand these land-cover changes, we apply complex systems methods uncovering spatial patterns in regional transition probabilities between land-cover types, which we estimate using maps derived from satellite imagery. The results show clusters of similar land-cover dynamics and thus complement studies at the local scale.
Cited articles
Agrawal, R. and Srikant, R.: Fast algorithms for mining association rules in large databases, in: VLDB 1994, edited by: Bocca, J., Jarke, M., and Zaniolo, C., 487–499, 1994.
Agrawal, R., Imieli\'nski, T., and Swami, A.: Mining association rules between sets of items in large databases, Sigmod Record, 22, 207–216, 1993.
Bailey, T. L. and Gribskov, M.: Combining evidence using p-values: application to sequence homology searches, Bioinformatics, 14, 48–54, 1998.
Borboudakis, G., Triantafilou, S., Lagani, V., and Tsamardinos, I.: A constraint-based approach to incorporate prior knowledge in causal models, in: ESANN'2011, 2011.
Bühlmann, P.: Causal statistical inference in high dimensions, Math. Meth. of OR, 77, 357–370, 2013.
Chang, P., Yamagata, T., Schopf, P., Behera, S. K., Carton, J., Kessler, W. S., Meyers, G., Qu, T., Schott, F., Shetye, S., and Xie, S.-P.: Climate Fluctuations of Tropical Coupled Systems–The Role of Ocean Dynamics, J. Climate, 19, 5122–5174, 2006.
de Kock, M., Le, H., Tadross, M., and Potgeiter, A.: Weather Forecasting Using Dynamic Bayesian Networks, Tech. Rep., University of Cape Town, 2008.
Dean, T. and Kanazawa, K.: A Model for Reasoning About Persistence and Causation, Tech. Rep., Brown University, Providence, RI, USA, 1989.
Fisher, R. A.: Statistical Methods for Research Workers, Oliver & Boyd, Edinburgh, 1932.
Friedman, N., Murphy, K., and Russell, S.: Learning the structure of dynamic probabilistic networks, in: UAI'98, edited by:P Cooper, G. and Moral, S., 139–147, 1998.
Gonçalves, G.: Analysis of interpolation errors in urban digital surface models created from Lidar data, 7th International Symposium on Spatial Accuracy Assessment in Natural Resources and Environmental Sciences, edited by: Caetano, M. and Painho, M., 160–168, 2006.
Gonzalez, D. L., Pendse, S. V., Padmanabhan, K., Angus, M. P., Tetteh, I. K., Srinivas, S., Villanes, A., Semazzi, F., Kumar, V., and Samatova, N. F.: Coupled Heterogeneous Association Rule Mining (CHARM): Application toward Inference of Modulatory Climate Relationships, in: 2013 IEEE 13th International Conference on Data Mining (ICDM'13), 1055–1060, IEEE, 2013.
Grossman, I. and Klotzbach, P.: A review of North Atlantic modes of natural variability and their driving mechanisms, J. Geophys. Res.-Atmos., 114, D24107, https://doi.org/10.1029/2009JD012728, 2009.
Hallett, T., Coulson, T., Pilkington, J., Clutton, T., Pemberton, J., and Grenfell, B.: Why large-scale climate indices seem to predict ecological processes better than local weather, Nature, 430, 71–75, 2004.
Havlin, S., Kenett, D., Ben-Jacob, E., Bunde, A., Cohen, R., Hermann, H., Kantelhardt, J., Kertész, J., Kirkpatrick, S., Kurths, J., Portugali, J., and Solomon, S.: Challenges in network science: Applications to infrastructures, climate, social systems and economics, The Eur. Phys. J. Special Top., 214, 273–293, 2012.
Huang, Y., Zhang, L., and Zhang, P.: A Framework for Mining Sequential Patterns from Spatio-Temporal Event Data Sets, IEEE T. Knowl. Data En., 20, 433–448, 2008.
Hurrell, J.: Decadal Trends in the North Atlantic Oscillation: Regional Temperatures and Precipitation, Science, 269, 676–679, 1995.
Hyttinen, A., Hoyer, P. O., Eberhardt, F., and Järvisalo, M.: Discovering Cyclic Causal Models with Latent Variables: A General SAT-Based Procedure, CoRR, abs/1309.6836, 2013.
Janicot, S., Moron, V., and Fontaine, B.: Sahel droughts and ENSO dynamics, Geophys. Res. Lett., 23, 515–518, 1996.
Janicot, S., Trzaska, S., and Poccard, I.: Summer Sahel-ENSO teleconnection and decadal time scale SST variations, Clim. Dynam., 18, 303–320, 2001.
Kidson, J. W. and Newell, R. E.: African rainfall and its relation to the upper air circulation, Q. J. Roy. Meteor. Soc., 103, 441–456, 1977.
Li, X., Ren, Q., Weng, Y., Cai, H., Zhu, Y., and Zhang, Y.: SCGPred: A Score-based Method for Gene Structure Prediction by Combining Multiple Sources of Evidence, Genomics, Proteom. Bioinform., 6, 175–185, 2008.
Lu, J.: The dynamics of the Indian Ocean sea surface temperature forcing of Sahel drought, Clim. Dynam., 33, 445–460, 2009.
Manatsa, D., Chipindu, B., and K., B. S.: Shifts in IOD and their impacts East Africa rainfall, Theor. Appl. Climatol., 110, 115–128, 2012.
Marshall, J., Kushnir, Y., Battisti, D., Chang, P., Czaja, A., Dickson, R., Hurrell, J., McCartney, M., Saravanan, R., and Visbeck, M.: North Atlantic climate variability: phenomena, impacts and mechanisms, Int. J. Climatol., 21, 1863–1898, 2001.
Meinshausen, N.: Relaxed Lasso, Comput. Stat. Data An., 52, 374–393, 2007.
Mortimore, M. J. and Adams, W. M.: Farmer adaptation, change and 'crisis' in the Sahel, Global Environ. Change, 11, 49–57, 2001.
Murphy, K. P.: Dynamic Bayesian Networks: Representation, Inference and Learning, PhD thesis, University Of California, Berkeley, 2002.
NCEP/NCAR: NCEP/NCAR Climate Index TimeSeries Data, available at: http://esrl.noaa.gov/psd/data/climateindices/list, last access: 1 February 2014.
Nicholson, S. E.: An Analysis of the ENSO Signal in the Tropical Atlantic and Western Indian Oceans, Int. J. Climatol., 17, 345–375, 1997.
Nicholson, S. E.: On the factors modulating the intensity of the tropical rainbelt over West Africa, Int. J. Climatol., 29, 673–689, 2009.
NOAA: NOAA Glossary, available at: http://nws.noaa.gov/climate/help/glossary.php, last access: 1 February 2014.
NOAA/OAR/ESRL: NOAA/OAR/ESRL PSD, available at: http://esrl.noaa.gov/psd/data/gridded/data.UDel_AirT_Precip.html, last access: 1 February 2014
Pendse, S., Tetteh, I., Semazzi, F., Kumar, V., and Samatova, N.: Toward Data-driven, Semi-automatic Inference of Phenomenological Physical Models: Application to Eastern Sahel Rainfall, in: SDM '12, edited by: Ghosh, J., Liu, H., Davidson, I., Domencioni, C., and Kamath, C., 2012.
Polo, I., Rodríguez, B., Losada, T., and García, J.: Tropical Atlantic Variability Modes (1979-2002): Time-Evolving SST Modes Related to West African Rainfall, J. Climate, 21, 6457–6475, 2008.
NOAA/PSD: NOAA PSD Reanalysis data, available at: http://esrl.noaa.gov/psd/data/reanalysis/reanalysis.shtml, last access: 1 February 2014.
Rowell, D. P.: The Impact of Mediterranean SSTs on the Sahelian Rainfall Season., J. Climate, 16, 849–862, 2003.
Saji, N. H., Goswami, B. N., Vinayachandran, P. N., and Yamagata, T.: A dipole mode in the tropical Indian Ocean, Nature, 401, 360–363, 1999.
Schreck, C. J. and Semazzi, F. H.: Variability of the recent climate of eastern Africa, Int. J. Climatol., 24, 681–701, 2004.
Spirtes, P.: Introduction to Causal Inference, J. Mach. Learn. Res., 11, 1643–1662, available at: http://dl.acm.org/citation.cfm?id=1756006.1859905 (last access: 1 February 2014), 2010.
Sultan, B., Labadi, K., Guégan, J.-F., and Janicot, S.: Climate drives the meningitis epidemics onset in West Africa, PLoS medicine, 2, E6–E6, 2005.
Sutton, R. T., Jewson, S. P., and Rowell, D. P.: The Elements of Climate Variability in the Tropical Atlantic Region., J. Climate, 13, 3261–3284, 2000.
Tan, P., Steinbach, M., Kumar, V., Potter, C., Klooster, C., and Torregrosa, A.: Finding Spatio-Temporal Patterns in Earth Science Data, KDD 2001 Workshop on Temporal Data Mining, 26 August 2001, San Francisco, CA, 2001.
Tan, P., Steinback, M., and Kumar, V.: Association Analysis: Basic Concepts and Algorithms, Introduction to Data Mining, Pearson, 327–396, 2006.
Tetteh, I. K.: West African Seasonal Climate Variability and Predictability, PhD thesis, North Carolina State University, 2012.
Tibshirani, R.: Regression shrinkage and selection via the Lasso, J. Roy. Stat. Soc. B, 58, 267–288, 1994.
Wilks, D. S.: Statistical Methods in the Atmospheric Sciences: An Introduction, Elsevier, 2006.
Zaki, M.: Generating non-redundant association rules, in: KDD '00, edited by: Simoff, S. and Zaïane, O., 34–43, ACM, 2000.
Zebiak, S. E.: Air-Sea Interaction in the Equatorial Atlantic Region, J. Climate, 6, 1567–1586, 1993.
Zhang, R. and Delworth, T. L.: Impact of Atlantic multidecadal oscillations on India/Sahel rainfall and Atlantic hurricanes, J. Geophys. Res., 33, L17712, https://doi.org/10.1029/2006GL026267, 2006.
Zou, C. and Feng, J.: Granger causality vs. dynamic Bayesian network inference: a comparative study, BMC Bioinform., 10, 1–17, 2009.
Short summary
We applied coupled heterogeneous association rule mining (CHARM), Lasso
multivariate regression, and dynamic Bayesian networks to find relationships
within a complex system, and explored means with which to obtain a consensus
result from the application of such varied methodologies. Using this fusion of approaches, we identified relationships among climate factors that fall into two categories: well-known associations from prior knowledge, and putative links that invite further research.
We applied coupled heterogeneous association rule mining (CHARM), Lasso
multivariate...
