Articles | Volume 26, issue 2
https://doi.org/10.5194/npg-26-91-2019
© Author(s) 2019. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/npg-26-91-2019
© Author(s) 2019. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Research article
| 
14 Jun 2019
Research article |
| 14 Jun 2019
| 14 Jun 2019
Statistical hypothesis testing in wavelet analysis: theoretical developments and applications to Indian rainfall
Justin A. Schulte
CORRESPONDING AUTHOR
Science Systems and Applications, Inc., Lanham, Maryland 20706, USA
Related authors
Justin Schulte, Frederick Policielli, and Benjamin Zaitchik
Hydrol. Earth Syst. Sci., 24, 5473–5489, https://doi.org/10.5194/hess-24-5473-2020, https://doi.org/10.5194/hess-24-5473-2020, 2020
Short summary
Short summary
Wavelet coherence is now a commonly used method for detecting scale-dependent relationships between time series. In this study, the concept of wavelet coherence is generalized to higher-order wavelet coherence methods that quantify the relationship between higher-order statistical moments associated with two time series. The methods are applied to the El Niño–Southern Oscillation (ENSO) and the Indian monsoon to show that the ENSO–Indian monsoon relationship is impacted by ENSO nonlinearity.
Justin A. Schulte and Sukyoung Lee
Ocean Sci., 15, 161–178, https://doi.org/10.5194/os-15-161-2019, https://doi.org/10.5194/os-15-161-2019, 2019
Short summary
Short summary
Connections between Long Island Sound (LIS) water temperature variability and modes of tropical sea surface temperature (SST) variability have yet to be explored. It is shown that intense LIS cold-water temperature events are related to central equatorial Pacific SSTs. The decay phase of such events may be related to canonical El Niño events. Furthermore, a ridge–trough atmospheric pattern related to LIS water temperature variability fluctuates coherently with central equatorial Pacific SSTs.
Justin A. Schulte
Nonlin. Processes Geophys., 23, 257–267, https://doi.org/10.5194/npg-23-257-2016, https://doi.org/10.5194/npg-23-257-2016, 2016
Justin A. Schulte
Nonlin. Processes Geophys., 23, 45–57, https://doi.org/10.5194/npg-23-45-2016, https://doi.org/10.5194/npg-23-45-2016, 2016
Short summary
Short summary
The paper presents a new method called cumulative areawise testing that allows scientists to better extract important signals from geophysical time series. The method was found to be able to distinguish aspects of time series that are random from those of potential physical importance better than existing methods in wavelet analysis.
J. A. Schulte, C. Duffy, and R. G. Najjar
Nonlin. Processes Geophys., 22, 139–156, https://doi.org/10.5194/npg-22-139-2015, https://doi.org/10.5194/npg-22-139-2015, 2015
Justin Schulte, Frederick Policielli, and Benjamin Zaitchik
Hydrol. Earth Syst. Sci., 24, 5473–5489, https://doi.org/10.5194/hess-24-5473-2020, https://doi.org/10.5194/hess-24-5473-2020, 2020
Short summary
Short summary
Wavelet coherence is now a commonly used method for detecting scale-dependent relationships between time series. In this study, the concept of wavelet coherence is generalized to higher-order wavelet coherence methods that quantify the relationship between higher-order statistical moments associated with two time series. The methods are applied to the El Niño–Southern Oscillation (ENSO) and the Indian monsoon to show that the ENSO–Indian monsoon relationship is impacted by ENSO nonlinearity.
Justin A. Schulte and Sukyoung Lee
Ocean Sci., 15, 161–178, https://doi.org/10.5194/os-15-161-2019, https://doi.org/10.5194/os-15-161-2019, 2019
Short summary
Short summary
Connections between Long Island Sound (LIS) water temperature variability and modes of tropical sea surface temperature (SST) variability have yet to be explored. It is shown that intense LIS cold-water temperature events are related to central equatorial Pacific SSTs. The decay phase of such events may be related to canonical El Niño events. Furthermore, a ridge–trough atmospheric pattern related to LIS water temperature variability fluctuates coherently with central equatorial Pacific SSTs.
Justin A. Schulte
Nonlin. Processes Geophys., 23, 257–267, https://doi.org/10.5194/npg-23-257-2016, https://doi.org/10.5194/npg-23-257-2016, 2016
Justin A. Schulte
Nonlin. Processes Geophys., 23, 45–57, https://doi.org/10.5194/npg-23-45-2016, https://doi.org/10.5194/npg-23-45-2016, 2016
Short summary
Short summary
The paper presents a new method called cumulative areawise testing that allows scientists to better extract important signals from geophysical time series. The method was found to be able to distinguish aspects of time series that are random from those of potential physical importance better than existing methods in wavelet analysis.
J. A. Schulte, C. Duffy, and R. G. Najjar
Nonlin. Processes Geophys., 22, 139–156, https://doi.org/10.5194/npg-22-139-2015, https://doi.org/10.5194/npg-22-139-2015, 2015
Related subject area
Subject: Time series, machine learning, networks, stochastic processes, extreme events | Topic: Climate, atmosphere, ocean, hydrology, cryosphere, biosphere
Evaluation of forecasts by a global data-driven weather model with and without probabilistic post-processing at Norwegian stations
Characterisation of Dansgaard-Oeschger events in palaeoclimate time series using the Matrix Profile
The sampling method for optimal precursors of El Niño–Southern Oscillation events
A comparison of two causal methods in the context of climate analyses
A two-fold deep-learning strategy to correct and downscale winds over mountains
Downscaling of surface wind forecasts using convolutional neural networks
Superstatistical analysis of sea surface currents in the Gulf of Trieste, measured by high-frequency radar, and its relation to wind regimes using the maximum-entropy principle
Representation learning with unconditional denoising diffusion models for dynamical systems
Physically constrained covariance inflation from location uncertainty
Data-driven methods to estimate the committor function in conceptual ocean models
Exploring meteorological droughts' spatial patterns across Europe through complex network theory
Rain process models and convergence to point processes
Integrated hydrodynamic and machine learning models for compound flooding prediction in a data-scarce estuarine delta
Empirical adaptive wavelet decomposition (EAWD): an adaptive decomposition for the variability analysis of observation time series in atmospheric science
Predicting sea surface temperatures with coupled reservoir computers
Lévy noise versus Gaussian-noise-induced transitions in the Ghil–Sellers energy balance model
Using neural networks to improve simulations in the gray zone
Direct Bayesian model reduction of smaller scale convective activity conditioned on large-scale dynamics
A waveform skewness index for measuring time series nonlinearity and its applications to the ENSO–Indian monsoon relationship
The blessing of dimensionality for the analysis of climate data
Empirical evidence of a fluctuation theorem for the wind mechanical power input into the ocean
Producing realistic climate data with generative adversarial networks
Identification of droughts and heatwaves in Germany with regional climate networks
Recurrence analysis of extreme event-like data
Extracting statistically significant eddy signals from large Lagrangian datasets using wavelet ridge analysis, with application to the Gulf of Mexico
Improvements to the use of the Trajectory-Adaptive Multilevel Sampling algorithm for the study of rare events
Ensemble-based statistical interpolation with Gaussian anamorphosis for the spatial analysis of precipitation
Applications of matrix factorization methods to climate data
Beyond univariate calibration: verifying spatial structure in ensembles of forecast fields
Simulation-based comparison of multivariate ensemble post-processing methods
Detecting dynamical anomalies in time series from different palaeoclimate proxy archives using windowed recurrence network analysis
Vertical profiles of wind gust statistics from a regional reanalysis using multivariate extreme value theory
Remember the past: a comparison of time-adaptive training schemes for non-homogeneous regression
On fluctuating momentum exchange in idealised models of air–sea interaction
A prototype stochastic parameterization of regime behaviour in the stably stratified atmospheric boundary layer
Statistical post-processing of ensemble forecasts of the height of new snow
Unravelling the spatial diversity of Indian precipitation teleconnections via a non-linear multi-scale approach
Comparison of stochastic parameterizations in the framework of a coupled ocean–atmosphere model
Idealized models of the joint probability distribution of wind speeds
Nonlinear analysis of the occurrence of hurricanes in the Gulf of Mexico and the Caribbean Sea
A general theory on frequency and time–frequency analysis of irregularly sampled time series based on projection methods – Part 1: Frequency analysis
A general theory on frequency and time–frequency analysis of irregularly sampled time series based on projection methods – Part 2: Extension to time–frequency analysis
Tipping point analysis of ocean acoustic noise
On the intrinsic timescales of temporal variability in measurements of the surface solar radiation
Optimal heavy tail estimation – Part 1: Order selection
Network-based study of Lagrangian transport and mixing
Multi-scale event synchronization analysis for unravelling climate processes: a wavelet-based approach
Fractional Brownian motion, the Matérn process, and stochastic modeling of turbulent dispersion
A matrix clustering method to explore patterns of land-cover transitions in satellite-derived maps of the Brazilian Amazon
Parameterization of stochastic multiscale triads
John Bjørnar Bremnes, Thomas N. Nipen, and Ivar A. Seierstad
Nonlin. Processes Geophys., 31, 247–257, https://doi.org/10.5194/npg-31-247-2024, https://doi.org/10.5194/npg-31-247-2024, 2024
Short summary
Short summary
During the last 2 years, tremendous progress has been made in global data-driven weather models trained on reanalysis data. In this study, the Pangu-Weather model is compared to several numerical weather prediction models with and without probabilistic post-processing for temperature and wind speed forecasting. The results confirm that global data-driven models are promising for operational weather forecasting and that post-processing can improve these forecasts considerably.
Susana Barbosa, Maria Eduarda Silva, and Denis-Didier Rousseau
Nonlin. Processes Geophys. Discuss., https://doi.org/10.5194/npg-2024-13, https://doi.org/10.5194/npg-2024-13, 2024
Revised manuscript accepted for NPG
Short summary
Short summary
The characterisation of abrupt transitions in palaeoclimate records allows the understanding of millennial climate variability and of potential tipping points in the context of current climate change. In our study an algorithmic method, the matrix profile, is employed to characterise abrupt warmings designated as Dansgaard-Oeschger (DO) events and to identify the most similar transitions in the palaeoclimate time series.
Bin Shi and Junjie Ma
Nonlin. Processes Geophys., 31, 165–174, https://doi.org/10.5194/npg-31-165-2024, https://doi.org/10.5194/npg-31-165-2024, 2024
Short summary
Short summary
Different from traditional deterministic optimization algorithms, we implement the sampling method to compute the conditional nonlinear optimal perturbations (CNOPs) in the realistic and predictive coupled ocean–atmosphere model, which reduces the first-order information to the zeroth-order one, avoiding the high-cost computation of the gradient. The numerical performance highlights the importance of stochastic optimization algorithms to compute CNOPs and capture initial optimal precursors.
David Docquier, Giorgia Di Capua, Reik V. Donner, Carlos A. L. Pires, Amélie Simon, and Stéphane Vannitsem
Nonlin. Processes Geophys., 31, 115–136, https://doi.org/10.5194/npg-31-115-2024, https://doi.org/10.5194/npg-31-115-2024, 2024
Short summary
Short summary
Identifying causes of specific processes is crucial in order to better understand our climate system. Traditionally, correlation analyses have been used to identify cause–effect relationships in climate studies. However, correlation does not imply causation, which justifies the need to use causal methods. We compare two independent causal methods and show that these are superior to classical correlation analyses. We also find some interesting differences between the two methods.
Louis Le Toumelin, Isabelle Gouttevin, Clovis Galiez, and Nora Helbig
Nonlin. Processes Geophys., 31, 75–97, https://doi.org/10.5194/npg-31-75-2024, https://doi.org/10.5194/npg-31-75-2024, 2024
Short summary
Short summary
Forecasting wind fields over mountains is of high importance for several applications and particularly for understanding how wind erodes and disperses snow. Forecasters rely on operational wind forecasts over mountains, which are currently only available on kilometric scales. These forecasts can also be affected by errors of diverse origins. Here we introduce a new strategy based on artificial intelligence to correct large-scale wind forecasts in mountains and increase their spatial resolution.
Florian Dupuy, Pierre Durand, and Thierry Hedde
Nonlin. Processes Geophys., 30, 553–570, https://doi.org/10.5194/npg-30-553-2023, https://doi.org/10.5194/npg-30-553-2023, 2023
Short summary
Short summary
Forecasting near-surface winds over complex terrain requires high-resolution numerical weather prediction models, which drastically increase the duration of simulations and hinder them in running on a routine basis. A faster alternative is statistical downscaling. We explore different ways of calculating near-surface wind speed and direction using artificial intelligence algorithms based on various convolutional neural networks in order to find the best approach for wind downscaling.
Sofia Flora, Laura Ursella, and Achim Wirth
Nonlin. Processes Geophys., 30, 515–525, https://doi.org/10.5194/npg-30-515-2023, https://doi.org/10.5194/npg-30-515-2023, 2023
Short summary
Short summary
An increasing amount of data allows us to move from low-order moments of fluctuating observations to their PDFs. We found the analytical fat-tailed PDF form (a combination of Gaussian and two-exponential convolutions) for 2 years of sea surface current increments in the Gulf of Trieste, using superstatistics and the maximum-entropy principle twice: on short and longer timescales. The data from different wind regimes follow the same analytical PDF, pointing towards a universal behaviour.
Tobias Sebastian Finn, Lucas Disson, Alban Farchi, Marc Bocquet, and Charlotte Durand
EGUsphere, https://doi.org/10.5194/egusphere-2023-2261, https://doi.org/10.5194/egusphere-2023-2261, 2023
Short summary
Short summary
We train neural networks as denoising diffusion models for state generation in the Lorenz 1963 system and demonstrate that they learn an internal representation of the system. We make use of this learned representation and the pre-trained model in two downstream tasks: surrogate modelling and ensemble generation. For both tasks, the diffusion model can outperform other more common approaches. Thus, we see a potential of representation learning with diffusion models for dynamical systems.
Yicun Zhen, Valentin Resseguier, and Bertrand Chapron
Nonlin. Processes Geophys., 30, 237–251, https://doi.org/10.5194/npg-30-237-2023, https://doi.org/10.5194/npg-30-237-2023, 2023
Short summary
Short summary
This paper provides perspective that the displacement vector field of physical state fields should be determined by the tensor fields associated with the physical fields. The advantage of this perspective is that certain physical quantities can be conserved while applying a displacement vector field to transfer the original physical field. A direct application of this perspective is the physically constrained covariance inflation scheme proposed in this paper.
Valérian Jacques-Dumas, René M. van Westen, Freddy Bouchet, and Henk A. Dijkstra
Nonlin. Processes Geophys., 30, 195–216, https://doi.org/10.5194/npg-30-195-2023, https://doi.org/10.5194/npg-30-195-2023, 2023
Short summary
Short summary
Computing the probability of occurrence of rare events is relevant because of their high impact but also difficult due to the lack of data. Rare event algorithms are designed for that task, but their efficiency relies on a score function that is hard to compute. We compare four methods that compute this function from data and measure their performance to assess which one would be best suited to be applied to a climate model. We find neural networks to be most robust and flexible for this task.
Domenico Giaquinto, Warner Marzocchi, and Jürgen Kurths
Nonlin. Processes Geophys., 30, 167–181, https://doi.org/10.5194/npg-30-167-2023, https://doi.org/10.5194/npg-30-167-2023, 2023
Short summary
Short summary
Despite being among the most severe climate extremes, it is still challenging to assess droughts’ features for specific regions. In this paper we study meteorological droughts in Europe using concepts derived from climate network theory. By exploring the synchronization in droughts occurrences across the continent we unveil regional clusters which are individually examined to identify droughts’ geographical propagation and source–sink systems, which could potentially support droughts’ forecast.
Scott Hottovy and Samuel N. Stechmann
Nonlin. Processes Geophys., 30, 85–100, https://doi.org/10.5194/npg-30-85-2023, https://doi.org/10.5194/npg-30-85-2023, 2023
Short summary
Short summary
Rainfall is erratic and difficult to predict. Thus, random models are often used to describe rainfall events. Since many of these random models are based more on statistics than physical laws, it is desirable to develop connections between the random statistical models and the underlying physics of rain. Here, a physics-based model is shown to converge to a statistics-based model, which helps to provide a physical basis for the statistics-based model.
Joko Sampurno, Valentin Vallaeys, Randy Ardianto, and Emmanuel Hanert
Nonlin. Processes Geophys., 29, 301–315, https://doi.org/10.5194/npg-29-301-2022, https://doi.org/10.5194/npg-29-301-2022, 2022
Short summary
Short summary
In this study, we successfully built and evaluated machine learning models for predicting water level dynamics as a proxy for compound flooding hazards in a data-scarce delta. The issues that we tackled here are data scarcity and low computational resources for building flood forecasting models. The proposed approach is suitable for use by local water management agencies in developing countries that encounter these issues.
Olivier Delage, Thierry Portafaix, Hassan Bencherif, Alain Bourdier, and Emma Lagracie
Nonlin. Processes Geophys., 29, 265–277, https://doi.org/10.5194/npg-29-265-2022, https://doi.org/10.5194/npg-29-265-2022, 2022
Short summary
Short summary
The complexity of geophysics systems results in time series with fluctuations at all timescales. The analysis of their variability then consists in decomposing them into a set of basis signals. We developed here a new adaptive filtering method called empirical adaptive wavelet decomposition that optimizes the empirical-mode decomposition existing technique, overcoming its drawbacks using the rigour of wavelets as defined in the recently published empirical wavelet transform method.
Benjamin Walleshauser and Erik Bollt
Nonlin. Processes Geophys., 29, 255–264, https://doi.org/10.5194/npg-29-255-2022, https://doi.org/10.5194/npg-29-255-2022, 2022
Short summary
Short summary
As sea surface temperature (SST) is vital for understanding the greater climate of the Earth and is also an important variable in weather prediction, we propose a model that effectively capitalizes on the reduced complexity of machine learning models while still being able to efficiently predict over a large spatial domain. We find that it is proficient at predicting the SST at specific locations as well as over the greater domain of the Earth’s oceans.
Valerio Lucarini, Larissa Serdukova, and Georgios Margazoglou
Nonlin. Processes Geophys., 29, 183–205, https://doi.org/10.5194/npg-29-183-2022, https://doi.org/10.5194/npg-29-183-2022, 2022
Short summary
Short summary
In most of the investigations on metastable systems, the stochastic forcing is modulated by Gaussian noise. Lévy noise laws, which describe jump processes, have recently received a lot of attention, but much less is known. We study stochastic versions of the Ghil–Sellers energy balance model, and we highlight the fundamental difference between how transitions are performed between the competing warm and snowball states, depending on whether Gaussian or Lévy noise acts as forcing.
Raphael Kriegmair, Yvonne Ruckstuhl, Stephan Rasp, and George Craig
Nonlin. Processes Geophys., 29, 171–181, https://doi.org/10.5194/npg-29-171-2022, https://doi.org/10.5194/npg-29-171-2022, 2022
Short summary
Short summary
Our regional numerical weather prediction models run at kilometer-scale resolutions. Processes that occur at smaller scales not yet resolved contribute significantly to the atmospheric flow. We use a neural network (NN) to represent the unresolved part of physical process such as cumulus clouds. We test this approach on a simplified, yet representative, 1D model and find that the NN corrections vastly improve the model forecast up to a couple of days.
Robert Polzin, Annette Müller, Henning Rust, Peter Névir, and Péter Koltai
Nonlin. Processes Geophys., 29, 37–52, https://doi.org/10.5194/npg-29-37-2022, https://doi.org/10.5194/npg-29-37-2022, 2022
Short summary
Short summary
In this study, a recent algorithmic framework called Direct Bayesian Model Reduction (DBMR) is applied which provides a scalable probability-preserving identification of reduced models directly from data. The stochastic method is tested in a meteorological application towards a model reduction to latent states of smaller scale convective activity conditioned on large-scale atmospheric flow.
Justin Schulte, Frederick Policelli, and Benjamin Zaitchik
Nonlin. Processes Geophys., 29, 1–15, https://doi.org/10.5194/npg-29-1-2022, https://doi.org/10.5194/npg-29-1-2022, 2022
Short summary
Short summary
The skewness of a time series is commonly used to quantify the extent to which positive (negative) deviations from the mean are larger than negative (positive) ones. However, in some cases, traditional skewness may not provide reliable information about time series skewness, motivating the development of a waveform skewness index in this paper. The waveform skewness index is used to show that changes in the relationship strength between climate time series could arise from changes in skewness.
Bo Christiansen
Nonlin. Processes Geophys., 28, 409–422, https://doi.org/10.5194/npg-28-409-2021, https://doi.org/10.5194/npg-28-409-2021, 2021
Short summary
Short summary
In geophysics we often need to analyse large samples of high-dimensional fields. Fortunately but counterintuitively, such high dimensionality can be a blessing, and we demonstrate how this allows simple analytical results to be derived. These results include estimates of correlations between sample members and how the sample mean depends on the sample size. We show that the properties of high dimensionality with success can be applied to climate fields, such as those from ensemble modelling.
Achim Wirth and Bertrand Chapron
Nonlin. Processes Geophys., 28, 371–378, https://doi.org/10.5194/npg-28-371-2021, https://doi.org/10.5194/npg-28-371-2021, 2021
Short summary
Short summary
In non-equilibrium statistical mechanics, which describes forced-dissipative systems such as air–sea interaction, there is no universal probability density function (pdf). Some such systems have recently been demonstrated to exhibit a symmetry called a fluctuation theorem (FT), which strongly constrains the shape of the pdf. Using satellite data, the mechanical power input to the ocean by air–sea interaction following or not a FT is questioned. A FT is found to apply over specific ocean regions.
Camille Besombes, Olivier Pannekoucke, Corentin Lapeyre, Benjamin Sanderson, and Olivier Thual
Nonlin. Processes Geophys., 28, 347–370, https://doi.org/10.5194/npg-28-347-2021, https://doi.org/10.5194/npg-28-347-2021, 2021
Short summary
Short summary
This paper investigates the potential of a type of deep generative neural network to produce realistic weather situations when trained from the climate of a general circulation model. The generator represents the climate in a compact latent space. It is able to reproduce many aspects of the targeted multivariate distribution. Some properties of our method open new perspectives such as the exploration of the extremes close to a given state or how to connect two realistic weather states.
Gerd Schädler and Marcus Breil
Nonlin. Processes Geophys., 28, 231–245, https://doi.org/10.5194/npg-28-231-2021, https://doi.org/10.5194/npg-28-231-2021, 2021
Short summary
Short summary
We used regional climate networks (RCNs) to identify past heatwaves and droughts in Germany. RCNs provide information for whole areas and can provide many details of extreme events. The RCNs were constructed on the grid of the E-OBS data set. Time series correlation was used to construct the networks. Network metrics were compared to standard extreme indices and differed considerably between normal and extreme years. The results show that RCNs can identify severe and moderate extremes.
Abhirup Banerjee, Bedartha Goswami, Yoshito Hirata, Deniz Eroglu, Bruno Merz, Jürgen Kurths, and Norbert Marwan
Nonlin. Processes Geophys., 28, 213–229, https://doi.org/10.5194/npg-28-213-2021, https://doi.org/10.5194/npg-28-213-2021, 2021
Jonathan M. Lilly and Paula Pérez-Brunius
Nonlin. Processes Geophys., 28, 181–212, https://doi.org/10.5194/npg-28-181-2021, https://doi.org/10.5194/npg-28-181-2021, 2021
Short summary
Short summary
Long-lived eddies are an important part of the ocean circulation. Here a dataset for studying eddies in the Gulf of Mexico is created through the analysis of trajectories of drifting instruments. The method involves the identification of quasi-periodic signals, characteristic of particles trapped in eddies, from the displacement records, followed by the creation of a measure of statistical significance. It is expected that this dataset will be of use to other authors studying this region.
Pascal Wang, Daniele Castellana, and Henk A. Dijkstra
Nonlin. Processes Geophys., 28, 135–151, https://doi.org/10.5194/npg-28-135-2021, https://doi.org/10.5194/npg-28-135-2021, 2021
Short summary
Short summary
This paper proposes two improvements to the use of Trajectory-Adaptive Multilevel Sampling, a rare-event algorithm which computes noise-induced transition probabilities. The first improvement uses locally linearised dynamics in order to reduce the arbitrariness associated with defining what constitutes a transition. The second improvement uses empirical transition paths accumulated at high noise in order to formulate the score function which determines the performance of the algorithm.
Cristian Lussana, Thomas N. Nipen, Ivar A. Seierstad, and Christoffer A. Elo
Nonlin. Processes Geophys., 28, 61–91, https://doi.org/10.5194/npg-28-61-2021, https://doi.org/10.5194/npg-28-61-2021, 2021
Short summary
Short summary
An unprecedented amount of rainfall data is available nowadays, such as ensemble model output, weather radar estimates, and in situ observations from networks of both traditional and opportunistic sensors. Nevertheless, the exact amount of precipitation, to some extent, eludes our knowledge. The objective of our study is precipitation reconstruction through the combination of numerical model outputs with observations from multiple data sources.
Dylan Harries and Terence J. O'Kane
Nonlin. Processes Geophys., 27, 453–471, https://doi.org/10.5194/npg-27-453-2020, https://doi.org/10.5194/npg-27-453-2020, 2020
Short summary
Short summary
Different dimension reduction methods may produce profoundly different low-dimensional representations of multiscale systems. We perform a set of case studies to investigate these differences. When a clear scale separation is present, similar bases are obtained using all methods, but when this is not the case some methods may produce representations that are poorly suited for describing features of interest, highlighting the importance of a careful choice of method when designing analyses.
Josh Jacobson, William Kleiber, Michael Scheuerer, and Joseph Bellier
Nonlin. Processes Geophys., 27, 411–427, https://doi.org/10.5194/npg-27-411-2020, https://doi.org/10.5194/npg-27-411-2020, 2020
Short summary
Short summary
Most verification metrics for ensemble forecasts assess the representation of uncertainty at a particular location and time. We study a new diagnostic tool based on fractions of threshold exceedance (FTE) which evaluates an additional important attribute: the ability of ensemble forecast fields to reproduce the spatial structure of observed fields. The utility of this diagnostic tool is demonstrated through simulations and an application to ensemble precipitation forecasts.
Sebastian Lerch, Sándor Baran, Annette Möller, Jürgen Groß, Roman Schefzik, Stephan Hemri, and Maximiliane Graeter
Nonlin. Processes Geophys., 27, 349–371, https://doi.org/10.5194/npg-27-349-2020, https://doi.org/10.5194/npg-27-349-2020, 2020
Short summary
Short summary
Accurate models of spatial, temporal, and inter-variable dependencies are of crucial importance for many practical applications. We review and compare several methods for multivariate ensemble post-processing, where such dependencies are imposed via copula functions. Our investigations utilize simulation studies that mimic challenges occurring in practical applications and allow ready interpretation of the effects of different misspecifications of the numerical weather prediction ensemble.
Jaqueline Lekscha and Reik V. Donner
Nonlin. Processes Geophys., 27, 261–275, https://doi.org/10.5194/npg-27-261-2020, https://doi.org/10.5194/npg-27-261-2020, 2020
Julian Steinheuer and Petra Friederichs
Nonlin. Processes Geophys., 27, 239–252, https://doi.org/10.5194/npg-27-239-2020, https://doi.org/10.5194/npg-27-239-2020, 2020
Short summary
Short summary
Many applications require wind gust estimates at very different atmospheric altitudes, such as in the wind energy sector. However, numerical weather prediction models usually only derive estimates for gusts at 10 m above the land surface. We present a statistical model that gives the hourly peak wind speed. The model is trained based on a weather reanalysis and observations from the Hamburg Weather Mast. Reliable predictions are derived at up to 250 m, even at unobserved intermediate levels.
Moritz N. Lang, Sebastian Lerch, Georg J. Mayr, Thorsten Simon, Reto Stauffer, and Achim Zeileis
Nonlin. Processes Geophys., 27, 23–34, https://doi.org/10.5194/npg-27-23-2020, https://doi.org/10.5194/npg-27-23-2020, 2020
Short summary
Short summary
Statistical post-processing aims to increase the predictive skill of probabilistic ensemble weather forecasts by learning the statistical relation between historical pairs of observations and ensemble forecasts within a given training data set. This study compares four different training schemes and shows that including multiple years of data in the training set typically yields a more stable post-processing while it loses the ability to quickly adjust to temporal changes in the underlying data.
Achim Wirth
Nonlin. Processes Geophys., 26, 457–477, https://doi.org/10.5194/npg-26-457-2019, https://doi.org/10.5194/npg-26-457-2019, 2019
Short summary
Short summary
The conspicuous feature of the atmosphere–ocean system is the large difference in the masses of the two media. In this respect there is a strong analogy to Brownian motion, with light and fast molecules colliding with heavy and slow Brownian particles. I apply the tools of non-equilibrium statistical mechanics for studying Brownian motion to air–sea interaction.
Carsten Abraham, Amber M. Holdsworth, and Adam H. Monahan
Nonlin. Processes Geophys., 26, 401–427, https://doi.org/10.5194/npg-26-401-2019, https://doi.org/10.5194/npg-26-401-2019, 2019
Short summary
Short summary
Atmospheric stably stratified boundary layers display transitions between regimes of sustained and intermittent turbulence. These transitions are not well represented in numerical weather prediction and climate models. A prototype explicitly stochastic turbulence parameterization simulating regime dynamics is presented and tested in an idealized model. Results demonstrate that the approach can improve the regime representation in models.
Jari-Pekka Nousu, Matthieu Lafaysse, Matthieu Vernay, Joseph Bellier, Guillaume Evin, and Bruno Joly
Nonlin. Processes Geophys., 26, 339–357, https://doi.org/10.5194/npg-26-339-2019, https://doi.org/10.5194/npg-26-339-2019, 2019
Short summary
Short summary
Forecasting the height of new snow is crucial for avalanche hazard, road viability, ski resorts and tourism. The numerical models suffer from systematic and significant errors which are misleading for the final users. Here, we applied for the first time a state-of-the-art statistical method to correct ensemble numerical forecasts of the height of new snow from their statistical link with measurements in French Alps and Pyrenees. Thus the realism of automatic forecasts can be quickly improved.
Jürgen Kurths, Ankit Agarwal, Roopam Shukla, Norbert Marwan, Maheswaran Rathinasamy, Levke Caesar, Raghavan Krishnan, and Bruno Merz
Nonlin. Processes Geophys., 26, 251–266, https://doi.org/10.5194/npg-26-251-2019, https://doi.org/10.5194/npg-26-251-2019, 2019
Short summary
Short summary
We examined the spatial diversity of Indian rainfall teleconnection at different timescales, first by identifying homogeneous communities and later by computing non-linear linkages between the identified communities (spatial regions) and dominant climatic patterns, represented by climatic indices such as El Nino–Southern Oscillation, Indian Ocean Dipole, North Atlantic Oscillation, Pacific Decadal Oscillation and Atlantic Multi-Decadal Oscillation.
Jonathan Demaeyer and Stéphane Vannitsem
Nonlin. Processes Geophys., 25, 605–631, https://doi.org/10.5194/npg-25-605-2018, https://doi.org/10.5194/npg-25-605-2018, 2018
Short summary
Short summary
We investigate the modeling of the effects of the unresolved scales on the large scales of the coupled ocean–atmosphere model MAOOAM. Two different physically based stochastic methods are considered and compared, in various configurations of the model. Both methods show remarkable performances and are able to model fundamental changes in the model dynamics. Ways to improve the parameterizations' implementation are also proposed.
Adam H. Monahan
Nonlin. Processes Geophys., 25, 335–353, https://doi.org/10.5194/npg-25-335-2018, https://doi.org/10.5194/npg-25-335-2018, 2018
Short summary
Short summary
Bivariate probability density functions (pdfs) of wind speed characterize the relationship between speeds at two different locations or times. This study develops such pdfs of wind speed from distributions of the components, following a well-established approach for univariate distributions. The ability of these models to characterize example observed datasets is assessed. The mathematical complexity of these models suggests further extensions of this line of reasoning may not be practical.
Berenice Rojo-Garibaldi, David Alberto Salas-de-León, María Adela Monreal-Gómez, Norma Leticia Sánchez-Santillán, and David Salas-Monreal
Nonlin. Processes Geophys., 25, 291–300, https://doi.org/10.5194/npg-25-291-2018, https://doi.org/10.5194/npg-25-291-2018, 2018
Short summary
Short summary
Hurricanes are complex systems that carry large amounts of energy. Its impact produces, most of the time, natural disasters involving the loss of human lives and of materials and infrastructure that is accounted for in billions of US dollars. Not everything is negative as hurricanes are the main source of rainwater for the regions where they develop. In this study we make a nonlinear analysis of the time series obtained from 1749 to 2012 of the hurricane occurrence in the Gulf of Mexico.
Guillaume Lenoir and Michel Crucifix
Nonlin. Processes Geophys., 25, 145–173, https://doi.org/10.5194/npg-25-145-2018, https://doi.org/10.5194/npg-25-145-2018, 2018
Short summary
Short summary
We develop a general framework for the frequency analysis of irregularly sampled time series. We also design a test of significance against a general background noise which encompasses the Gaussian white or red noise. Our results generalize and unify methods developed in the fields of geosciences, engineering, astronomy and astrophysics. All the analysis tools presented in this paper are available to the reader in the Python package WAVEPAL.
Guillaume Lenoir and Michel Crucifix
Nonlin. Processes Geophys., 25, 175–200, https://doi.org/10.5194/npg-25-175-2018, https://doi.org/10.5194/npg-25-175-2018, 2018
Short summary
Short summary
There is so far no general framework for handling the continuous wavelet transform when the time sampling is irregular. Here we provide such a framework with the Morlet wavelet, based on the results of part I of this study. We also design a test of significance against a general background noise which encompasses the Gaussian white or red noise. All the analysis tools presented in this article are available to the reader in the Python package WAVEPAL.
Valerie N. Livina, Albert Brouwer, Peter Harris, Lian Wang, Kostas Sotirakopoulos, and Stephen Robinson
Nonlin. Processes Geophys., 25, 89–97, https://doi.org/10.5194/npg-25-89-2018, https://doi.org/10.5194/npg-25-89-2018, 2018
Short summary
Short summary
We have applied tipping point analysis to a large record of ocean acoustic data to identify the main components of the acoustic dynamical system: long-term and seasonal trends, system states and fluctuations. We reconstructed a one-dimensional stochastic model equation to approximate the acoustic dynamical system. We have found a signature of El Niño events in the deep ocean acoustic data near the southwest Australian coast, which proves the investigative power of the tipping point methodology.
Marc Bengulescu, Philippe Blanc, and Lucien Wald
Nonlin. Processes Geophys., 25, 19–37, https://doi.org/10.5194/npg-25-19-2018, https://doi.org/10.5194/npg-25-19-2018, 2018
Short summary
Short summary
We employ the Hilbert–Huang transform to study the temporal variability in time series of daily means of the surface solar irradiance (SSI) at different locations around the world. The data have a significant spectral peak corresponding to the yearly variability cycle and feature quasi-stochastic high-frequency "weather noise", irrespective of the geographical location or of the local climate. Our findings can improve models for estimating SSI from satellite images or forecasts of the SSI.
Manfred Mudelsee and Miguel A. Bermejo
Nonlin. Processes Geophys., 24, 737–744, https://doi.org/10.5194/npg-24-737-2017, https://doi.org/10.5194/npg-24-737-2017, 2017
Short summary
Short summary
Risk analysis of extremes has high socioeconomic relevance. Of crucial interest is the tail probability, P, of the distribution of a variable, which is the chance of observing a value equal to or greater than a certain threshold value, x. Many variables in geophysical systems (e.g. climate) show heavy tail behaviour, where P may be rather large. In particular, P decreases with x as a power law that is described by a parameter, α. We present an improved method to estimate α on data.
Kathrin Padberg-Gehle and Christiane Schneide
Nonlin. Processes Geophys., 24, 661–671, https://doi.org/10.5194/npg-24-661-2017, https://doi.org/10.5194/npg-24-661-2017, 2017
Short summary
Short summary
Transport and mixing processes in fluid flows are crucially influenced by coherent structures, such as eddies, gyres, or jets in geophysical flows. We propose a very simple and computationally efficient approach for analyzing coherent behavior in fluid flows. The central object is a flow network constructed directly from particle trajectories. The network's local and spectral properties are shown to give a very good indication of coherent as well as mixing regions in the underlying flow.
Ankit Agarwal, Norbert Marwan, Maheswaran Rathinasamy, Bruno Merz, and Jürgen Kurths
Nonlin. Processes Geophys., 24, 599–611, https://doi.org/10.5194/npg-24-599-2017, https://doi.org/10.5194/npg-24-599-2017, 2017
Short summary
Short summary
Extreme events such as floods and droughts result from synchronization of different natural processes working at multiple timescales. Investigation on an observation timescale will not reveal the inherent underlying dynamics triggering these events. This paper develops a new method based on wavelets and event synchronization to unravel the hidden dynamics responsible for such sudden events. This method is tested with synthetic and real-world cases and the results are promising.
Jonathan M. Lilly, Adam M. Sykulski, Jeffrey J. Early, and Sofia C. Olhede
Nonlin. Processes Geophys., 24, 481–514, https://doi.org/10.5194/npg-24-481-2017, https://doi.org/10.5194/npg-24-481-2017, 2017
Short summary
Short summary
This work arose from a desire to understand the nature of particle motions in turbulence. We sought a simple conceptual model that could describe such motions, then realized that this model could be applicable to an array of other problems. The basic idea is to create a string of random numbers, called a stochastic process, that mimics the properties of particle trajectories. This model could be useful in making best use of data from freely drifting instruments tracking the ocean currents.
Finn Müller-Hansen, Manoel F. Cardoso, Eloi L. Dalla-Nora, Jonathan F. Donges, Jobst Heitzig, Jürgen Kurths, and Kirsten Thonicke
Nonlin. Processes Geophys., 24, 113–123, https://doi.org/10.5194/npg-24-113-2017, https://doi.org/10.5194/npg-24-113-2017, 2017
Short summary
Short summary
Deforestation and subsequent land uses in the Brazilian Amazon have huge impacts on greenhouse gas emissions, local climate and biodiversity. To better understand these land-cover changes, we apply complex systems methods uncovering spatial patterns in regional transition probabilities between land-cover types, which we estimate using maps derived from satellite imagery. The results show clusters of similar land-cover dynamics and thus complement studies at the local scale.
Jeroen Wouters, Stamen Iankov Dolaptchiev, Valerio Lucarini, and Ulrich Achatz
Nonlin. Processes Geophys., 23, 435–445, https://doi.org/10.5194/npg-23-435-2016, https://doi.org/10.5194/npg-23-435-2016, 2016
Cited articles
Adarsh, S. and Reddy M. J.: Trend analysis of rainfall in four meteorological
subdivisions of southern India using nonparametric methods and discrete
wavelet analysis, Int. J. Climatol., 35, 1107–1124, 2014.
Addison, P. S.: Wavelet transforms and the ECG: a review, Physiol. Meas.,
26, R155, https://doi.org/10.1088/0967-3334/26/5/R01, 2005.
Agarwal, A., Maheswaran, R., Marwan, N., Caesar, L., and Kurths, J.:
Wavelet-based multiscale similarity measure for complex networks,
Eur. Phys. J. B, 91, 296,
https://doi.org/10.1140/epjb/e2018-90460-6, 2018.
Azad, S., Vignesh, T. S., and Narasimha, R.: Periodicities in Indian Monsoon
Rainfall over spectrally homogeneous regions, Int. J. Climatol., 30,
2289–2298, 2010.
Edelsbrunner, H. and Harer, J.: Persistent homology-a survey, Contemp. Math.,
453, 257–282, 2008.
Elsanabary, M. H. and Gan, T. Y.: Wavelet analysis of seasonal rainfall
variability of the upper Blue Nile Basin, its teleconnection to Global Sea
surface temperature, and its forecasting by an artificial neural network,
Mon. Weather Rev., 142, 1771–1791, 2014.
Fasullo, J.: Biennial characteristics of All India rainfall, J. Climate, 17,
2972–2982, 2004.
Ferri, M.: Persistent topology for natural data analysis – A survey, in:
Towards Integrative Machine Learning and Knowledge Extraction, Springer,
Berlin/Heidelberg, Germany, 117–133, 2017.
Gallegati, M.: A systematic wavelet-based exploratory analysis of climatic
variables, Climate Change, 148, 325–338, 2018.
Grinsted, A., Moore, J. C., and Jevrejeva, S.: Application of the cross wavelet transform and wavelet coherence to
geophysical time series, Nonlin. Processes Geophys., 11, 561–566, https://doi.org/10.5194/npg-11-561-2004, 2004.
Hu, W. and Si, B. C.: Technical note: Multiple wavelet coherence for untangling scale-specific and localized multivariate
relationships in geosciences, Hydrol. Earth Syst. Sci., 20, 3183–3191, https://doi.org/10.5194/hess-20-3183-2016, 2016.
Indian Institute of Tropical Meteorology: Meteorological Data Sets for Downloading, available at: https://www.tropmet.res.in/Data Archival-51-Page, last access: 15 March 2019.
Kumar, P. and Foufoula-Georgiou, E.: Wavelet analysis for geophysical
applications, Rev. Geophys., 35, 385–412, 1997.
Labat, D.: Recent advances in wavelet analyses: Part 1. A review of
concepts, J. Hydrol., 314, 275–288, 2005.
Labat, D.: Cross wavelet analyses of annual continental freshwater discharge
and selected climate indices, J. Hydrol., 385, 269–278, 2010.
Lane, S. N.: Assessment of rainfall–runoff models based upon wavelet
analysis, Hydrol. Process., 21, 586–607, 2007.
Lau, K.-M. and Weng, H.-Y.: Climate signal detection using wavelet
transform: How to make a time series sing, B. Am. Meteorol. Soc., 76,
2391–2402, 1995.
Liu, Y., Liang, X. S., and Weisberg, R. H.: Rectification of the bias in the
wavelet power spectrum, J. Atmos. Ocean. Tech., 24, 2093–2102, 2007.
Liu, Y., Brown, J., Demargne, J., and Seo, D.: A wavelet-based approach to
assessing timing errors in hydrological predictions, J. Hydrol., 397,
210–224, 2011.
Maheswaran, R. and Khosa, R.: A wavelet-based second order nonlinear model for
forecasting monthly rainfall, Water Resour. Manag., 28, 5411–5431, 2014.
Maraun, D. and Kurths, J.: Cross wavelet analysis: significance testing and pitfalls, Nonlin. Processes Geophys.,
11, 505–514, https://doi.org/10.5194/npg-11-505-2004, 2004.
Maraun, D., Kurths, J., and Holschneider, M.: Non-stationary Gaussian processes
in wavelet domain: definitions, estimation and significance testing, Phys.
Rev. E., 75, 016707, https://doi.org/10.1103/PhysRevE.75.016707, 2007.
Meyers, S. D., Kelly, B. G., and O'Brien, J. J.: An introduction to wavelet
analysis in oceanography and meteorology: With application to the dispersion
of Yanai waves, Mon. Weather Rev., 121, 2858–2866, 1993.
Narasimha, R. and Bhattacharyya, S.: A wavelet cross-spectral analysis of
solar–ENSO–rainfall connections in the Indian monsoons, Appl. Comput. Harmon. A., 28, 285–295, 2010.
Nayagam, L. R., Janardanan, R., and Ram Mohan, H. S.: Variability and
teleconnectivity of northeast monsoon rainfall over India, Global Planet. Change, 69, 225–231, 2009.
Ng, E. K. W. and Chan, J. C. L.: Geophysical applications of partial wavelet
coherence and multiple wavelet coherence, J. Atmos. Ocean. Tech., 29,
1845–1853, 2012.
NOAA/OAR/ESRL PSD: Climate Timeseries, available at: https://www.esrl.noaa.gov/psd/gcos_wgsp/Timeseries/,last access: 15 March 2019.
Paluš, M.: Linked by Dynamics: Wavelet-Based Mutual Information Rate as
a Connectivity Measure and Scale-SpecificNetworks, in: Advances in Nonlinear
Geosciences, edited by: Tsonis, A. A., 427–463, Springer International
Publishing, Cham., 2018.
Parthasarathy B., Munot A. A., and Kothawale D. R.: All India monthly and
seasonal rainfall series, 1871–1993, Theor. Appl. Climatol., 49,
217–224, 1994.
Parthasarathy, B., Munot, A. A., and Kothawale, D. R.: Monthly and seasonal rainfall
series for all-India homogeneous regions and meteorological subdivisions:
1871–1994, Research Report No. RR-065, Indian Institute of Tropical
Meteorology, Pune, 113 pp., 1995.
Qaiser, T., Sirinukunwattana, K., Nakane, K., Tsang, Y. W., Epstein, D., and
Rajpoot, N.: Persistent homology for fast tumor segmentation in whole slide
histology images, Procedia Comput. Sci., 90, 119–124, 2016.
Ramana, R. V., Krishna, B., Kumar, S. R., and Pandey, N. G.: Monthly rainfall
prediction using Wavelet Neural Network Analysis, Water Resour. Manag., 27,
3697–3711, 2013.
Roy, I., Tedeschi, R. G., and Collins, M.: ENSO teleconnections to the
Indian summer monsoon in observations and models, Int. J.
Climatol., 37, 1794–1813, 2017.
Sahay, R. R. and Srivastava, A.: Predicting monsoon floods in rivers embedding
wavelet transform, genetic algorithm and neural network, Water Resour.
Manag., 28, 301–317, 2014.
Sang, Y. F.: A review on the applications of wavelet transform in hydrology
time series analysis, Atmos. Res., 122, 8–15, 2012.
Schaefli, B., Maraun, D., and Holschneider, M.: What drives high flow events in
the Swiss Alps? Recent developments in wavelet spectral analysis and their
application to hydrology, Adv. Water Resour., 30, 2511–2525, 2007.
Schulte, J. A.: Cumulative areawise testing in wavelet analysis and its application to geophysical time series,
Nonlin. Processes Geophys., 23, 45–57, https://doi.org/10.5194/npg-23-45-2016, 2016a.
Schulte, J. A.: Wavelet analysis for non-stationary, nonlinear time series, Nonlin. Processes Geophys., 23, 257–267, https://doi.org/10.5194/npg-23-257-2016, 2016b.
Schulte, J. A. and Georgas, N.: Theory and Practice of Phase-aware Ensemble
Forecasting, Q. J. Roy. Meteor. Soc., 144, 1415–1428, 2018.
Schulte, J. A., Duffy, C., and Najjar, R. G.: Geometric and topological approaches to significance testing in wavelet analysis,
Nonlin. Processes Geophys., 22, 139–156, https://doi.org/10.5194/npg-22-139-2015, 2015.
Schulte, J. A., Najjar, R. G., and Lee, S.: Salinity and Streamflow
Variability in the Mid-Atlantic Region of the United States and its
Relationship with Large-scale Atmospheric Circulation Patterns, J. Hydrol.,
550, 65–79, 2017.
Terray, P., Delecluse, P., Labattu, S., and Terray, L.: Sea surface
temperature associations with the late Indian summer monsoon, Clim. Dynam.,
21, 593–618, 2003.
Torrence, C. and Compo, G. P.: A practical guide to wavelet analysis, B.
Am. Meteorol. Soc., 79, 61–78, 1998.
Torrence, C. and Webster, P. J.: Interdecadal changes in the ENSO monsoon
system, J. Climate, 12, 2679–2690, 1999.
Yadava, M. G. and Ramesh, R.: Significant longer-term periodicities in the
proxy record of the Indian monsoon rainfall, New Astron., 12, 544–555,
2007.
Short summary
Statistical hypothesis tests in wavelet analysis are used to asses the likelihood that time series features are noise. The choice of test will determine which features emerge as a signal. Tests based on area do poorly at distinguishing abrupt fluctuations from periodic behavior, unlike tests based on arclength that do better. The application of the tests suggests that there are features in Indian rainfall time series that emerge from background noise.
Statistical hypothesis tests in wavelet analysis are used to asses the likelihood that time...
