Articles | Volume 22, issue 6
https://doi.org/10.5194/npg-22-679-2015
© Author(s) 2015. This work is distributed under
the Creative Commons Attribution 3.0 License.
the Creative Commons Attribution 3.0 License.
https://doi.org/10.5194/npg-22-679-2015
© Author(s) 2015. This work is distributed under
the Creative Commons Attribution 3.0 License.
the Creative Commons Attribution 3.0 License.
Research article
| 
18 Nov 2015
Research article |
| 18 Nov 2015
Efficient Bayesian inference for natural time series using ARFIMA processes
T. Graves
URS Corporation, London, UK
R. B. Gramacy
The University of Chicago, Booth School of Business, Chicago, IL, USA
C. L. E. Franzke
CORRESPONDING AUTHOR
Meteorological Institute and Center for Earth System Research and Sustainability (CEN), University of Hamburg, Hamburg, Germany
N. W. Watkins
Centre for the Analysis of Time Series, London School of Economics and Political Science, London, UK
Centre for Fusion Space and Astrophysics, University of Warwick, Coventry, UK
Max Planck Institute for the Physics of Complex Systems, Dresden, Germany
Faculty of Mathematics, Computing and Technology, Open University, Milton Keynes, UK
Related authors
No articles found.
C. L. E. Franzke, T. J. O'Kane, D. P. Monselesan, J. S. Risbey, and I. Horenko
Nonlin. Processes Geophys., 22, 513–525, https://doi.org/10.5194/npg-22-513-2015, https://doi.org/10.5194/npg-22-513-2015, 2015
Related subject area
Subject: Time series, machine learning, networks, stochastic processes, extreme events | Topic: Climate, atmosphere, ocean, hydrology, cryosphere, biosphere
Evaluation of forecasts by a global data-driven weather model with and without probabilistic post-processing at Norwegian stations
Characterisation of Dansgaard-Oeschger events in palaeoclimate time series using the Matrix Profile
The sampling method for optimal precursors of El Niño–Southern Oscillation events
A comparison of two causal methods in the context of climate analyses
A two-fold deep-learning strategy to correct and downscale winds over mountains
Downscaling of surface wind forecasts using convolutional neural networks
Superstatistical analysis of sea surface currents in the Gulf of Trieste, measured by high-frequency radar, and its relation to wind regimes using the maximum-entropy principle
Representation learning with unconditional denoising diffusion models for dynamical systems
Physically constrained covariance inflation from location uncertainty
Data-driven methods to estimate the committor function in conceptual ocean models
Exploring meteorological droughts' spatial patterns across Europe through complex network theory
Rain process models and convergence to point processes
Integrated hydrodynamic and machine learning models for compound flooding prediction in a data-scarce estuarine delta
Empirical adaptive wavelet decomposition (EAWD): an adaptive decomposition for the variability analysis of observation time series in atmospheric science
Predicting sea surface temperatures with coupled reservoir computers
Lévy noise versus Gaussian-noise-induced transitions in the Ghil–Sellers energy balance model
Using neural networks to improve simulations in the gray zone
Direct Bayesian model reduction of smaller scale convective activity conditioned on large-scale dynamics
A waveform skewness index for measuring time series nonlinearity and its applications to the ENSO–Indian monsoon relationship
The blessing of dimensionality for the analysis of climate data
Empirical evidence of a fluctuation theorem for the wind mechanical power input into the ocean
Producing realistic climate data with generative adversarial networks
Identification of droughts and heatwaves in Germany with regional climate networks
Recurrence analysis of extreme event-like data
Extracting statistically significant eddy signals from large Lagrangian datasets using wavelet ridge analysis, with application to the Gulf of Mexico
Improvements to the use of the Trajectory-Adaptive Multilevel Sampling algorithm for the study of rare events
Ensemble-based statistical interpolation with Gaussian anamorphosis for the spatial analysis of precipitation
Applications of matrix factorization methods to climate data
Beyond univariate calibration: verifying spatial structure in ensembles of forecast fields
Simulation-based comparison of multivariate ensemble post-processing methods
Detecting dynamical anomalies in time series from different palaeoclimate proxy archives using windowed recurrence network analysis
Vertical profiles of wind gust statistics from a regional reanalysis using multivariate extreme value theory
Remember the past: a comparison of time-adaptive training schemes for non-homogeneous regression
On fluctuating momentum exchange in idealised models of air–sea interaction
A prototype stochastic parameterization of regime behaviour in the stably stratified atmospheric boundary layer
Statistical post-processing of ensemble forecasts of the height of new snow
Unravelling the spatial diversity of Indian precipitation teleconnections via a non-linear multi-scale approach
Statistical hypothesis testing in wavelet analysis: theoretical developments and applications to Indian rainfall
Comparison of stochastic parameterizations in the framework of a coupled ocean–atmosphere model
Idealized models of the joint probability distribution of wind speeds
Nonlinear analysis of the occurrence of hurricanes in the Gulf of Mexico and the Caribbean Sea
A general theory on frequency and time–frequency analysis of irregularly sampled time series based on projection methods – Part 1: Frequency analysis
A general theory on frequency and time–frequency analysis of irregularly sampled time series based on projection methods – Part 2: Extension to time–frequency analysis
Tipping point analysis of ocean acoustic noise
On the intrinsic timescales of temporal variability in measurements of the surface solar radiation
Optimal heavy tail estimation – Part 1: Order selection
Network-based study of Lagrangian transport and mixing
Multi-scale event synchronization analysis for unravelling climate processes: a wavelet-based approach
Fractional Brownian motion, the Matérn process, and stochastic modeling of turbulent dispersion
A matrix clustering method to explore patterns of land-cover transitions in satellite-derived maps of the Brazilian Amazon
John Bjørnar Bremnes, Thomas N. Nipen, and Ivar A. Seierstad
Nonlin. Processes Geophys., 31, 247–257, https://doi.org/10.5194/npg-31-247-2024, https://doi.org/10.5194/npg-31-247-2024, 2024
Short summary
Short summary
During the last 2 years, tremendous progress has been made in global data-driven weather models trained on reanalysis data. In this study, the Pangu-Weather model is compared to several numerical weather prediction models with and without probabilistic post-processing for temperature and wind speed forecasting. The results confirm that global data-driven models are promising for operational weather forecasting and that post-processing can improve these forecasts considerably.
Susana Barbosa, Maria Eduarda Silva, and Denis-Didier Rousseau
Nonlin. Processes Geophys. Discuss., https://doi.org/10.5194/npg-2024-13, https://doi.org/10.5194/npg-2024-13, 2024
Revised manuscript accepted for NPG
Short summary
Short summary
The characterisation of abrupt transitions in palaeoclimate records allows the understanding of millennial climate variability and of potential tipping points in the context of current climate change. In our study an algorithmic method, the matrix profile, is employed to characterise abrupt warmings designated as Dansgaard-Oeschger (DO) events and to identify the most similar transitions in the palaeoclimate time series.
Bin Shi and Junjie Ma
Nonlin. Processes Geophys., 31, 165–174, https://doi.org/10.5194/npg-31-165-2024, https://doi.org/10.5194/npg-31-165-2024, 2024
Short summary
Short summary
Different from traditional deterministic optimization algorithms, we implement the sampling method to compute the conditional nonlinear optimal perturbations (CNOPs) in the realistic and predictive coupled ocean–atmosphere model, which reduces the first-order information to the zeroth-order one, avoiding the high-cost computation of the gradient. The numerical performance highlights the importance of stochastic optimization algorithms to compute CNOPs and capture initial optimal precursors.
David Docquier, Giorgia Di Capua, Reik V. Donner, Carlos A. L. Pires, Amélie Simon, and Stéphane Vannitsem
Nonlin. Processes Geophys., 31, 115–136, https://doi.org/10.5194/npg-31-115-2024, https://doi.org/10.5194/npg-31-115-2024, 2024
Short summary
Short summary
Identifying causes of specific processes is crucial in order to better understand our climate system. Traditionally, correlation analyses have been used to identify cause–effect relationships in climate studies. However, correlation does not imply causation, which justifies the need to use causal methods. We compare two independent causal methods and show that these are superior to classical correlation analyses. We also find some interesting differences between the two methods.
Louis Le Toumelin, Isabelle Gouttevin, Clovis Galiez, and Nora Helbig
Nonlin. Processes Geophys., 31, 75–97, https://doi.org/10.5194/npg-31-75-2024, https://doi.org/10.5194/npg-31-75-2024, 2024
Short summary
Short summary
Forecasting wind fields over mountains is of high importance for several applications and particularly for understanding how wind erodes and disperses snow. Forecasters rely on operational wind forecasts over mountains, which are currently only available on kilometric scales. These forecasts can also be affected by errors of diverse origins. Here we introduce a new strategy based on artificial intelligence to correct large-scale wind forecasts in mountains and increase their spatial resolution.
Florian Dupuy, Pierre Durand, and Thierry Hedde
Nonlin. Processes Geophys., 30, 553–570, https://doi.org/10.5194/npg-30-553-2023, https://doi.org/10.5194/npg-30-553-2023, 2023
Short summary
Short summary
Forecasting near-surface winds over complex terrain requires high-resolution numerical weather prediction models, which drastically increase the duration of simulations and hinder them in running on a routine basis. A faster alternative is statistical downscaling. We explore different ways of calculating near-surface wind speed and direction using artificial intelligence algorithms based on various convolutional neural networks in order to find the best approach for wind downscaling.
Sofia Flora, Laura Ursella, and Achim Wirth
Nonlin. Processes Geophys., 30, 515–525, https://doi.org/10.5194/npg-30-515-2023, https://doi.org/10.5194/npg-30-515-2023, 2023
Short summary
Short summary
An increasing amount of data allows us to move from low-order moments of fluctuating observations to their PDFs. We found the analytical fat-tailed PDF form (a combination of Gaussian and two-exponential convolutions) for 2 years of sea surface current increments in the Gulf of Trieste, using superstatistics and the maximum-entropy principle twice: on short and longer timescales. The data from different wind regimes follow the same analytical PDF, pointing towards a universal behaviour.
Tobias Sebastian Finn, Lucas Disson, Alban Farchi, Marc Bocquet, and Charlotte Durand
EGUsphere, https://doi.org/10.5194/egusphere-2023-2261, https://doi.org/10.5194/egusphere-2023-2261, 2023
Short summary
Short summary
We train neural networks as denoising diffusion models for state generation in the Lorenz 1963 system and demonstrate that they learn an internal representation of the system. We make use of this learned representation and the pre-trained model in two downstream tasks: surrogate modelling and ensemble generation. For both tasks, the diffusion model can outperform other more common approaches. Thus, we see a potential of representation learning with diffusion models for dynamical systems.
Yicun Zhen, Valentin Resseguier, and Bertrand Chapron
Nonlin. Processes Geophys., 30, 237–251, https://doi.org/10.5194/npg-30-237-2023, https://doi.org/10.5194/npg-30-237-2023, 2023
Short summary
Short summary
This paper provides perspective that the displacement vector field of physical state fields should be determined by the tensor fields associated with the physical fields. The advantage of this perspective is that certain physical quantities can be conserved while applying a displacement vector field to transfer the original physical field. A direct application of this perspective is the physically constrained covariance inflation scheme proposed in this paper.
Valérian Jacques-Dumas, René M. van Westen, Freddy Bouchet, and Henk A. Dijkstra
Nonlin. Processes Geophys., 30, 195–216, https://doi.org/10.5194/npg-30-195-2023, https://doi.org/10.5194/npg-30-195-2023, 2023
Short summary
Short summary
Computing the probability of occurrence of rare events is relevant because of their high impact but also difficult due to the lack of data. Rare event algorithms are designed for that task, but their efficiency relies on a score function that is hard to compute. We compare four methods that compute this function from data and measure their performance to assess which one would be best suited to be applied to a climate model. We find neural networks to be most robust and flexible for this task.
Domenico Giaquinto, Warner Marzocchi, and Jürgen Kurths
Nonlin. Processes Geophys., 30, 167–181, https://doi.org/10.5194/npg-30-167-2023, https://doi.org/10.5194/npg-30-167-2023, 2023
Short summary
Short summary
Despite being among the most severe climate extremes, it is still challenging to assess droughts’ features for specific regions. In this paper we study meteorological droughts in Europe using concepts derived from climate network theory. By exploring the synchronization in droughts occurrences across the continent we unveil regional clusters which are individually examined to identify droughts’ geographical propagation and source–sink systems, which could potentially support droughts’ forecast.
Scott Hottovy and Samuel N. Stechmann
Nonlin. Processes Geophys., 30, 85–100, https://doi.org/10.5194/npg-30-85-2023, https://doi.org/10.5194/npg-30-85-2023, 2023
Short summary
Short summary
Rainfall is erratic and difficult to predict. Thus, random models are often used to describe rainfall events. Since many of these random models are based more on statistics than physical laws, it is desirable to develop connections between the random statistical models and the underlying physics of rain. Here, a physics-based model is shown to converge to a statistics-based model, which helps to provide a physical basis for the statistics-based model.
Joko Sampurno, Valentin Vallaeys, Randy Ardianto, and Emmanuel Hanert
Nonlin. Processes Geophys., 29, 301–315, https://doi.org/10.5194/npg-29-301-2022, https://doi.org/10.5194/npg-29-301-2022, 2022
Short summary
Short summary
In this study, we successfully built and evaluated machine learning models for predicting water level dynamics as a proxy for compound flooding hazards in a data-scarce delta. The issues that we tackled here are data scarcity and low computational resources for building flood forecasting models. The proposed approach is suitable for use by local water management agencies in developing countries that encounter these issues.
Olivier Delage, Thierry Portafaix, Hassan Bencherif, Alain Bourdier, and Emma Lagracie
Nonlin. Processes Geophys., 29, 265–277, https://doi.org/10.5194/npg-29-265-2022, https://doi.org/10.5194/npg-29-265-2022, 2022
Short summary
Short summary
The complexity of geophysics systems results in time series with fluctuations at all timescales. The analysis of their variability then consists in decomposing them into a set of basis signals. We developed here a new adaptive filtering method called empirical adaptive wavelet decomposition that optimizes the empirical-mode decomposition existing technique, overcoming its drawbacks using the rigour of wavelets as defined in the recently published empirical wavelet transform method.
Benjamin Walleshauser and Erik Bollt
Nonlin. Processes Geophys., 29, 255–264, https://doi.org/10.5194/npg-29-255-2022, https://doi.org/10.5194/npg-29-255-2022, 2022
Short summary
Short summary
As sea surface temperature (SST) is vital for understanding the greater climate of the Earth and is also an important variable in weather prediction, we propose a model that effectively capitalizes on the reduced complexity of machine learning models while still being able to efficiently predict over a large spatial domain. We find that it is proficient at predicting the SST at specific locations as well as over the greater domain of the Earth’s oceans.
Valerio Lucarini, Larissa Serdukova, and Georgios Margazoglou
Nonlin. Processes Geophys., 29, 183–205, https://doi.org/10.5194/npg-29-183-2022, https://doi.org/10.5194/npg-29-183-2022, 2022
Short summary
Short summary
In most of the investigations on metastable systems, the stochastic forcing is modulated by Gaussian noise. Lévy noise laws, which describe jump processes, have recently received a lot of attention, but much less is known. We study stochastic versions of the Ghil–Sellers energy balance model, and we highlight the fundamental difference between how transitions are performed between the competing warm and snowball states, depending on whether Gaussian or Lévy noise acts as forcing.
Raphael Kriegmair, Yvonne Ruckstuhl, Stephan Rasp, and George Craig
Nonlin. Processes Geophys., 29, 171–181, https://doi.org/10.5194/npg-29-171-2022, https://doi.org/10.5194/npg-29-171-2022, 2022
Short summary
Short summary
Our regional numerical weather prediction models run at kilometer-scale resolutions. Processes that occur at smaller scales not yet resolved contribute significantly to the atmospheric flow. We use a neural network (NN) to represent the unresolved part of physical process such as cumulus clouds. We test this approach on a simplified, yet representative, 1D model and find that the NN corrections vastly improve the model forecast up to a couple of days.
Robert Polzin, Annette Müller, Henning Rust, Peter Névir, and Péter Koltai
Nonlin. Processes Geophys., 29, 37–52, https://doi.org/10.5194/npg-29-37-2022, https://doi.org/10.5194/npg-29-37-2022, 2022
Short summary
Short summary
In this study, a recent algorithmic framework called Direct Bayesian Model Reduction (DBMR) is applied which provides a scalable probability-preserving identification of reduced models directly from data. The stochastic method is tested in a meteorological application towards a model reduction to latent states of smaller scale convective activity conditioned on large-scale atmospheric flow.
Justin Schulte, Frederick Policelli, and Benjamin Zaitchik
Nonlin. Processes Geophys., 29, 1–15, https://doi.org/10.5194/npg-29-1-2022, https://doi.org/10.5194/npg-29-1-2022, 2022
Short summary
Short summary
The skewness of a time series is commonly used to quantify the extent to which positive (negative) deviations from the mean are larger than negative (positive) ones. However, in some cases, traditional skewness may not provide reliable information about time series skewness, motivating the development of a waveform skewness index in this paper. The waveform skewness index is used to show that changes in the relationship strength between climate time series could arise from changes in skewness.
Bo Christiansen
Nonlin. Processes Geophys., 28, 409–422, https://doi.org/10.5194/npg-28-409-2021, https://doi.org/10.5194/npg-28-409-2021, 2021
Short summary
Short summary
In geophysics we often need to analyse large samples of high-dimensional fields. Fortunately but counterintuitively, such high dimensionality can be a blessing, and we demonstrate how this allows simple analytical results to be derived. These results include estimates of correlations between sample members and how the sample mean depends on the sample size. We show that the properties of high dimensionality with success can be applied to climate fields, such as those from ensemble modelling.
Achim Wirth and Bertrand Chapron
Nonlin. Processes Geophys., 28, 371–378, https://doi.org/10.5194/npg-28-371-2021, https://doi.org/10.5194/npg-28-371-2021, 2021
Short summary
Short summary
In non-equilibrium statistical mechanics, which describes forced-dissipative systems such as air–sea interaction, there is no universal probability density function (pdf). Some such systems have recently been demonstrated to exhibit a symmetry called a fluctuation theorem (FT), which strongly constrains the shape of the pdf. Using satellite data, the mechanical power input to the ocean by air–sea interaction following or not a FT is questioned. A FT is found to apply over specific ocean regions.
Camille Besombes, Olivier Pannekoucke, Corentin Lapeyre, Benjamin Sanderson, and Olivier Thual
Nonlin. Processes Geophys., 28, 347–370, https://doi.org/10.5194/npg-28-347-2021, https://doi.org/10.5194/npg-28-347-2021, 2021
Short summary
Short summary
This paper investigates the potential of a type of deep generative neural network to produce realistic weather situations when trained from the climate of a general circulation model. The generator represents the climate in a compact latent space. It is able to reproduce many aspects of the targeted multivariate distribution. Some properties of our method open new perspectives such as the exploration of the extremes close to a given state or how to connect two realistic weather states.
Gerd Schädler and Marcus Breil
Nonlin. Processes Geophys., 28, 231–245, https://doi.org/10.5194/npg-28-231-2021, https://doi.org/10.5194/npg-28-231-2021, 2021
Short summary
Short summary
We used regional climate networks (RCNs) to identify past heatwaves and droughts in Germany. RCNs provide information for whole areas and can provide many details of extreme events. The RCNs were constructed on the grid of the E-OBS data set. Time series correlation was used to construct the networks. Network metrics were compared to standard extreme indices and differed considerably between normal and extreme years. The results show that RCNs can identify severe and moderate extremes.
Abhirup Banerjee, Bedartha Goswami, Yoshito Hirata, Deniz Eroglu, Bruno Merz, Jürgen Kurths, and Norbert Marwan
Nonlin. Processes Geophys., 28, 213–229, https://doi.org/10.5194/npg-28-213-2021, https://doi.org/10.5194/npg-28-213-2021, 2021
Jonathan M. Lilly and Paula Pérez-Brunius
Nonlin. Processes Geophys., 28, 181–212, https://doi.org/10.5194/npg-28-181-2021, https://doi.org/10.5194/npg-28-181-2021, 2021
Short summary
Short summary
Long-lived eddies are an important part of the ocean circulation. Here a dataset for studying eddies in the Gulf of Mexico is created through the analysis of trajectories of drifting instruments. The method involves the identification of quasi-periodic signals, characteristic of particles trapped in eddies, from the displacement records, followed by the creation of a measure of statistical significance. It is expected that this dataset will be of use to other authors studying this region.
Pascal Wang, Daniele Castellana, and Henk A. Dijkstra
Nonlin. Processes Geophys., 28, 135–151, https://doi.org/10.5194/npg-28-135-2021, https://doi.org/10.5194/npg-28-135-2021, 2021
Short summary
Short summary
This paper proposes two improvements to the use of Trajectory-Adaptive Multilevel Sampling, a rare-event algorithm which computes noise-induced transition probabilities. The first improvement uses locally linearised dynamics in order to reduce the arbitrariness associated with defining what constitutes a transition. The second improvement uses empirical transition paths accumulated at high noise in order to formulate the score function which determines the performance of the algorithm.
Cristian Lussana, Thomas N. Nipen, Ivar A. Seierstad, and Christoffer A. Elo
Nonlin. Processes Geophys., 28, 61–91, https://doi.org/10.5194/npg-28-61-2021, https://doi.org/10.5194/npg-28-61-2021, 2021
Short summary
Short summary
An unprecedented amount of rainfall data is available nowadays, such as ensemble model output, weather radar estimates, and in situ observations from networks of both traditional and opportunistic sensors. Nevertheless, the exact amount of precipitation, to some extent, eludes our knowledge. The objective of our study is precipitation reconstruction through the combination of numerical model outputs with observations from multiple data sources.
Dylan Harries and Terence J. O'Kane
Nonlin. Processes Geophys., 27, 453–471, https://doi.org/10.5194/npg-27-453-2020, https://doi.org/10.5194/npg-27-453-2020, 2020
Short summary
Short summary
Different dimension reduction methods may produce profoundly different low-dimensional representations of multiscale systems. We perform a set of case studies to investigate these differences. When a clear scale separation is present, similar bases are obtained using all methods, but when this is not the case some methods may produce representations that are poorly suited for describing features of interest, highlighting the importance of a careful choice of method when designing analyses.
Josh Jacobson, William Kleiber, Michael Scheuerer, and Joseph Bellier
Nonlin. Processes Geophys., 27, 411–427, https://doi.org/10.5194/npg-27-411-2020, https://doi.org/10.5194/npg-27-411-2020, 2020
Short summary
Short summary
Most verification metrics for ensemble forecasts assess the representation of uncertainty at a particular location and time. We study a new diagnostic tool based on fractions of threshold exceedance (FTE) which evaluates an additional important attribute: the ability of ensemble forecast fields to reproduce the spatial structure of observed fields. The utility of this diagnostic tool is demonstrated through simulations and an application to ensemble precipitation forecasts.
Sebastian Lerch, Sándor Baran, Annette Möller, Jürgen Groß, Roman Schefzik, Stephan Hemri, and Maximiliane Graeter
Nonlin. Processes Geophys., 27, 349–371, https://doi.org/10.5194/npg-27-349-2020, https://doi.org/10.5194/npg-27-349-2020, 2020
Short summary
Short summary
Accurate models of spatial, temporal, and inter-variable dependencies are of crucial importance for many practical applications. We review and compare several methods for multivariate ensemble post-processing, where such dependencies are imposed via copula functions. Our investigations utilize simulation studies that mimic challenges occurring in practical applications and allow ready interpretation of the effects of different misspecifications of the numerical weather prediction ensemble.
Jaqueline Lekscha and Reik V. Donner
Nonlin. Processes Geophys., 27, 261–275, https://doi.org/10.5194/npg-27-261-2020, https://doi.org/10.5194/npg-27-261-2020, 2020
Julian Steinheuer and Petra Friederichs
Nonlin. Processes Geophys., 27, 239–252, https://doi.org/10.5194/npg-27-239-2020, https://doi.org/10.5194/npg-27-239-2020, 2020
Short summary
Short summary
Many applications require wind gust estimates at very different atmospheric altitudes, such as in the wind energy sector. However, numerical weather prediction models usually only derive estimates for gusts at 10 m above the land surface. We present a statistical model that gives the hourly peak wind speed. The model is trained based on a weather reanalysis and observations from the Hamburg Weather Mast. Reliable predictions are derived at up to 250 m, even at unobserved intermediate levels.
Moritz N. Lang, Sebastian Lerch, Georg J. Mayr, Thorsten Simon, Reto Stauffer, and Achim Zeileis
Nonlin. Processes Geophys., 27, 23–34, https://doi.org/10.5194/npg-27-23-2020, https://doi.org/10.5194/npg-27-23-2020, 2020
Short summary
Short summary
Statistical post-processing aims to increase the predictive skill of probabilistic ensemble weather forecasts by learning the statistical relation between historical pairs of observations and ensemble forecasts within a given training data set. This study compares four different training schemes and shows that including multiple years of data in the training set typically yields a more stable post-processing while it loses the ability to quickly adjust to temporal changes in the underlying data.
Achim Wirth
Nonlin. Processes Geophys., 26, 457–477, https://doi.org/10.5194/npg-26-457-2019, https://doi.org/10.5194/npg-26-457-2019, 2019
Short summary
Short summary
The conspicuous feature of the atmosphere–ocean system is the large difference in the masses of the two media. In this respect there is a strong analogy to Brownian motion, with light and fast molecules colliding with heavy and slow Brownian particles. I apply the tools of non-equilibrium statistical mechanics for studying Brownian motion to air–sea interaction.
Carsten Abraham, Amber M. Holdsworth, and Adam H. Monahan
Nonlin. Processes Geophys., 26, 401–427, https://doi.org/10.5194/npg-26-401-2019, https://doi.org/10.5194/npg-26-401-2019, 2019
Short summary
Short summary
Atmospheric stably stratified boundary layers display transitions between regimes of sustained and intermittent turbulence. These transitions are not well represented in numerical weather prediction and climate models. A prototype explicitly stochastic turbulence parameterization simulating regime dynamics is presented and tested in an idealized model. Results demonstrate that the approach can improve the regime representation in models.
Jari-Pekka Nousu, Matthieu Lafaysse, Matthieu Vernay, Joseph Bellier, Guillaume Evin, and Bruno Joly
Nonlin. Processes Geophys., 26, 339–357, https://doi.org/10.5194/npg-26-339-2019, https://doi.org/10.5194/npg-26-339-2019, 2019
Short summary
Short summary
Forecasting the height of new snow is crucial for avalanche hazard, road viability, ski resorts and tourism. The numerical models suffer from systematic and significant errors which are misleading for the final users. Here, we applied for the first time a state-of-the-art statistical method to correct ensemble numerical forecasts of the height of new snow from their statistical link with measurements in French Alps and Pyrenees. Thus the realism of automatic forecasts can be quickly improved.
Jürgen Kurths, Ankit Agarwal, Roopam Shukla, Norbert Marwan, Maheswaran Rathinasamy, Levke Caesar, Raghavan Krishnan, and Bruno Merz
Nonlin. Processes Geophys., 26, 251–266, https://doi.org/10.5194/npg-26-251-2019, https://doi.org/10.5194/npg-26-251-2019, 2019
Short summary
Short summary
We examined the spatial diversity of Indian rainfall teleconnection at different timescales, first by identifying homogeneous communities and later by computing non-linear linkages between the identified communities (spatial regions) and dominant climatic patterns, represented by climatic indices such as El Nino–Southern Oscillation, Indian Ocean Dipole, North Atlantic Oscillation, Pacific Decadal Oscillation and Atlantic Multi-Decadal Oscillation.
Justin A. Schulte
Nonlin. Processes Geophys., 26, 91–108, https://doi.org/10.5194/npg-26-91-2019, https://doi.org/10.5194/npg-26-91-2019, 2019
Short summary
Short summary
Statistical hypothesis tests in wavelet analysis are used to asses the likelihood that time series features are noise. The choice of test will determine which features emerge as a signal. Tests based on area do poorly at distinguishing abrupt fluctuations from periodic behavior, unlike tests based on arclength that do better. The application of the tests suggests that there are features in Indian rainfall time series that emerge from background noise.
Jonathan Demaeyer and Stéphane Vannitsem
Nonlin. Processes Geophys., 25, 605–631, https://doi.org/10.5194/npg-25-605-2018, https://doi.org/10.5194/npg-25-605-2018, 2018
Short summary
Short summary
We investigate the modeling of the effects of the unresolved scales on the large scales of the coupled ocean–atmosphere model MAOOAM. Two different physically based stochastic methods are considered and compared, in various configurations of the model. Both methods show remarkable performances and are able to model fundamental changes in the model dynamics. Ways to improve the parameterizations' implementation are also proposed.
Adam H. Monahan
Nonlin. Processes Geophys., 25, 335–353, https://doi.org/10.5194/npg-25-335-2018, https://doi.org/10.5194/npg-25-335-2018, 2018
Short summary
Short summary
Bivariate probability density functions (pdfs) of wind speed characterize the relationship between speeds at two different locations or times. This study develops such pdfs of wind speed from distributions of the components, following a well-established approach for univariate distributions. The ability of these models to characterize example observed datasets is assessed. The mathematical complexity of these models suggests further extensions of this line of reasoning may not be practical.
Berenice Rojo-Garibaldi, David Alberto Salas-de-León, María Adela Monreal-Gómez, Norma Leticia Sánchez-Santillán, and David Salas-Monreal
Nonlin. Processes Geophys., 25, 291–300, https://doi.org/10.5194/npg-25-291-2018, https://doi.org/10.5194/npg-25-291-2018, 2018
Short summary
Short summary
Hurricanes are complex systems that carry large amounts of energy. Its impact produces, most of the time, natural disasters involving the loss of human lives and of materials and infrastructure that is accounted for in billions of US dollars. Not everything is negative as hurricanes are the main source of rainwater for the regions where they develop. In this study we make a nonlinear analysis of the time series obtained from 1749 to 2012 of the hurricane occurrence in the Gulf of Mexico.
Guillaume Lenoir and Michel Crucifix
Nonlin. Processes Geophys., 25, 145–173, https://doi.org/10.5194/npg-25-145-2018, https://doi.org/10.5194/npg-25-145-2018, 2018
Short summary
Short summary
We develop a general framework for the frequency analysis of irregularly sampled time series. We also design a test of significance against a general background noise which encompasses the Gaussian white or red noise. Our results generalize and unify methods developed in the fields of geosciences, engineering, astronomy and astrophysics. All the analysis tools presented in this paper are available to the reader in the Python package WAVEPAL.
Guillaume Lenoir and Michel Crucifix
Nonlin. Processes Geophys., 25, 175–200, https://doi.org/10.5194/npg-25-175-2018, https://doi.org/10.5194/npg-25-175-2018, 2018
Short summary
Short summary
There is so far no general framework for handling the continuous wavelet transform when the time sampling is irregular. Here we provide such a framework with the Morlet wavelet, based on the results of part I of this study. We also design a test of significance against a general background noise which encompasses the Gaussian white or red noise. All the analysis tools presented in this article are available to the reader in the Python package WAVEPAL.
Valerie N. Livina, Albert Brouwer, Peter Harris, Lian Wang, Kostas Sotirakopoulos, and Stephen Robinson
Nonlin. Processes Geophys., 25, 89–97, https://doi.org/10.5194/npg-25-89-2018, https://doi.org/10.5194/npg-25-89-2018, 2018
Short summary
Short summary
We have applied tipping point analysis to a large record of ocean acoustic data to identify the main components of the acoustic dynamical system: long-term and seasonal trends, system states and fluctuations. We reconstructed a one-dimensional stochastic model equation to approximate the acoustic dynamical system. We have found a signature of El Niño events in the deep ocean acoustic data near the southwest Australian coast, which proves the investigative power of the tipping point methodology.
Marc Bengulescu, Philippe Blanc, and Lucien Wald
Nonlin. Processes Geophys., 25, 19–37, https://doi.org/10.5194/npg-25-19-2018, https://doi.org/10.5194/npg-25-19-2018, 2018
Short summary
Short summary
We employ the Hilbert–Huang transform to study the temporal variability in time series of daily means of the surface solar irradiance (SSI) at different locations around the world. The data have a significant spectral peak corresponding to the yearly variability cycle and feature quasi-stochastic high-frequency "weather noise", irrespective of the geographical location or of the local climate. Our findings can improve models for estimating SSI from satellite images or forecasts of the SSI.
Manfred Mudelsee and Miguel A. Bermejo
Nonlin. Processes Geophys., 24, 737–744, https://doi.org/10.5194/npg-24-737-2017, https://doi.org/10.5194/npg-24-737-2017, 2017
Short summary
Short summary
Risk analysis of extremes has high socioeconomic relevance. Of crucial interest is the tail probability, P, of the distribution of a variable, which is the chance of observing a value equal to or greater than a certain threshold value, x. Many variables in geophysical systems (e.g. climate) show heavy tail behaviour, where P may be rather large. In particular, P decreases with x as a power law that is described by a parameter, α. We present an improved method to estimate α on data.
Kathrin Padberg-Gehle and Christiane Schneide
Nonlin. Processes Geophys., 24, 661–671, https://doi.org/10.5194/npg-24-661-2017, https://doi.org/10.5194/npg-24-661-2017, 2017
Short summary
Short summary
Transport and mixing processes in fluid flows are crucially influenced by coherent structures, such as eddies, gyres, or jets in geophysical flows. We propose a very simple and computationally efficient approach for analyzing coherent behavior in fluid flows. The central object is a flow network constructed directly from particle trajectories. The network's local and spectral properties are shown to give a very good indication of coherent as well as mixing regions in the underlying flow.
Ankit Agarwal, Norbert Marwan, Maheswaran Rathinasamy, Bruno Merz, and Jürgen Kurths
Nonlin. Processes Geophys., 24, 599–611, https://doi.org/10.5194/npg-24-599-2017, https://doi.org/10.5194/npg-24-599-2017, 2017
Short summary
Short summary
Extreme events such as floods and droughts result from synchronization of different natural processes working at multiple timescales. Investigation on an observation timescale will not reveal the inherent underlying dynamics triggering these events. This paper develops a new method based on wavelets and event synchronization to unravel the hidden dynamics responsible for such sudden events. This method is tested with synthetic and real-world cases and the results are promising.
Jonathan M. Lilly, Adam M. Sykulski, Jeffrey J. Early, and Sofia C. Olhede
Nonlin. Processes Geophys., 24, 481–514, https://doi.org/10.5194/npg-24-481-2017, https://doi.org/10.5194/npg-24-481-2017, 2017
Short summary
Short summary
This work arose from a desire to understand the nature of particle motions in turbulence. We sought a simple conceptual model that could describe such motions, then realized that this model could be applicable to an array of other problems. The basic idea is to create a string of random numbers, called a stochastic process, that mimics the properties of particle trajectories. This model could be useful in making best use of data from freely drifting instruments tracking the ocean currents.
Finn Müller-Hansen, Manoel F. Cardoso, Eloi L. Dalla-Nora, Jonathan F. Donges, Jobst Heitzig, Jürgen Kurths, and Kirsten Thonicke
Nonlin. Processes Geophys., 24, 113–123, https://doi.org/10.5194/npg-24-113-2017, https://doi.org/10.5194/npg-24-113-2017, 2017
Short summary
Short summary
Deforestation and subsequent land uses in the Brazilian Amazon have huge impacts on greenhouse gas emissions, local climate and biodiversity. To better understand these land-cover changes, we apply complex systems methods uncovering spatial patterns in regional transition probabilities between land-cover types, which we estimate using maps derived from satellite imagery. The results show clusters of similar land-cover dynamics and thus complement studies at the local scale.
Cited articles
Abry, P., Flandrin, P., Taqqu, M. S., and Veitch, D.: Self-similarity and long-range dependence through the wavelet lens, in: Theory and Applications of Long-Range Dependence, Birkhaeuser, Boston, USA, 527–556, 2003.
Adenstedt, R. K.: On Large-sample Estimation for the Mean of a Stationary Random Sequence, Ann. Stat., 2, 1095–1107, 1974.
Anděl, J.: Long Memory Time Series Models, Kybernetika, 22, 105–123, 1986.
Barnes, J. A. and Allan, D. W.: A statistical model of flicker noise, Proc. IEEE, 54, 176–178, 1966.
Beran, J.: Statistics for Long Memory Processes, Chapman & Hall, New York, 1994a.
Beran, J.: On a Class of M-Estimators for Gaussian Long-Memory Models, Biometrika, 81, 755–766, 1994b.
Beran, J., Feng, Y., Ghosh, S., and Kulik, R.: Long Memory Processes, Springer, Heidelberg, 2013.
Box, G. E. P. and Jenkins, G. M.: Time Series Analysis, Forecasting and Control, Holden-Day, Wiley, Hoboken, USA, 1970.
Brockwell, P. J. and Davis, R. A.: Time Series: Theory and Methods, 2nd Edn., Springer, New York, 1991.
Bunde, A., Ludescher, J., Franzke, C., and Schellnhuber, H.-J.: How significant is West Antarctic warming?, Nat. Geosci., 7, 246–247, 2014.
Cleveland, R. B., Cleveland, W. S., McRae, J. E., and Terpenning, I.: STL: A Seasonal-Trend Decomposition Procedure Based on Loess, J. Offic. Stat., 6, 3–73, 1990.
Eğr\.ioğlu, E. and Günay, S.: Bayesian model selection in ARFIMA models, Expert Sys. Appl., 37, 8359–8364, 2010.
Ehlers, R. S. and Brooks, S. P.: Bayesian analysis of order uncertainty in ARIMA models, Tech. rep., Department of Statistics, Federal University of Paraná, http://www.est.ufpr.br/rt/ehlb06.pdf (last access: November 2015), 2006.
Ehlers, R. S. and Brooks, S. P.: Adaptive proposal construction for reversible jump MCMC, Scand. J. Stat., 35, 677–690, 2008.
Fraley, C., Leisch, F., Maechler, M., Reisen, V., and Lemonte, A.: \textttfracdiff: Fractionally differenced ARIMA aka ARFIMA(p,d,q) models, R package version 1.4-1, http://CRAN.R-project.org/package=fracdiff (last access: November 2015), 2012.
Franzke, C. L. E.: Long-range Dependence and Climate Noise Characteristics of Antarctic Temperature Data, J. Climate, 23, 6074–6081, 2010.
Franzke, C. L. E.: Nonlinear trends, long-range dependence and climate noise properties of surface air temperature, J. Climate, 25, 4172–4183, 2012.
Franzke, C. L. E., Graves, T., Watkins, N. W., Gramacy, R. B., and Hughes, C.: Robustness of estimators of long-range dependence and self-similarity under non-Gaussianity, Philos. T. Roy. Soc. A, 370, 1250–1267, 2012.
Genz, A., Bretz, F., Miwa, T., Mi, X., Leisch, F., Scheipl, F., and Hothorn, T.: \textttmvtnorm: Multivariate Normal and t Distributions, R package version 0.9-9992, http://CRAN.R-project.org/package=mvtnorm (last access: November 2015), 2012.
Geweke, J. and Porter-Hudak, S.: The estimation and application of long-memory time series models, J. Time Ser. Anal., 4, 221–238, 1983.
Gil-Alana, L. A.: An Application of Fractional Integration to a Long Temperature Series, Int. J. Climatol., 23, 1699–1710, 2003.
Gil-Alana, L. A.: Cyclical long-range dependence and the warming effect in a long temperature time series, Int. J. Climatol., 28, 1435–1443, 2008.
Giraitis, L. and Leipus, R.: A generalized fractionally differencing approach in long-memory modeling, Lithuan. Math. J., 35, 53–65, 1995.
Granger, C. W. J. and Joyeux, R.: An Introduction to Long-memory Time Series Models and Fractional Differencing, J. Time Ser. Anal., 1, 15–29, 1980.
Graves, T.: A systematic approach to Bayesian inference for long memory processes, PhD thesis, University of Cambridge, Cambridge, UK, 2013.
Graves, T., Gramacy, R. B., Watkins, N. W., and Franzke, C.: A brief history of long memory, Tech. rep., The University of Chicago, http://arxiv.org/abs/1406.6018, last access: 4 November 2014.
Gray, H. L., Zhang, N.-F., and Woodward, W. A.: On generalized fractional processes, J. Time Ser. Anal., 10, 233–257, 1989.
Gray, H. L., Zhang, N.-F., and Woodward, W. A.: Correction to: Gray et al. (1989), J. Time Ser. Anal., 15, 561–562, 1994.
Green, P. J.: Reversible jump Markov chain Monte Carlo computation and Bayesian model determination, Biometrika, 82, 711–732, 1995.
Haslett, J. and Raftery, A. E.: Space-time Modelling with Long-memory Dependence: Assessing Ireland's Wind Power Resource, J. Roy. Stat. Soc. Ser. C, 38, 1–50, 1989.
Hassler, U.: (Mis)specification of long memory in seasonal time, J. Time Ser. Anal., 15, 19–30, 1994.
Holan, S., McElroy, T., and Chakraborty, S.: A Bayesian Approach to Estimating the Long Memory Parameter, Bayesian Analysis, 4, 159–190, 2009.
Hosking, J. R. M.: Fractional differencing, Biometrika, 68, 165–176, 1981.
Hosking, J. R. M.: Modeling persistence in hydrological time series using fractional differencing, Water Resour. Res., 20, 1898–1908, 1984.
Hsu, N.-J. and Breidt, F. J.: Bayesian Analysis of Fractionally Integrated ARMA with additive noise, J. Forecast., 22, 491–514, 2003.
Hurst, H. E.: Long-term storage capacity of reservoirs, T. Am. Soc. Civ. Eng., 116, 770–808, 1951.
Kärner, O.: Comment on Hurst Exponent, Geophys. Res. Lett., 28, 3825–3826, https://doi.org/10.1029/2001GL013104, 2001.
Kay, S. M. and Marple, S. L.: Spectrum analysis – A modern perspective, Proc. IEEE, 69, 1380–1419, 1981.
Ko, K. and Vannucci, M.: Bayesian wavelet analysis of autoregressive fractionally integrated moving-average processes, J. Stat. Plan. Inf., 136, 3415–3434, 2006a.
Ko, K. and Vannucci, M.: Bayesian Wavelet-Based Methods for the Detection of Multiple Changes of the Long Memory Parameter, IEEE T. Sig. Proc., 54, 4461–4470, 2006b.
Koop, G., Ley, E., Osiewalski, J., and Steel, M. F.: Bayesian analysis of long memory and persistence using ARFIMA models, J. Econ., 76, 149–169, 1997.
Liseo, B., Marinucci, D., and Petrella, L.: Bayesian semiparametric inference on long-range dependence, Biometrika, 88, 1089–1104, 2001.
Mandelbrot, B. B. and Van Ness, J. W.: Fractional Brownian Motions, Fractional Noises and Applications, SIAM Review, 10, 422–437, 1968.
Mandelbrot, B. B. and Wallis, J. R.: Noah, Joseph and operational hydrology, Water Resour. Res., 4, 909–918, 1968.
Manley, G.: Central England temperatures: monthly means 1659 to 1973, Q. J. Roy. Meteorol. Soc., 100, 389–405, 1974.
Marriott, J. M., Ravishanker, N., Gelfand, A. E., and Pai, J. S.: Bayesian analysis for ARMA processes: complete sampling based inference under exact likelihoods, in: Bayesian Statistics and Econometrics: Essays in Honor of Arnold Zellner, edited by: Berry, D., Chaloner, K., and Geweke, J., Wiley, New York, 243–256, 1995.
McLeod, A. I., Yu, H., and Krougly, Z.: Algorithms for Linear Time Series Analysis: With R Package, J. of Statistical Software, http://www.jstatsoft.org/v23/i05/ (last access: November 2015), 2007.
Monahan, J. F.: A note on enforcing stationarity in autoregressive-moving average models, Biometrika, 71, 403–404, 1984.
Montanari, A., Rosso, R., and Taqqu, M. S.: A seasonal fractional ARIMA model applied to the Nile River monthly flows at Aswan, Water Resour. Res., 36, 1249–1259, 2000.
Pai, J. S. and Ravishanker, N.: Bayesian analysis of autoregressive fractionally integrated moving-average processes, J. Time Ser. Anal., 19, 99–112, 1998.
Palma, W.: Long Memory Time Series, Wiley, Hoboken, USA, 2007.
Peng, C. K., Buldyrev, S. V., Havlin, S., Simons, M., Stanley, H. E., and Goldberger, A. L.: Mosaic organization of DNA nucleotides, Phys. Rev. E, 49, 1685–1689, 1994.
Porter-Hudak, S.: An Application of the Seasonal Fractionally Differenced Model to the Monetary Aggregates, J. Am. Stat. Assoc., 85, 338–344, 1990.
Reisen, V. A., Rodrigues, A. L., and Palma, W.: Estimation of seasonal fractionally integrated processes, Comput. Stat. Data Anal., 50, 568–582, 2006.
Robert, C. P.: Simulation of truncated normal variables, Stat. Comput., 5, 121–125, 1995.
Roberts, G. O. and Rosenthal, J. S.: Optimal Scaling for Various Metropolis–Hastings Algorithms, Stat. Sci., 16, 351–367, 2001.
Robinson, P. M.: Efficient Tests of Nonstationary Hypotheses, J. Am. Stat. Assoc., 89, 1420–1437, 1994.
Slezak, J. and Weron, A.: From physical linear systems to discrete-time series. A guide for analysis of the sampled experimental data, Phys. Rev. E, 91, 053302, https://doi.org/10.1103/PhysRevE.91.053302, 2015.
Vermaak, J., Andrieu, C., Doucet, A., and Godsill, S.: Reversible jump Markov chain Monte Carlo strategies for Bayesian model selection in autoregressive processes, J. Time Ser. Anal., 25, 785–809, 2004.
Vyushin, D., Mayer, J., and Kushner, P.: \textttPowerSpectrum: Spectral Analysis of Time Series, R package version 0.3, http://www.atmosp.physics.utoronto.ca/people/vyushin/mysoftware.html (last access: November 2015), 2009.
Watkins, N. W.: Bunched black (and grouped grey) swans: Dissipative and non-dissipative models of correlated extreme fluctuations in complex geosystems., Geophys. Res. Lett., 40, 1–9, https://doi.org/10.1002/GRL.50103, 2013.
Woodward, W. A., Cheng, Q. C., and Gray, H. L.: A k-factor GARMA long-memory model, J. Time Ser. Anal., 19, 485–504, 1998.
Wuertz, D.: \textttfArma: ARMA Time Series Modelling, R package version 2160.77, http://CRAN.R-project.org/package=fArma (last access: November 2015), 2012.
