Articles | Volume 23, issue 3
https://doi.org/10.5194/npg-23-137-2016
© Author(s) 2016. This work is distributed under
the Creative Commons Attribution 3.0 License.
the Creative Commons Attribution 3.0 License.
https://doi.org/10.5194/npg-23-137-2016
© Author(s) 2016. This work is distributed under
the Creative Commons Attribution 3.0 License.
the Creative Commons Attribution 3.0 License.
Brief Communication: Breeding vectors in the phase space reconstructed from time series data
Erin Lynch
CORRESPONDING AUTHOR
Department of Atmospheric and Oceanic Science, University of Maryland, College Park, College Park, MD 20742, USA
Daniel Kaufman
Virginia Institute of Marine Science, College of William & Mary, Gloucester Point, VA 23062, USA
A. Surjalal Sharma
Department of Astronomy, University of Maryland, College Park, College Park, MD 20742, USA
Eugenia Kalnay
Department of Atmospheric and Oceanic Science, University of Maryland, College Park, College Park, MD 20742, USA
Institute for Physical Science and Technology, University of Maryland, College Park, College Park, MD 20742, USA
Earth System Science Interdisciplinary Center, University of Maryland, College Park, College Park, MD 20742, USA
Department of Atmospheric and Oceanic Science, University of Maryland, College Park, College Park, MD 20742, USA
Institute for Physical Science and Technology, University of Maryland, College Park, College Park, MD 20742, USA
Earth System Science Interdisciplinary Center, University of Maryland, College Park, College Park, MD 20742, USA
Center for Scientific Computation and Mathematical Modeling, University of Maryland, College Park, College Park, MD 20742, USA
Related authors
No articles found.
Eugenia Kalnay, Travis Sluka, Takuma Yoshida, Cheng Da, and Safa Mote
Nonlin. Processes Geophys., 30, 217–236, https://doi.org/10.5194/npg-30-217-2023, https://doi.org/10.5194/npg-30-217-2023, 2023
Short summary
Short summary
Strongly coupled data assimilation (SCDA) generates coherent integrated Earth system analyses by assimilating the full Earth observation set into all Earth components. We describe SCDA based on the ensemble Kalman filter with a hierarchy of coupled models, from a coupled Lorenz to the Climate Forecast System v2. SCDA with a sufficiently large ensemble can provide more accurate coupled analyses compared to weakly coupled DA. The correlation-cutoff method can compensate for a small ensemble size.
Zhiqiang Liu, Ning Zeng, Yun Liu, Eugenia Kalnay, Ghassem Asrar, Qixiang Cai, and Pengfei Han
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2023-15, https://doi.org/10.5194/gmd-2023-15, 2023
Revised manuscript not accepted
Short summary
Short summary
We introduced a novel algorithm that assimilates a better a priori knowledge to improve the estimation of global surface carbon flux. The algorithm aims at separating the first-order systematic biases in the a priori "bottom-up" flux estimations out of the inversion framework from a comprehensive data assimilation perspective.
Chu-Chun Chang and Eugenia Kalnay
Nonlin. Processes Geophys., 29, 317–327, https://doi.org/10.5194/npg-29-317-2022, https://doi.org/10.5194/npg-29-317-2022, 2022
Short summary
Short summary
This study introduces a new approach for enhancing the ensemble data assimilation (DA), a technique that combines observations and forecasts to improve numerical weather predictions. Our method uses the prescribed correlations to suppress spurious errors, improving the accuracy of DA. The experiments on the simplified atmosphere model show that our method has comparable performance to the traditional method but is superior in the early stage and is more computationally efficient.
Zhiqiang Liu, Ning Zeng, Yun Liu, Eugenia Kalnay, Ghassem Asrar, Bo Wu, Qixiang Cai, Di Liu, and Pengfei Han
Geosci. Model Dev., 15, 5511–5528, https://doi.org/10.5194/gmd-15-5511-2022, https://doi.org/10.5194/gmd-15-5511-2022, 2022
Short summary
Short summary
We described the application of a constrained ensemble Kalman filter (CEnKF) in a joint CO2 and surface carbon fluxes estimation study. By assimilating the pseudo-surface and OCO-2 observations, the annual global flux estimation is significantly biased without mass conservation. With the additional CEnKF process, the CO2 mass is strictly constrained, and the estimation of annual fluxes is significantly improved.
Hui Liu, Kevin Garrett, Kayo Ide, Ross N. Hoffman, and Katherine E. Lukens
Atmos. Meas. Tech., 15, 3925–3940, https://doi.org/10.5194/amt-15-3925-2022, https://doi.org/10.5194/amt-15-3925-2022, 2022
Short summary
Short summary
A total least squares (TLS) regression is used to optimally estimate linear speed-dependent biases between Aeolus Level-2B winds and short-term (6 h) forecasts of NOAA’s FV3GFS. The winds for 1–7 September 2019 are examined. Clear speed-dependent biases for both Mie and Rayleigh winds are found, particularly in the tropics and Southern Hemisphere. Use of the TLS correction improves the forecast of the 26–28 November 2019 winter storm over the USA.
Katherine E. Lukens, Kayo Ide, Kevin Garrett, Hui Liu, David Santek, Brett Hoover, and Ross N. Hoffman
Atmos. Meas. Tech., 15, 2719–2743, https://doi.org/10.5194/amt-15-2719-2022, https://doi.org/10.5194/amt-15-2719-2022, 2022
Short summary
Short summary
Winds that are crucial to weather forecasting derived from two different techniques – tracking satellite images (AMVs) and direct measurement of molecular and aerosol motions by Doppler lidar (Aeolus satellite winds) – are compared. We find that AMVs and Aeolus winds are highly correlated. Aeolus Mie-cloudy winds have great potential value as a comparison standard for AMVs. Larger differences are found in the Southern Hemisphere related to higher wind speed and higher vertical variation in wind.
Yun Liu, Eugenia Kalnay, Ning Zeng, Ghassem Asrar, Zhaohui Chen, and Binghao Jia
Geosci. Model Dev., 12, 2899–2914, https://doi.org/10.5194/gmd-12-2899-2019, https://doi.org/10.5194/gmd-12-2899-2019, 2019
Short summary
Short summary
We developed a new carbon data assimilation system to estimate the surface carbon fluxes using the LETKF and GEOS-Chem model, which uses a new scheme with a short
assimilation windowand a long
observation window. The analysis is more accurate using the short assimilation window and is exposed to the future observations that accelerate the spin-up. In OSSE, the system reduces the analysis error significantly, suggesting that this method could be used for other data assimilation problems.
Guo-Yuan Lien, Daisuke Hotta, Eugenia Kalnay, Takemasa Miyoshi, and Tse-Chun Chen
Nonlin. Processes Geophys., 25, 129–143, https://doi.org/10.5194/npg-25-129-2018, https://doi.org/10.5194/npg-25-129-2018, 2018
Short summary
Short summary
The ensemble forecast sensitivity to observation (EFSO) method can efficiently clarify under what conditions observations are beneficial or detrimental for assimilation. Based on EFSO, an offline assimilation method is proposed to accelerate the development of data selection strategies for new observing systems. The usefulness of this method is demonstrated with the assimilation of global satellite precipitation data.
Daniel E. Kaufman, Marjorie A. M. Friedrichs, John C. P. Hemmings, and Walker O. Smith Jr.
Biogeosciences, 15, 73–90, https://doi.org/10.5194/bg-15-73-2018, https://doi.org/10.5194/bg-15-73-2018, 2018
Short summary
Short summary
Computer simulations of the highly variable phytoplankton in the Ross Sea demonstrated how incorporating data from different sources (satellite, ship, or glider) results in different system interpretations. For example, simulations assimilating satellite-based data produced lower carbon export estimates. Combining observations with models in this remote, harsh, and biologically variable environment should include consideration of the potential impacts of data frequency, duration, and coverage.
Yun Liu, Eugenia Kalnay, Ning Zeng, Ghassem Asrar, Zhaohui Chen, and Binghao Jia
Atmos. Chem. Phys. Discuss., https://doi.org/10.5194/acp-2017-888, https://doi.org/10.5194/acp-2017-888, 2017
Preprint withdrawn
Short summary
Short summary
We developed a new Carbon data assimilation system to estimate the surface carbon fluxes using the LETKF and GEOS-Chem model, which uses a new scheme with a short
assimilation windowand a long
observation window. The analysis is more accurate with the short assimilation window and is exposed to the future observations accelerating the spin up. In OSSE, the system reduces significantly the analysis error, suggesting that this method could be used in other data assimilation problems.
Fang Zhao, Ning Zeng, Ghassem Asrar, Pierre Friedlingstein, Akihiko Ito, Atul Jain, Eugenia Kalnay, Etsushi Kato, Charles D. Koven, Ben Poulter, Rashid Rafique, Stephen Sitch, Shijie Shu, Beni Stocker, Nicolas Viovy, Andy Wiltshire, and Sonke Zaehle
Biogeosciences, 13, 5121–5137, https://doi.org/10.5194/bg-13-5121-2016, https://doi.org/10.5194/bg-13-5121-2016, 2016
Short summary
Short summary
The increasing seasonality of atmospheric CO2 is strongly linked with enhanced land vegetation activities in the last 5 decades, for which the importance of increasing CO2, climate and land use/cover change was evaluated in single model studies (Zeng et al., 2014; Forkel et al., 2016). Here we examine the relative importance of these factors in multiple models. Our results highlight models can show similar results in some benchmarks with different underlying regional dynamics.
N. Jain and A. S. Sharma
Ann. Geophys., 33, 719–724, https://doi.org/10.5194/angeo-33-719-2015, https://doi.org/10.5194/angeo-33-719-2015, 2015
Short summary
Short summary
In magnetic reconnection in collisionless plasmas, a quadrupole structure of the magnetic field component in the direction of current supporting the reconnecting magnetic field is generated down to electron scales. This paper shows that the magnetic field can develop a "nested structure of quadrupoles" at the electron scales and identifies the nested structure in Cluster observations. Results are useful in interpreting the electron physics in observations, in particular by the NASA/MMS mission.
S. G. Penny, E. Kalnay, J. A. Carton, B. R. Hunt, K. Ide, T. Miyoshi, and G. A. Chepurin
Nonlin. Processes Geophys., 20, 1031–1046, https://doi.org/10.5194/npg-20-1031-2013, https://doi.org/10.5194/npg-20-1031-2013, 2013
Related subject area
Subject: Time series, machine learning, networks, stochastic processes, extreme events | Topic: Climate, atmosphere, ocean, hydrology, cryosphere, biosphere
Evaluation of forecasts by a global data-driven weather model with and without probabilistic post-processing at Norwegian stations
Characterisation of Dansgaard-Oeschger events in palaeoclimate time series using the Matrix Profile
The sampling method for optimal precursors of El Niño–Southern Oscillation events
A comparison of two causal methods in the context of climate analyses
A two-fold deep-learning strategy to correct and downscale winds over mountains
Downscaling of surface wind forecasts using convolutional neural networks
Superstatistical analysis of sea surface currents in the Gulf of Trieste, measured by high-frequency radar, and its relation to wind regimes using the maximum-entropy principle
Representation learning with unconditional denoising diffusion models for dynamical systems
Physically constrained covariance inflation from location uncertainty
Data-driven methods to estimate the committor function in conceptual ocean models
Exploring meteorological droughts' spatial patterns across Europe through complex network theory
Rain process models and convergence to point processes
Integrated hydrodynamic and machine learning models for compound flooding prediction in a data-scarce estuarine delta
Empirical adaptive wavelet decomposition (EAWD): an adaptive decomposition for the variability analysis of observation time series in atmospheric science
Predicting sea surface temperatures with coupled reservoir computers
Lévy noise versus Gaussian-noise-induced transitions in the Ghil–Sellers energy balance model
Using neural networks to improve simulations in the gray zone
Direct Bayesian model reduction of smaller scale convective activity conditioned on large-scale dynamics
A waveform skewness index for measuring time series nonlinearity and its applications to the ENSO–Indian monsoon relationship
The blessing of dimensionality for the analysis of climate data
Empirical evidence of a fluctuation theorem for the wind mechanical power input into the ocean
Producing realistic climate data with generative adversarial networks
Identification of droughts and heatwaves in Germany with regional climate networks
Recurrence analysis of extreme event-like data
Extracting statistically significant eddy signals from large Lagrangian datasets using wavelet ridge analysis, with application to the Gulf of Mexico
Improvements to the use of the Trajectory-Adaptive Multilevel Sampling algorithm for the study of rare events
Ensemble-based statistical interpolation with Gaussian anamorphosis for the spatial analysis of precipitation
Applications of matrix factorization methods to climate data
Beyond univariate calibration: verifying spatial structure in ensembles of forecast fields
Simulation-based comparison of multivariate ensemble post-processing methods
Detecting dynamical anomalies in time series from different palaeoclimate proxy archives using windowed recurrence network analysis
Vertical profiles of wind gust statistics from a regional reanalysis using multivariate extreme value theory
Remember the past: a comparison of time-adaptive training schemes for non-homogeneous regression
On fluctuating momentum exchange in idealised models of air–sea interaction
A prototype stochastic parameterization of regime behaviour in the stably stratified atmospheric boundary layer
Statistical post-processing of ensemble forecasts of the height of new snow
Unravelling the spatial diversity of Indian precipitation teleconnections via a non-linear multi-scale approach
Statistical hypothesis testing in wavelet analysis: theoretical developments and applications to Indian rainfall
Comparison of stochastic parameterizations in the framework of a coupled ocean–atmosphere model
Idealized models of the joint probability distribution of wind speeds
Nonlinear analysis of the occurrence of hurricanes in the Gulf of Mexico and the Caribbean Sea
A general theory on frequency and time–frequency analysis of irregularly sampled time series based on projection methods – Part 1: Frequency analysis
A general theory on frequency and time–frequency analysis of irregularly sampled time series based on projection methods – Part 2: Extension to time–frequency analysis
Tipping point analysis of ocean acoustic noise
On the intrinsic timescales of temporal variability in measurements of the surface solar radiation
Optimal heavy tail estimation – Part 1: Order selection
Network-based study of Lagrangian transport and mixing
Multi-scale event synchronization analysis for unravelling climate processes: a wavelet-based approach
Fractional Brownian motion, the Matérn process, and stochastic modeling of turbulent dispersion
A matrix clustering method to explore patterns of land-cover transitions in satellite-derived maps of the Brazilian Amazon
John Bjørnar Bremnes, Thomas N. Nipen, and Ivar A. Seierstad
Nonlin. Processes Geophys., 31, 247–257, https://doi.org/10.5194/npg-31-247-2024, https://doi.org/10.5194/npg-31-247-2024, 2024
Short summary
Short summary
During the last 2 years, tremendous progress has been made in global data-driven weather models trained on reanalysis data. In this study, the Pangu-Weather model is compared to several numerical weather prediction models with and without probabilistic post-processing for temperature and wind speed forecasting. The results confirm that global data-driven models are promising for operational weather forecasting and that post-processing can improve these forecasts considerably.
Susana Barbosa, Maria Eduarda Silva, and Denis-Didier Rousseau
Nonlin. Processes Geophys. Discuss., https://doi.org/10.5194/npg-2024-13, https://doi.org/10.5194/npg-2024-13, 2024
Revised manuscript accepted for NPG
Short summary
Short summary
The characterisation of abrupt transitions in palaeoclimate records allows the understanding of millennial climate variability and of potential tipping points in the context of current climate change. In our study an algorithmic method, the matrix profile, is employed to characterise abrupt warmings designated as Dansgaard-Oeschger (DO) events and to identify the most similar transitions in the palaeoclimate time series.
Bin Shi and Junjie Ma
Nonlin. Processes Geophys., 31, 165–174, https://doi.org/10.5194/npg-31-165-2024, https://doi.org/10.5194/npg-31-165-2024, 2024
Short summary
Short summary
Different from traditional deterministic optimization algorithms, we implement the sampling method to compute the conditional nonlinear optimal perturbations (CNOPs) in the realistic and predictive coupled ocean–atmosphere model, which reduces the first-order information to the zeroth-order one, avoiding the high-cost computation of the gradient. The numerical performance highlights the importance of stochastic optimization algorithms to compute CNOPs and capture initial optimal precursors.
David Docquier, Giorgia Di Capua, Reik V. Donner, Carlos A. L. Pires, Amélie Simon, and Stéphane Vannitsem
Nonlin. Processes Geophys., 31, 115–136, https://doi.org/10.5194/npg-31-115-2024, https://doi.org/10.5194/npg-31-115-2024, 2024
Short summary
Short summary
Identifying causes of specific processes is crucial in order to better understand our climate system. Traditionally, correlation analyses have been used to identify cause–effect relationships in climate studies. However, correlation does not imply causation, which justifies the need to use causal methods. We compare two independent causal methods and show that these are superior to classical correlation analyses. We also find some interesting differences between the two methods.
Louis Le Toumelin, Isabelle Gouttevin, Clovis Galiez, and Nora Helbig
Nonlin. Processes Geophys., 31, 75–97, https://doi.org/10.5194/npg-31-75-2024, https://doi.org/10.5194/npg-31-75-2024, 2024
Short summary
Short summary
Forecasting wind fields over mountains is of high importance for several applications and particularly for understanding how wind erodes and disperses snow. Forecasters rely on operational wind forecasts over mountains, which are currently only available on kilometric scales. These forecasts can also be affected by errors of diverse origins. Here we introduce a new strategy based on artificial intelligence to correct large-scale wind forecasts in mountains and increase their spatial resolution.
Florian Dupuy, Pierre Durand, and Thierry Hedde
Nonlin. Processes Geophys., 30, 553–570, https://doi.org/10.5194/npg-30-553-2023, https://doi.org/10.5194/npg-30-553-2023, 2023
Short summary
Short summary
Forecasting near-surface winds over complex terrain requires high-resolution numerical weather prediction models, which drastically increase the duration of simulations and hinder them in running on a routine basis. A faster alternative is statistical downscaling. We explore different ways of calculating near-surface wind speed and direction using artificial intelligence algorithms based on various convolutional neural networks in order to find the best approach for wind downscaling.
Sofia Flora, Laura Ursella, and Achim Wirth
Nonlin. Processes Geophys., 30, 515–525, https://doi.org/10.5194/npg-30-515-2023, https://doi.org/10.5194/npg-30-515-2023, 2023
Short summary
Short summary
An increasing amount of data allows us to move from low-order moments of fluctuating observations to their PDFs. We found the analytical fat-tailed PDF form (a combination of Gaussian and two-exponential convolutions) for 2 years of sea surface current increments in the Gulf of Trieste, using superstatistics and the maximum-entropy principle twice: on short and longer timescales. The data from different wind regimes follow the same analytical PDF, pointing towards a universal behaviour.
Tobias Sebastian Finn, Lucas Disson, Alban Farchi, Marc Bocquet, and Charlotte Durand
EGUsphere, https://doi.org/10.5194/egusphere-2023-2261, https://doi.org/10.5194/egusphere-2023-2261, 2023
Short summary
Short summary
We train neural networks as denoising diffusion models for state generation in the Lorenz 1963 system and demonstrate that they learn an internal representation of the system. We make use of this learned representation and the pre-trained model in two downstream tasks: surrogate modelling and ensemble generation. For both tasks, the diffusion model can outperform other more common approaches. Thus, we see a potential of representation learning with diffusion models for dynamical systems.
Yicun Zhen, Valentin Resseguier, and Bertrand Chapron
Nonlin. Processes Geophys., 30, 237–251, https://doi.org/10.5194/npg-30-237-2023, https://doi.org/10.5194/npg-30-237-2023, 2023
Short summary
Short summary
This paper provides perspective that the displacement vector field of physical state fields should be determined by the tensor fields associated with the physical fields. The advantage of this perspective is that certain physical quantities can be conserved while applying a displacement vector field to transfer the original physical field. A direct application of this perspective is the physically constrained covariance inflation scheme proposed in this paper.
Valérian Jacques-Dumas, René M. van Westen, Freddy Bouchet, and Henk A. Dijkstra
Nonlin. Processes Geophys., 30, 195–216, https://doi.org/10.5194/npg-30-195-2023, https://doi.org/10.5194/npg-30-195-2023, 2023
Short summary
Short summary
Computing the probability of occurrence of rare events is relevant because of their high impact but also difficult due to the lack of data. Rare event algorithms are designed for that task, but their efficiency relies on a score function that is hard to compute. We compare four methods that compute this function from data and measure their performance to assess which one would be best suited to be applied to a climate model. We find neural networks to be most robust and flexible for this task.
Domenico Giaquinto, Warner Marzocchi, and Jürgen Kurths
Nonlin. Processes Geophys., 30, 167–181, https://doi.org/10.5194/npg-30-167-2023, https://doi.org/10.5194/npg-30-167-2023, 2023
Short summary
Short summary
Despite being among the most severe climate extremes, it is still challenging to assess droughts’ features for specific regions. In this paper we study meteorological droughts in Europe using concepts derived from climate network theory. By exploring the synchronization in droughts occurrences across the continent we unveil regional clusters which are individually examined to identify droughts’ geographical propagation and source–sink systems, which could potentially support droughts’ forecast.
Scott Hottovy and Samuel N. Stechmann
Nonlin. Processes Geophys., 30, 85–100, https://doi.org/10.5194/npg-30-85-2023, https://doi.org/10.5194/npg-30-85-2023, 2023
Short summary
Short summary
Rainfall is erratic and difficult to predict. Thus, random models are often used to describe rainfall events. Since many of these random models are based more on statistics than physical laws, it is desirable to develop connections between the random statistical models and the underlying physics of rain. Here, a physics-based model is shown to converge to a statistics-based model, which helps to provide a physical basis for the statistics-based model.
Joko Sampurno, Valentin Vallaeys, Randy Ardianto, and Emmanuel Hanert
Nonlin. Processes Geophys., 29, 301–315, https://doi.org/10.5194/npg-29-301-2022, https://doi.org/10.5194/npg-29-301-2022, 2022
Short summary
Short summary
In this study, we successfully built and evaluated machine learning models for predicting water level dynamics as a proxy for compound flooding hazards in a data-scarce delta. The issues that we tackled here are data scarcity and low computational resources for building flood forecasting models. The proposed approach is suitable for use by local water management agencies in developing countries that encounter these issues.
Olivier Delage, Thierry Portafaix, Hassan Bencherif, Alain Bourdier, and Emma Lagracie
Nonlin. Processes Geophys., 29, 265–277, https://doi.org/10.5194/npg-29-265-2022, https://doi.org/10.5194/npg-29-265-2022, 2022
Short summary
Short summary
The complexity of geophysics systems results in time series with fluctuations at all timescales. The analysis of their variability then consists in decomposing them into a set of basis signals. We developed here a new adaptive filtering method called empirical adaptive wavelet decomposition that optimizes the empirical-mode decomposition existing technique, overcoming its drawbacks using the rigour of wavelets as defined in the recently published empirical wavelet transform method.
Benjamin Walleshauser and Erik Bollt
Nonlin. Processes Geophys., 29, 255–264, https://doi.org/10.5194/npg-29-255-2022, https://doi.org/10.5194/npg-29-255-2022, 2022
Short summary
Short summary
As sea surface temperature (SST) is vital for understanding the greater climate of the Earth and is also an important variable in weather prediction, we propose a model that effectively capitalizes on the reduced complexity of machine learning models while still being able to efficiently predict over a large spatial domain. We find that it is proficient at predicting the SST at specific locations as well as over the greater domain of the Earth’s oceans.
Valerio Lucarini, Larissa Serdukova, and Georgios Margazoglou
Nonlin. Processes Geophys., 29, 183–205, https://doi.org/10.5194/npg-29-183-2022, https://doi.org/10.5194/npg-29-183-2022, 2022
Short summary
Short summary
In most of the investigations on metastable systems, the stochastic forcing is modulated by Gaussian noise. Lévy noise laws, which describe jump processes, have recently received a lot of attention, but much less is known. We study stochastic versions of the Ghil–Sellers energy balance model, and we highlight the fundamental difference between how transitions are performed between the competing warm and snowball states, depending on whether Gaussian or Lévy noise acts as forcing.
Raphael Kriegmair, Yvonne Ruckstuhl, Stephan Rasp, and George Craig
Nonlin. Processes Geophys., 29, 171–181, https://doi.org/10.5194/npg-29-171-2022, https://doi.org/10.5194/npg-29-171-2022, 2022
Short summary
Short summary
Our regional numerical weather prediction models run at kilometer-scale resolutions. Processes that occur at smaller scales not yet resolved contribute significantly to the atmospheric flow. We use a neural network (NN) to represent the unresolved part of physical process such as cumulus clouds. We test this approach on a simplified, yet representative, 1D model and find that the NN corrections vastly improve the model forecast up to a couple of days.
Robert Polzin, Annette Müller, Henning Rust, Peter Névir, and Péter Koltai
Nonlin. Processes Geophys., 29, 37–52, https://doi.org/10.5194/npg-29-37-2022, https://doi.org/10.5194/npg-29-37-2022, 2022
Short summary
Short summary
In this study, a recent algorithmic framework called Direct Bayesian Model Reduction (DBMR) is applied which provides a scalable probability-preserving identification of reduced models directly from data. The stochastic method is tested in a meteorological application towards a model reduction to latent states of smaller scale convective activity conditioned on large-scale atmospheric flow.
Justin Schulte, Frederick Policelli, and Benjamin Zaitchik
Nonlin. Processes Geophys., 29, 1–15, https://doi.org/10.5194/npg-29-1-2022, https://doi.org/10.5194/npg-29-1-2022, 2022
Short summary
Short summary
The skewness of a time series is commonly used to quantify the extent to which positive (negative) deviations from the mean are larger than negative (positive) ones. However, in some cases, traditional skewness may not provide reliable information about time series skewness, motivating the development of a waveform skewness index in this paper. The waveform skewness index is used to show that changes in the relationship strength between climate time series could arise from changes in skewness.
Bo Christiansen
Nonlin. Processes Geophys., 28, 409–422, https://doi.org/10.5194/npg-28-409-2021, https://doi.org/10.5194/npg-28-409-2021, 2021
Short summary
Short summary
In geophysics we often need to analyse large samples of high-dimensional fields. Fortunately but counterintuitively, such high dimensionality can be a blessing, and we demonstrate how this allows simple analytical results to be derived. These results include estimates of correlations between sample members and how the sample mean depends on the sample size. We show that the properties of high dimensionality with success can be applied to climate fields, such as those from ensemble modelling.
Achim Wirth and Bertrand Chapron
Nonlin. Processes Geophys., 28, 371–378, https://doi.org/10.5194/npg-28-371-2021, https://doi.org/10.5194/npg-28-371-2021, 2021
Short summary
Short summary
In non-equilibrium statistical mechanics, which describes forced-dissipative systems such as air–sea interaction, there is no universal probability density function (pdf). Some such systems have recently been demonstrated to exhibit a symmetry called a fluctuation theorem (FT), which strongly constrains the shape of the pdf. Using satellite data, the mechanical power input to the ocean by air–sea interaction following or not a FT is questioned. A FT is found to apply over specific ocean regions.
Camille Besombes, Olivier Pannekoucke, Corentin Lapeyre, Benjamin Sanderson, and Olivier Thual
Nonlin. Processes Geophys., 28, 347–370, https://doi.org/10.5194/npg-28-347-2021, https://doi.org/10.5194/npg-28-347-2021, 2021
Short summary
Short summary
This paper investigates the potential of a type of deep generative neural network to produce realistic weather situations when trained from the climate of a general circulation model. The generator represents the climate in a compact latent space. It is able to reproduce many aspects of the targeted multivariate distribution. Some properties of our method open new perspectives such as the exploration of the extremes close to a given state or how to connect two realistic weather states.
Gerd Schädler and Marcus Breil
Nonlin. Processes Geophys., 28, 231–245, https://doi.org/10.5194/npg-28-231-2021, https://doi.org/10.5194/npg-28-231-2021, 2021
Short summary
Short summary
We used regional climate networks (RCNs) to identify past heatwaves and droughts in Germany. RCNs provide information for whole areas and can provide many details of extreme events. The RCNs were constructed on the grid of the E-OBS data set. Time series correlation was used to construct the networks. Network metrics were compared to standard extreme indices and differed considerably between normal and extreme years. The results show that RCNs can identify severe and moderate extremes.
Abhirup Banerjee, Bedartha Goswami, Yoshito Hirata, Deniz Eroglu, Bruno Merz, Jürgen Kurths, and Norbert Marwan
Nonlin. Processes Geophys., 28, 213–229, https://doi.org/10.5194/npg-28-213-2021, https://doi.org/10.5194/npg-28-213-2021, 2021
Jonathan M. Lilly and Paula Pérez-Brunius
Nonlin. Processes Geophys., 28, 181–212, https://doi.org/10.5194/npg-28-181-2021, https://doi.org/10.5194/npg-28-181-2021, 2021
Short summary
Short summary
Long-lived eddies are an important part of the ocean circulation. Here a dataset for studying eddies in the Gulf of Mexico is created through the analysis of trajectories of drifting instruments. The method involves the identification of quasi-periodic signals, characteristic of particles trapped in eddies, from the displacement records, followed by the creation of a measure of statistical significance. It is expected that this dataset will be of use to other authors studying this region.
Pascal Wang, Daniele Castellana, and Henk A. Dijkstra
Nonlin. Processes Geophys., 28, 135–151, https://doi.org/10.5194/npg-28-135-2021, https://doi.org/10.5194/npg-28-135-2021, 2021
Short summary
Short summary
This paper proposes two improvements to the use of Trajectory-Adaptive Multilevel Sampling, a rare-event algorithm which computes noise-induced transition probabilities. The first improvement uses locally linearised dynamics in order to reduce the arbitrariness associated with defining what constitutes a transition. The second improvement uses empirical transition paths accumulated at high noise in order to formulate the score function which determines the performance of the algorithm.
Cristian Lussana, Thomas N. Nipen, Ivar A. Seierstad, and Christoffer A. Elo
Nonlin. Processes Geophys., 28, 61–91, https://doi.org/10.5194/npg-28-61-2021, https://doi.org/10.5194/npg-28-61-2021, 2021
Short summary
Short summary
An unprecedented amount of rainfall data is available nowadays, such as ensemble model output, weather radar estimates, and in situ observations from networks of both traditional and opportunistic sensors. Nevertheless, the exact amount of precipitation, to some extent, eludes our knowledge. The objective of our study is precipitation reconstruction through the combination of numerical model outputs with observations from multiple data sources.
Dylan Harries and Terence J. O'Kane
Nonlin. Processes Geophys., 27, 453–471, https://doi.org/10.5194/npg-27-453-2020, https://doi.org/10.5194/npg-27-453-2020, 2020
Short summary
Short summary
Different dimension reduction methods may produce profoundly different low-dimensional representations of multiscale systems. We perform a set of case studies to investigate these differences. When a clear scale separation is present, similar bases are obtained using all methods, but when this is not the case some methods may produce representations that are poorly suited for describing features of interest, highlighting the importance of a careful choice of method when designing analyses.
Josh Jacobson, William Kleiber, Michael Scheuerer, and Joseph Bellier
Nonlin. Processes Geophys., 27, 411–427, https://doi.org/10.5194/npg-27-411-2020, https://doi.org/10.5194/npg-27-411-2020, 2020
Short summary
Short summary
Most verification metrics for ensemble forecasts assess the representation of uncertainty at a particular location and time. We study a new diagnostic tool based on fractions of threshold exceedance (FTE) which evaluates an additional important attribute: the ability of ensemble forecast fields to reproduce the spatial structure of observed fields. The utility of this diagnostic tool is demonstrated through simulations and an application to ensemble precipitation forecasts.
Sebastian Lerch, Sándor Baran, Annette Möller, Jürgen Groß, Roman Schefzik, Stephan Hemri, and Maximiliane Graeter
Nonlin. Processes Geophys., 27, 349–371, https://doi.org/10.5194/npg-27-349-2020, https://doi.org/10.5194/npg-27-349-2020, 2020
Short summary
Short summary
Accurate models of spatial, temporal, and inter-variable dependencies are of crucial importance for many practical applications. We review and compare several methods for multivariate ensemble post-processing, where such dependencies are imposed via copula functions. Our investigations utilize simulation studies that mimic challenges occurring in practical applications and allow ready interpretation of the effects of different misspecifications of the numerical weather prediction ensemble.
Jaqueline Lekscha and Reik V. Donner
Nonlin. Processes Geophys., 27, 261–275, https://doi.org/10.5194/npg-27-261-2020, https://doi.org/10.5194/npg-27-261-2020, 2020
Julian Steinheuer and Petra Friederichs
Nonlin. Processes Geophys., 27, 239–252, https://doi.org/10.5194/npg-27-239-2020, https://doi.org/10.5194/npg-27-239-2020, 2020
Short summary
Short summary
Many applications require wind gust estimates at very different atmospheric altitudes, such as in the wind energy sector. However, numerical weather prediction models usually only derive estimates for gusts at 10 m above the land surface. We present a statistical model that gives the hourly peak wind speed. The model is trained based on a weather reanalysis and observations from the Hamburg Weather Mast. Reliable predictions are derived at up to 250 m, even at unobserved intermediate levels.
Moritz N. Lang, Sebastian Lerch, Georg J. Mayr, Thorsten Simon, Reto Stauffer, and Achim Zeileis
Nonlin. Processes Geophys., 27, 23–34, https://doi.org/10.5194/npg-27-23-2020, https://doi.org/10.5194/npg-27-23-2020, 2020
Short summary
Short summary
Statistical post-processing aims to increase the predictive skill of probabilistic ensemble weather forecasts by learning the statistical relation between historical pairs of observations and ensemble forecasts within a given training data set. This study compares four different training schemes and shows that including multiple years of data in the training set typically yields a more stable post-processing while it loses the ability to quickly adjust to temporal changes in the underlying data.
Achim Wirth
Nonlin. Processes Geophys., 26, 457–477, https://doi.org/10.5194/npg-26-457-2019, https://doi.org/10.5194/npg-26-457-2019, 2019
Short summary
Short summary
The conspicuous feature of the atmosphere–ocean system is the large difference in the masses of the two media. In this respect there is a strong analogy to Brownian motion, with light and fast molecules colliding with heavy and slow Brownian particles. I apply the tools of non-equilibrium statistical mechanics for studying Brownian motion to air–sea interaction.
Carsten Abraham, Amber M. Holdsworth, and Adam H. Monahan
Nonlin. Processes Geophys., 26, 401–427, https://doi.org/10.5194/npg-26-401-2019, https://doi.org/10.5194/npg-26-401-2019, 2019
Short summary
Short summary
Atmospheric stably stratified boundary layers display transitions between regimes of sustained and intermittent turbulence. These transitions are not well represented in numerical weather prediction and climate models. A prototype explicitly stochastic turbulence parameterization simulating regime dynamics is presented and tested in an idealized model. Results demonstrate that the approach can improve the regime representation in models.
Jari-Pekka Nousu, Matthieu Lafaysse, Matthieu Vernay, Joseph Bellier, Guillaume Evin, and Bruno Joly
Nonlin. Processes Geophys., 26, 339–357, https://doi.org/10.5194/npg-26-339-2019, https://doi.org/10.5194/npg-26-339-2019, 2019
Short summary
Short summary
Forecasting the height of new snow is crucial for avalanche hazard, road viability, ski resorts and tourism. The numerical models suffer from systematic and significant errors which are misleading for the final users. Here, we applied for the first time a state-of-the-art statistical method to correct ensemble numerical forecasts of the height of new snow from their statistical link with measurements in French Alps and Pyrenees. Thus the realism of automatic forecasts can be quickly improved.
Jürgen Kurths, Ankit Agarwal, Roopam Shukla, Norbert Marwan, Maheswaran Rathinasamy, Levke Caesar, Raghavan Krishnan, and Bruno Merz
Nonlin. Processes Geophys., 26, 251–266, https://doi.org/10.5194/npg-26-251-2019, https://doi.org/10.5194/npg-26-251-2019, 2019
Short summary
Short summary
We examined the spatial diversity of Indian rainfall teleconnection at different timescales, first by identifying homogeneous communities and later by computing non-linear linkages between the identified communities (spatial regions) and dominant climatic patterns, represented by climatic indices such as El Nino–Southern Oscillation, Indian Ocean Dipole, North Atlantic Oscillation, Pacific Decadal Oscillation and Atlantic Multi-Decadal Oscillation.
Justin A. Schulte
Nonlin. Processes Geophys., 26, 91–108, https://doi.org/10.5194/npg-26-91-2019, https://doi.org/10.5194/npg-26-91-2019, 2019
Short summary
Short summary
Statistical hypothesis tests in wavelet analysis are used to asses the likelihood that time series features are noise. The choice of test will determine which features emerge as a signal. Tests based on area do poorly at distinguishing abrupt fluctuations from periodic behavior, unlike tests based on arclength that do better. The application of the tests suggests that there are features in Indian rainfall time series that emerge from background noise.
Jonathan Demaeyer and Stéphane Vannitsem
Nonlin. Processes Geophys., 25, 605–631, https://doi.org/10.5194/npg-25-605-2018, https://doi.org/10.5194/npg-25-605-2018, 2018
Short summary
Short summary
We investigate the modeling of the effects of the unresolved scales on the large scales of the coupled ocean–atmosphere model MAOOAM. Two different physically based stochastic methods are considered and compared, in various configurations of the model. Both methods show remarkable performances and are able to model fundamental changes in the model dynamics. Ways to improve the parameterizations' implementation are also proposed.
Adam H. Monahan
Nonlin. Processes Geophys., 25, 335–353, https://doi.org/10.5194/npg-25-335-2018, https://doi.org/10.5194/npg-25-335-2018, 2018
Short summary
Short summary
Bivariate probability density functions (pdfs) of wind speed characterize the relationship between speeds at two different locations or times. This study develops such pdfs of wind speed from distributions of the components, following a well-established approach for univariate distributions. The ability of these models to characterize example observed datasets is assessed. The mathematical complexity of these models suggests further extensions of this line of reasoning may not be practical.
Berenice Rojo-Garibaldi, David Alberto Salas-de-León, María Adela Monreal-Gómez, Norma Leticia Sánchez-Santillán, and David Salas-Monreal
Nonlin. Processes Geophys., 25, 291–300, https://doi.org/10.5194/npg-25-291-2018, https://doi.org/10.5194/npg-25-291-2018, 2018
Short summary
Short summary
Hurricanes are complex systems that carry large amounts of energy. Its impact produces, most of the time, natural disasters involving the loss of human lives and of materials and infrastructure that is accounted for in billions of US dollars. Not everything is negative as hurricanes are the main source of rainwater for the regions where they develop. In this study we make a nonlinear analysis of the time series obtained from 1749 to 2012 of the hurricane occurrence in the Gulf of Mexico.
Guillaume Lenoir and Michel Crucifix
Nonlin. Processes Geophys., 25, 145–173, https://doi.org/10.5194/npg-25-145-2018, https://doi.org/10.5194/npg-25-145-2018, 2018
Short summary
Short summary
We develop a general framework for the frequency analysis of irregularly sampled time series. We also design a test of significance against a general background noise which encompasses the Gaussian white or red noise. Our results generalize and unify methods developed in the fields of geosciences, engineering, astronomy and astrophysics. All the analysis tools presented in this paper are available to the reader in the Python package WAVEPAL.
Guillaume Lenoir and Michel Crucifix
Nonlin. Processes Geophys., 25, 175–200, https://doi.org/10.5194/npg-25-175-2018, https://doi.org/10.5194/npg-25-175-2018, 2018
Short summary
Short summary
There is so far no general framework for handling the continuous wavelet transform when the time sampling is irregular. Here we provide such a framework with the Morlet wavelet, based on the results of part I of this study. We also design a test of significance against a general background noise which encompasses the Gaussian white or red noise. All the analysis tools presented in this article are available to the reader in the Python package WAVEPAL.
Valerie N. Livina, Albert Brouwer, Peter Harris, Lian Wang, Kostas Sotirakopoulos, and Stephen Robinson
Nonlin. Processes Geophys., 25, 89–97, https://doi.org/10.5194/npg-25-89-2018, https://doi.org/10.5194/npg-25-89-2018, 2018
Short summary
Short summary
We have applied tipping point analysis to a large record of ocean acoustic data to identify the main components of the acoustic dynamical system: long-term and seasonal trends, system states and fluctuations. We reconstructed a one-dimensional stochastic model equation to approximate the acoustic dynamical system. We have found a signature of El Niño events in the deep ocean acoustic data near the southwest Australian coast, which proves the investigative power of the tipping point methodology.
Marc Bengulescu, Philippe Blanc, and Lucien Wald
Nonlin. Processes Geophys., 25, 19–37, https://doi.org/10.5194/npg-25-19-2018, https://doi.org/10.5194/npg-25-19-2018, 2018
Short summary
Short summary
We employ the Hilbert–Huang transform to study the temporal variability in time series of daily means of the surface solar irradiance (SSI) at different locations around the world. The data have a significant spectral peak corresponding to the yearly variability cycle and feature quasi-stochastic high-frequency "weather noise", irrespective of the geographical location or of the local climate. Our findings can improve models for estimating SSI from satellite images or forecasts of the SSI.
Manfred Mudelsee and Miguel A. Bermejo
Nonlin. Processes Geophys., 24, 737–744, https://doi.org/10.5194/npg-24-737-2017, https://doi.org/10.5194/npg-24-737-2017, 2017
Short summary
Short summary
Risk analysis of extremes has high socioeconomic relevance. Of crucial interest is the tail probability, P, of the distribution of a variable, which is the chance of observing a value equal to or greater than a certain threshold value, x. Many variables in geophysical systems (e.g. climate) show heavy tail behaviour, where P may be rather large. In particular, P decreases with x as a power law that is described by a parameter, α. We present an improved method to estimate α on data.
Kathrin Padberg-Gehle and Christiane Schneide
Nonlin. Processes Geophys., 24, 661–671, https://doi.org/10.5194/npg-24-661-2017, https://doi.org/10.5194/npg-24-661-2017, 2017
Short summary
Short summary
Transport and mixing processes in fluid flows are crucially influenced by coherent structures, such as eddies, gyres, or jets in geophysical flows. We propose a very simple and computationally efficient approach for analyzing coherent behavior in fluid flows. The central object is a flow network constructed directly from particle trajectories. The network's local and spectral properties are shown to give a very good indication of coherent as well as mixing regions in the underlying flow.
Ankit Agarwal, Norbert Marwan, Maheswaran Rathinasamy, Bruno Merz, and Jürgen Kurths
Nonlin. Processes Geophys., 24, 599–611, https://doi.org/10.5194/npg-24-599-2017, https://doi.org/10.5194/npg-24-599-2017, 2017
Short summary
Short summary
Extreme events such as floods and droughts result from synchronization of different natural processes working at multiple timescales. Investigation on an observation timescale will not reveal the inherent underlying dynamics triggering these events. This paper develops a new method based on wavelets and event synchronization to unravel the hidden dynamics responsible for such sudden events. This method is tested with synthetic and real-world cases and the results are promising.
Jonathan M. Lilly, Adam M. Sykulski, Jeffrey J. Early, and Sofia C. Olhede
Nonlin. Processes Geophys., 24, 481–514, https://doi.org/10.5194/npg-24-481-2017, https://doi.org/10.5194/npg-24-481-2017, 2017
Short summary
Short summary
This work arose from a desire to understand the nature of particle motions in turbulence. We sought a simple conceptual model that could describe such motions, then realized that this model could be applicable to an array of other problems. The basic idea is to create a string of random numbers, called a stochastic process, that mimics the properties of particle trajectories. This model could be useful in making best use of data from freely drifting instruments tracking the ocean currents.
Finn Müller-Hansen, Manoel F. Cardoso, Eloi L. Dalla-Nora, Jonathan F. Donges, Jobst Heitzig, Jürgen Kurths, and Kirsten Thonicke
Nonlin. Processes Geophys., 24, 113–123, https://doi.org/10.5194/npg-24-113-2017, https://doi.org/10.5194/npg-24-113-2017, 2017
Short summary
Short summary
Deforestation and subsequent land uses in the Brazilian Amazon have huge impacts on greenhouse gas emissions, local climate and biodiversity. To better understand these land-cover changes, we apply complex systems methods uncovering spatial patterns in regional transition probabilities between land-cover types, which we estimate using maps derived from satellite imagery. The results show clusters of similar land-cover dynamics and thus complement studies at the local scale.
Cited articles
Abarbanel, H. D. I., Brown, R., Sidorowich, J. J., and Tsimring, L. S.: The analysis of observed chaotic data in physical systems, Rev. Mod. Phys., 65, 1331–1392, 1993.
Chen, J. and Sharma, A. S.: Modeling and prediction of the magnetospheric dynamics during intense geospace storms, J. Geophys. Res., 111, A04209, https://doi.org/10.1029/2005JA011359, 2006.
Evans, E., Bhatti, N., Kinney, J., Pann, L., Pena, M., Yang, S. C., Kalnay, E., and Hansen, J.: RISE undergraduates find that regime changes in Lorenz's Model are predictable, B. Am. Meteorol. Soc., 85, 521–524, 2004.
Hoffman, M. J., Kalnay, E., Carton, J. A., and Yang, S.-C.: Use of breeding to detect and explain instabilities in the global ocean, Geophys. Res. Lett., 36, L12608, https://doi.org/10.1029/2009GL037729, 2009.
Kalnay, E.: Atmospheric Modeling, Data Assimilation and Predictability, Cambridge University Press, Cambridge, UK, 2003.
Kantz, H. and Schreiber, T.: Nonlinear Time Series Analysis, Cambridge University Press, Cambridge, UK, 1997.
Lorenz, E. N.: Deterministic Nonperiodic Flow, J. Atmos. Sci., 20, 130–141, 1963.
Norwood, A., Kalnay, E., Ide, K., Yang, S.-C., and Wolfe, C.: Lyapunov, singular and bred vectors in a multi-scale system: an empirical exploration of vectors related to instabilities, J. Phys. A-Math. Theor., 46, 254021, https://doi.org/10.1088/1751-8113/46/25/254021, 2013.
Packard, N., Crutchfield, J., Farmer, D., and Shaw, R.: Geometry from Time Series, Phys. Rev. Lett, 45, 712–716, 1980.
Patil, D. J., Hunt, B., Kalnay, E., Yorke, J. A., and Ott, E.: Using bred vectors to establish local low dimensionality of atmospheric dynamics, Phys. Rev. Lett., 86, 5878–5881, 2001.
Sauer, T., Yorke, J. A., and Casdagli, M.: Embedology, J. Stat. Phys., 65, 579–616, 1991.
Sharma, A. S.: Assessing the magnetosphere's nonlinear behavior: Its dimension is low, its predictability, high, Rev. Geophys., 33(S1), 645–650, https://doi.org/10.1029/95RG00495, 1995.
Sharma, A. S., Vassiliadis, D., and Papadopoulos, K.: Reconstruction of low dimensional magnetospheric dynamics by singular spectrum analysis, Geophys. Res. Lett., 20, 335–338, 1993.
Takens, F.: Detecting strange attractors in turbulence, in: Dynamical Systems and Turbulence, Warwick 1980, Lecture Notes in Mathematics 898, Springer, Berlin, 1981.
Toth, Z. and Kalnay, E.: Ensemble forcasting at NMC: the generation of perturbations, B. Am. Meteorol. Soc., 74, 2317–2330, 1993.
Toth, Z. and Kalnay, E.: Ensemble forecasting at NCEP and the breeding method, Mon. Weather Rev., 125, 3297–3318, 1997.
Ukhorskiy, A. Y., Sitnov, M. I., Sharma, A. S., and Papadopoulos, K.: Global and multi-scale aspects of magnetopheric dynamics in local-linear filter, J. Geophys. Res., 107, 1369, https://doi.org/10.1029/2001JA009160, 2002.
Valdivia, J. A., Sharma, A. S., and Papadopoulos, K.: Prediction of magnetic storms by nonlinear models, Geophys. Res. Lett., 23, 2899–2902, 1996.
Vassiliadis, D., Sharma, A. S., and Papadopoulos, K.: Lyapunov exponent of magnetospheric activity from AL time series, Geophys. Res. Lett., 18, 1643–1646, 1991.
Vassiliadis, D., Klimas, A. J., Baker, D. N., and Roberts, D. A.: A description of the solar wind-magnetosphere coupling based on nonlinear filters, J. Geophys. Res., 100, 3495–3512, https://doi.org/10.1029/94JA02725, 1995.
Wilks, D.: Statistical Methods in the Atmospheric Sciences: An Introduction, International Geophysical Series, vol. 59, Academic Press, Oxford, UK, 1995.
Yadav, R. S., Dwivedi, S., and Mittal, A. K.: Prediction rules for regime changes and length in a new regime for the Lorenz model, J. Atmos. Sci., 62, 2316–2321, 2005.
Short summary
In this article, bred vectors are computed from a single time series data using time-delay embedding, with a new technique, nearest-neighbor breeding. Since the dynamical properties of the nearest-neighbor bred vectors are shown to be similar to bred vectors computed using evolution equations, this provides a new and novel way to model and predict sudden transitions in systems represented by time series data alone.
In this article, bred vectors are computed from a single time series data using time-delay...