Articles | Volume 30, issue 2
https://doi.org/10.5194/npg-30-183-2023
© Author(s) 2023. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/npg-30-183-2023
© Author(s) 2023. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Reducing manipulations in a control simulation experiment based on instability vectors with the Lorenz-63 model
Mao Ouyang
CORRESPONDING AUTHOR
Center for Environmental Remote Sensing (CEReS), Chiba University, 1–33 Yayoi, Inage, Chiba 263–8522, Japan
Keita Tokuda
The Faculty of Health Data Science, Juntendo University, 6–8–1 Hinode, Urayasu, Chiba, 279–0013, Japan
Graduate School of Medicine, Juntendo University, 2–1–1 Hongo, Bunkyo, Tokyo, 113–8421, Japan
Shunji Kotsuki
CORRESPONDING AUTHOR
Center for Environmental Remote Sensing (CEReS), Chiba University, 1–33 Yayoi, Inage, Chiba 263–8522, Japan
Institute for Advanced Academic Research (IAAR), Chiba University, 1–33 Yayoi, Inage, Chiba 263–8522, Japan
PRESTO, Japan Science and Technology Agency, 4–1–8 Honcho, Kawaguchi, Saitama 332–0012, Japan
Related authors
No articles found.
Shunji Kotsuki, Kenta Shiraishi, and Atsushi Okazaki
EGUsphere, https://doi.org/10.48550/arXiv.2407.17781, https://doi.org/10.48550/arXiv.2407.17781, 2024
Short summary
Short summary
Artificial intelligence (AI) is playing a bigger role in weather forecasting, often competing with physical models. However, combining AI models with data assimilation, a process that improves weather forecasts by incorporating observation data, is still relatively unexplored. This study explored coupling ensemble data assimilation with an AI weather prediction model ClimaX, succeeded in employing weather forecasts stably by applying techniques conventionally used for physical models.
Fumitoshi Kawasaki and Shunji Kotsuki
Nonlin. Processes Geophys., 31, 319–333, https://doi.org/10.5194/npg-31-319-2024, https://doi.org/10.5194/npg-31-319-2024, 2024
Short summary
Short summary
Recently, scientists have been looking into ways to control the weather to lead to a desirable direction for mitigating weather-induced disasters caused by torrential rainfall and typhoons. This study proposes using the model predictive control (MPC), an advanced control method, to control a chaotic system. Through numerical experiments using a low-dimensional chaotic system, we demonstrate that the system can be successfully controlled with shorter forecasts compared to previous studies.
Toshiyuki Ohtsuka, Atsushi Okazaki, Masaki Ogura, and Shunji Kotsuki
EGUsphere, https://doi.org/10.48550/arXiv.2405.19546, https://doi.org/10.48550/arXiv.2405.19546, 2024
Preprint withdrawn
Short summary
Short summary
We utilize weather forecasts in the reverse direction and determine how much we should change the temperature or humidity of the atmosphere at a certain time to change the future rainfall as desired. Even though a weather phenomenon is complicated, we can superimpose the effects of small changes in the atmosphere and find suitable small changes to realize desirable rainfall by solving an optimization problem. We examine this idea on a realistic weather simulator and show it is promising.
Shunji Kotsuki, Fumitoshi Kawasaki, and Masanao Ohashi
Nonlin. Processes Geophys., 31, 237–245, https://doi.org/10.5194/npg-31-237-2024, https://doi.org/10.5194/npg-31-237-2024, 2024
Short summary
Short summary
In Earth science, data assimilation plays an important role in integrating real-world observations with numerical simulations for improving subsequent predictions. To overcome the time-consuming computations of conventional data assimilation methods, this paper proposes using quantum annealing machines. Using the D-Wave quantum annealer, the proposed method found solutions with comparable accuracy to conventional approaches and significantly reduced computational time.
Yuka Muto and Shunji Kotsuki
EGUsphere, https://doi.org/10.5194/egusphere-2024-960, https://doi.org/10.5194/egusphere-2024-960, 2024
Short summary
Short summary
It is crucial to improve global precipitation estimates for understanding water-related disasters and water resources. This study proposes a new methodology to interpolate global precipitation fields from ground rain gauge observations using ensemble data assimilation and the precipitation of a numerical weather prediction model. Our estimates agree with independent rain gauge observations better than the existing precipitation estimates, especially in mountainous or rain-gauge-sparse regions.
Kenta Kurosawa, Shunji Kotsuki, and Takemasa Miyoshi
Nonlin. Processes Geophys., 30, 457–479, https://doi.org/10.5194/npg-30-457-2023, https://doi.org/10.5194/npg-30-457-2023, 2023
Short summary
Short summary
This study aimed to enhance weather and hydrological forecasts by integrating soil moisture data into a global weather model. By assimilating atmospheric observations and soil moisture data, the accuracy of forecasts was improved, and certain biases were reduced. The method was found to be particularly beneficial in areas like the Sahel and equatorial Africa, where precipitation patterns vary seasonally. This new approach has the potential to improve the precision of weather predictions.
Shunji Kotsuki, Takemasa Miyoshi, Keiichi Kondo, and Roland Potthast
Geosci. Model Dev., 15, 8325–8348, https://doi.org/10.5194/gmd-15-8325-2022, https://doi.org/10.5194/gmd-15-8325-2022, 2022
Short summary
Short summary
Data assimilation plays an important part in numerical weather prediction (NWP) in terms of combining forecasted states and observations. While data assimilation methods in NWP usually assume the Gaussian error distribution, some variables in the atmosphere, such as precipitation, are known to have non-Gaussian error statistics. This study extended a widely used ensemble data assimilation algorithm to enable the assimilation of more non-Gaussian observations.
Related subject area
Subject: Predictability, probabilistic forecasts, data assimilation, inverse problems | Topic: Climate, atmosphere, ocean, hydrology, cryosphere, biosphere | Techniques: Simulation
A comparison of two nonlinear data assimilation methods
Leading the Lorenz 63 system toward the prescribed regime by model predictive control coupled with data assimilation
Quantum data assimilation: a new approach to solving data assimilation on quantum annealers
Comparative study of strongly and weakly coupled data assimilation with a global land–atmosphere coupled model
Control simulation experiments of extreme events with the Lorenz-96 model
A range of outcomes: the combined effects of internal variability and anthropogenic forcing on regional climate trends over Europe
Using a hybrid optimal interpolation–ensemble Kalman filter for the Canadian Precipitation Analysis
Control simulation experiment with Lorenz's butterfly attractor
Reduced non-Gaussianity by 30 s rapid update in convective-scale numerical weather prediction
A study of capturing Atlantic meridional overturning circulation (AMOC) regime transition through observation-constrained model parameters
Fast hybrid tempered ensemble transform filter formulation for Bayesian elliptical problems via Sinkhorn approximation
Simulating model uncertainty of subgrid-scale processes by sampling model errors at convective scales
Data-driven versus self-similar parameterizations for stochastic advection by Lie transport and location uncertainty
Generalization properties of feed-forward neural networks trained on Lorenz systems
Vivian A. Montiforte, Hans E. Ngodock, and Innocent Souopgui
Nonlin. Processes Geophys., 31, 463–476, https://doi.org/10.5194/npg-31-463-2024, https://doi.org/10.5194/npg-31-463-2024, 2024
Short summary
Short summary
Advanced data assimilation methods are complex and computationally expensive. We compare two simpler methods, diffusive back-and-forth nudging and concave–convex nonlinearity, which account for change over time with the potential of providing accurate results with a reduced computational cost. We evaluate the accuracy of the two methods by implementing them within simple chaotic models. We conclude that the length and frequency of observations impact which method is better suited for a problem.
Fumitoshi Kawasaki and Shunji Kotsuki
Nonlin. Processes Geophys., 31, 319–333, https://doi.org/10.5194/npg-31-319-2024, https://doi.org/10.5194/npg-31-319-2024, 2024
Short summary
Short summary
Recently, scientists have been looking into ways to control the weather to lead to a desirable direction for mitigating weather-induced disasters caused by torrential rainfall and typhoons. This study proposes using the model predictive control (MPC), an advanced control method, to control a chaotic system. Through numerical experiments using a low-dimensional chaotic system, we demonstrate that the system can be successfully controlled with shorter forecasts compared to previous studies.
Shunji Kotsuki, Fumitoshi Kawasaki, and Masanao Ohashi
Nonlin. Processes Geophys., 31, 237–245, https://doi.org/10.5194/npg-31-237-2024, https://doi.org/10.5194/npg-31-237-2024, 2024
Short summary
Short summary
In Earth science, data assimilation plays an important role in integrating real-world observations with numerical simulations for improving subsequent predictions. To overcome the time-consuming computations of conventional data assimilation methods, this paper proposes using quantum annealing machines. Using the D-Wave quantum annealer, the proposed method found solutions with comparable accuracy to conventional approaches and significantly reduced computational time.
Kenta Kurosawa, Shunji Kotsuki, and Takemasa Miyoshi
Nonlin. Processes Geophys., 30, 457–479, https://doi.org/10.5194/npg-30-457-2023, https://doi.org/10.5194/npg-30-457-2023, 2023
Short summary
Short summary
This study aimed to enhance weather and hydrological forecasts by integrating soil moisture data into a global weather model. By assimilating atmospheric observations and soil moisture data, the accuracy of forecasts was improved, and certain biases were reduced. The method was found to be particularly beneficial in areas like the Sahel and equatorial Africa, where precipitation patterns vary seasonally. This new approach has the potential to improve the precision of weather predictions.
Qiwen Sun, Takemasa Miyoshi, and Serge Richard
Nonlin. Processes Geophys., 30, 117–128, https://doi.org/10.5194/npg-30-117-2023, https://doi.org/10.5194/npg-30-117-2023, 2023
Short summary
Short summary
This paper is a follow-up of a work by Miyoshi and Sun which was published in NPG Letters in 2022. The control simulation experiment is applied to the Lorenz-96 model for avoiding extreme events. The results show that extreme events of this partially and imperfectly observed chaotic system can be avoided by applying pre-designed small perturbations. These investigations may be extended to more realistic numerical weather prediction models.
Clara Deser and Adam S. Phillips
Nonlin. Processes Geophys., 30, 63–84, https://doi.org/10.5194/npg-30-63-2023, https://doi.org/10.5194/npg-30-63-2023, 2023
Short summary
Short summary
Past and future climate change at regional scales is a result of both human influences and natural (internal) variability. Here, we provide an overview of recent advances in climate modeling and physical understanding that has led to new insights into their respective roles, illustrated with original results for the European climate. Our findings highlight the confounding role of internal variability in attribution, climate model evaluation, and accuracy of future projections.
Dikraa Khedhaouiria, Stéphane Bélair, Vincent Fortin, Guy Roy, and Franck Lespinas
Nonlin. Processes Geophys., 29, 329–344, https://doi.org/10.5194/npg-29-329-2022, https://doi.org/10.5194/npg-29-329-2022, 2022
Short summary
Short summary
This study introduces a well-known use of hybrid methods in data assimilation (DA) algorithms that has not yet been explored for precipitation analyses. Our approach combined an ensemble-based DA approach with an existing deterministically based DA. Both DA scheme families have desirable aspects that can be leveraged if combined. The DA hybrid method showed better precipitation analyses in regions with a low rate of assimilated surface observations, which is typically the case in winter.
Takemasa Miyoshi and Qiwen Sun
Nonlin. Processes Geophys., 29, 133–139, https://doi.org/10.5194/npg-29-133-2022, https://doi.org/10.5194/npg-29-133-2022, 2022
Short summary
Short summary
The weather is chaotic and hard to predict, but the chaos implies an effective control where a small control signal grows rapidly to make a big difference. This study proposes a control simulation experiment where we apply a small signal to control
naturein a computational simulation. Idealized experiments with a low-order chaotic system show successful results by small control signals of only 3 % of the observation error. This is the first step toward realistic weather simulations.
Juan Ruiz, Guo-Yuan Lien, Keiichi Kondo, Shigenori Otsuka, and Takemasa Miyoshi
Nonlin. Processes Geophys., 28, 615–626, https://doi.org/10.5194/npg-28-615-2021, https://doi.org/10.5194/npg-28-615-2021, 2021
Short summary
Short summary
Effective use of observations with numerical weather prediction models, also known as data assimilation, is a key part of weather forecasting systems. For precise prediction at the scales of thunderstorms, fast nonlinear processes pose a grand challenge because most data assimilation systems are based on linear processes and normal distribution errors. We investigate how, every 30 s, weather radar observations can help reduce the effect of nonlinear processes and nonnormal distributions.
Zhao Liu, Shaoqing Zhang, Yang Shen, Yuping Guan, and Xiong Deng
Nonlin. Processes Geophys., 28, 481–500, https://doi.org/10.5194/npg-28-481-2021, https://doi.org/10.5194/npg-28-481-2021, 2021
Short summary
Short summary
A general methodology is introduced to capture regime transitions of the Atlantic meridional overturning circulation (AMOC). The assimilation models with different parameters simulate different paths for the AMOC to switch between equilibrium states. Constraining model parameters with observations can significantly mitigate the model deviations, thus capturing AMOC regime transitions. This simple model study serves as a guideline for improving coupled general circulation models.
Sangeetika Ruchi, Svetlana Dubinkina, and Jana de Wiljes
Nonlin. Processes Geophys., 28, 23–41, https://doi.org/10.5194/npg-28-23-2021, https://doi.org/10.5194/npg-28-23-2021, 2021
Short summary
Short summary
To infer information of an unknown quantity that helps to understand an associated system better and to predict future outcomes, observations and a physical model that connects the data points to the unknown parameter are typically used as information sources. Yet this problem is often very challenging due to the fact that the unknown is generally high dimensional, the data are sparse and the model can be non-linear. We propose a novel approach to address these challenges.
Michiel Van Ginderachter, Daan Degrauwe, Stéphane Vannitsem, and Piet Termonia
Nonlin. Processes Geophys., 27, 187–207, https://doi.org/10.5194/npg-27-187-2020, https://doi.org/10.5194/npg-27-187-2020, 2020
Short summary
Short summary
A generic methodology is developed to estimate the model error and simulate the model uncertainty related to a specific physical process. The method estimates the model error by comparing two different representations of the physical process in otherwise identical models. The found model error can then be used to perturb the model and simulate the model uncertainty. When applying this methodology to deep convection an improvement in the probabilistic skill of the ensemble forecast is found.
Valentin Resseguier, Wei Pan, and Baylor Fox-Kemper
Nonlin. Processes Geophys., 27, 209–234, https://doi.org/10.5194/npg-27-209-2020, https://doi.org/10.5194/npg-27-209-2020, 2020
Short summary
Short summary
Geophysical flows span a broader range of temporal and spatial scales than can be resolved numerically. One way to alleviate the ensuing numerical errors is to combine simulations with measurements, taking account of the accuracies of these two sources of information. Here we quantify the distribution of numerical simulation errors without relying on high-resolution numerical simulations. Specifically, small-scale random vortices are added to simulations while conserving energy or circulation.
Sebastian Scher and Gabriele Messori
Nonlin. Processes Geophys., 26, 381–399, https://doi.org/10.5194/npg-26-381-2019, https://doi.org/10.5194/npg-26-381-2019, 2019
Short summary
Short summary
Neural networks are a technique that is widely used to predict the time evolution of physical systems. For this the past evolution of the system is shown to the neural network – it is
trained– and then can be used to predict the evolution in the future. We show some limitations in this approach for certain systems that are important to consider when using neural networks for climate- and weather-related applications.
Cited articles
Bishop, C. H., Etherton, B. J., and Majumdar, S. J.:
Adaptive sampling with the ensemble transform Kalman filter. Part I: Theoretical aspects, Mon. Weather Rev., 129, 420–436, https://doi.org/10.1175/1520-0493(2001)129<0420:ASWTET>2.0.CO;2, 2001. a
Corazza, M., Kalnay, E., Patil, D. J., Yang, S.-C., Morss, R., Cai, M., Szunyogh, I., Hunt, B. R., and Yorke, J. A.:
Use of the breeding technique to estimate the structure of the analysis “errors of the day”, Nonlin. Processes Geophys., 10, 233–243, https://doi.org/10.5194/npg-10-233-2003, 2003. a, b
Diaconescu, E. P. and Laprise, R.:
Singular vectors in atmospheric sciences: A review, Earth-Sci. Rev., 113, 161–175, https://doi.org/10.1016/j.earscirev.2012.05.005, 2012. a, b
Egolf, D. A., Melnikov, I. V., Pesch, W., and Ecke, R. E.:
Mechanisms of extensive spatiotemporal chaos in Rayleigh–Bénard convection, Nature, 404, 733–736, https://doi.org/10.1038/35008013, 2000. a
Ginelli, F., Poggi, P., Turchi, A., Chaté, H., Livi, R., and Politi, A.:
Characterizing dynamics with covariant Lyapunov vectors, Phys. Rev. Lett., 99, 130601, https://doi.org/10.1103/PhysRevLett.99.130601, 2007. a
Houtekamer, P. L. and Zhang, F.:
Review of the ensemble Kalman filter for atmospheric data assimilation, Mon. Weather Rev., 144, 4489–4532, https://doi.org/10.1175/MWR-D-15-0440.1, 2016. a
Jolliffe, I. T. and Stephenson, D. B.:
Forecast verification: A practitioner's guide in atmospheric science, second edition, John Wiley & Sons, Ltd, https://doi.org/10.1002/9781119960003, 2011. a
Kalnay, E., Li, H., Miyoshi, T., Yang, S.-C., and Ballabrera-Poy, J.:
4-D-Var or ensemble Kalman filter?, Tellus A, 59, 758–773, https://doi.org/10.1111/j.1600-0870.2007.00261.x, 2007. a, b
Kim, H. M. and Jung, B.-J.:
Singular vector structure and evolution of a recurving tropical cyclone, Mon. Weather Rev., 137, 505–524, https://doi.org/10.1175/2008MWR2643.1, 2009. a
Kotsuki, S., Terasaki, K., Kanemaru, K., Satoh, M., Kubota, T., and Miyoshi, T.:
Predictability of record-breaking rainfall in Japan in July 2018: snsemble forecast experiments with the near-real-time global atmospheric data assimilation system NEXRA, SOLA, 15A, 1–7, https://doi.org/10.2151/sola.15A-001, 2019. a
Lorenz, E. N.:
Deterministic nonperiodic flow, J. Atmos. Sci., 20, 130–141, https://doi.org/10.1175/1520-0469(1963)020<0130:DNF>2.0.CO;2, 1963. a, b, c
Lucarini, V., Faranda, D., de Freitas, A., de Freitas, J., Holland, M., Kuna, T., Nicol, M., Todd, M., and Vaienti, S.:
Extremes and recurrence in dynamical systems, Pure and Applied Mathematics: A Wiley Series of Texts, Monographs and Tracts, Wiley, ISBN 978-1-118-63219-2, 2016. a
Norwood, A., Kalnay, E., Ide, K., Yang, S.-C., and Wolfe, C.:
Lyapunov, singular and bred vectors in a multi-scale system: an empirical exploration of vectors related to instabilities, J. Phys. A, 46, 254021, https://doi.org/10.1088/1751-8113/46/25/254021, 2013.
a, b, c
Ouyang, M., Ito, Y., and Tokunaga, T.:
Quantifying the inundation impacts of earthquake-induced surface elevation change by hydrological and hydraulic modeling, Sci. Rep.-UK, 11, 4269, https://doi.org/10.1038/s41598-021-83309-7, 2021. a
Ouyang, M., Kotsuki, S., Ito, Y., and Tokunaga, T.:
Employment of hydraulic model and social media data for flood hazard assessment in an urban city, Journal of Hydrology: Regional Studies, 44, 101261, https://doi.org/10.1016/j.ejrh.2022.101261, 2022. a
Palmer, T.:
The ECMWF ensemble prediction system: Looking back (more than) 25 years and projecting forward 25 years, Q. J. Roy. Meteor. Soc., 145, 12–24, https://doi.org/10.1002/qj.3383, 2019. a
Press, W. H., Teukolsky, S. A., Vetterling, W. T., and Flannery, B. P.:
Numerical recipes in FORTRAN. The art of scientific computing, Cambridge University Press, ISBN 9780521430647, 1992. a
Sun, Q., Miyoshi, T., and Richard, S.:
Control Simulation Experiments of Extreme Events with the Lorenz-96 Model, Nonlin. Processes Geophys. Discuss. [preprint], https://doi.org/10.5194/npg-2022-12, in review, 2022. a, b
Tokuda, K., Katori, Y., and Aihara, K.:
Chaotic dynamics as a mechanism of rapid transition of hippocampal local field activity between theta and non-theta states, Chaos, 29, 113115, https://doi.org/10.1063/1.5110327, 2019. a
Tokuda, K., Fujiwara, N., Sudo, A., and Katori, Y.:
Chaos may enhance expressivity in cerebellar granular layer, Neural Networks, 136, 72–86, https://doi.org/10.1016/j.neunet.2020.12.020, 2021. a
Toth, Z. and Kalnay, E.:
Ensemble forecasting at NMC: the generation of perturbations, B. Am. Meteorol. Soc., 74, 2317–2330, https://doi.org/10.1175/1520-0477(1993)074<2317:EFANTG>2.0.CO;2, 1993. a
Toth, Z. and Kalnay, E.:
Ensemble forecasting at NCEP and the breeding method, Mon. Weather Rev., 125, 3297–3319, https://doi.org/10.1175/1520-0493(1997)125<3297:EFANAT>2.0.CO;2, 1997. a
Yang, S.-C., Kalnay, E., and Hunt, B.:
Handling nonlinearity in an ensemble Kalman filter: Experiments with the three-variable Lorenz model, Mon. Weather Rev., 140, 2628–2646, https://doi.org/10.1175/MWR-D-11-00313.1, 2012. a
Zhang, Y., Ide, K., and Kalnay, E.:
Bred vectors of the Lorenz63 system, Adv. Atmos. Sci., 32, 1533–1538, https://doi.org/10.1007/s00376-015-4275-8, 2015. a
Short summary
This research found that weather control would change the chaotic behavior of an atmospheric model. We proposed to introduce chaos theory in the weather control. Experimental results demonstrated that the proposed approach reduced the manipulations, including the control times and magnitudes, which throw light on the weather control in a real atmospheric model.
This research found that weather control would change the chaotic behavior of an atmospheric...