Articles | Volume 29, issue 2
https://doi.org/10.5194/npg-29-171-2022
© Author(s) 2022. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/npg-29-171-2022
© Author(s) 2022. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Using neural networks to improve simulations in the gray zone
Raphael Kriegmair
Meteorological Institute Munich, Ludwig-Maximilians-Universität München, Munich, Germany
Yvonne Ruckstuhl
CORRESPONDING AUTHOR
Meteorological Institute Munich, Ludwig-Maximilians-Universität München, Munich, Germany
Stephan Rasp
ClimateAi, Inc., San Francisco, USA
George Craig
Meteorological Institute Munich, Ludwig-Maximilians-Universität München, Munich, Germany
Related authors
No articles found.
Oriol Tintó Prims, Robert Redl, Marc Rautenhaus, Tobias Selz, Takumi Matsunobu, Kameswar Rao Modali, and George Craig
Geosci. Model Dev., 17, 8909–8925, https://doi.org/10.5194/gmd-17-8909-2024, https://doi.org/10.5194/gmd-17-8909-2024, 2024
Short summary
Short summary
Advanced compression techniques can drastically reduce the size of meteorological datasets (by 5 to 150 times) without compromising the data's scientific value. We developed a user-friendly tool called
enstools-compressionthat makes this compression simple for Earth scientists. This tool works seamlessly with common weather and climate data formats. Our work shows that lossy compression can significantly improve how researchers store and analyze large meteorological datasets.
Konstantin Krüger, Andreas Schäfler, Martin Weissmann, and George C. Craig
Weather Clim. Dynam., 5, 491–509, https://doi.org/10.5194/wcd-5-491-2024, https://doi.org/10.5194/wcd-5-491-2024, 2024
Short summary
Short summary
Initial conditions of current numerical weather prediction models insufficiently represent the sharp vertical gradients across the midlatitude tropopause. Observation-space data assimilation output is used to study the influence of assimilated radiosondes on the tropopause. The radiosondes reduce systematic biases of the model background and sharpen temperature and wind gradients in the analysis. Tropopause sharpness is still underestimated in the analysis, which may impact weather forecasts.
Hyunju Jung, Peter Knippertz, Yvonne Ruckstuhl, Robert Redl, Tijana Janjic, and Corinna Hoose
Weather Clim. Dynam., 4, 1111–1134, https://doi.org/10.5194/wcd-4-1111-2023, https://doi.org/10.5194/wcd-4-1111-2023, 2023
Short summary
Short summary
A narrow rainfall belt in the tropics is an important feature for large-scale circulations and the global water cycle. The accurate simulation of this rainfall feature has been a long-standing problem, with the reasons behind that unclear. We present a novel diagnostic tool that allows us to disentangle processes important for rainfall, which changes due to modifications in model. Using our diagnostic tool, one can potentially identify sources of uncertainty in weather and climate models.
Andreas A. Beckert, Lea Eisenstein, Annika Oertel, Tim Hewson, George C. Craig, and Marc Rautenhaus
Geosci. Model Dev., 16, 4427–4450, https://doi.org/10.5194/gmd-16-4427-2023, https://doi.org/10.5194/gmd-16-4427-2023, 2023
Short summary
Short summary
We investigate the benefit of objective 3-D front detection with modern interactive visual analysis techniques for case studies of extra-tropical cyclones and comparisons of frontal structures between different numerical weather prediction models. The 3-D frontal structures show agreement with 2-D fronts from surface analysis charts and augment them in the vertical dimension. We see great potential for more complex studies of atmospheric dynamics and for operational weather forecasting.
Konstantin Krüger, Andreas Schäfler, Martin Wirth, Martin Weissmann, and George C. Craig
Atmos. Chem. Phys., 22, 15559–15577, https://doi.org/10.5194/acp-22-15559-2022, https://doi.org/10.5194/acp-22-15559-2022, 2022
Short summary
Short summary
A comprehensive data set of airborne lidar water vapour profiles is compared with ERA5 reanalyses for a robust characterization of the vertical structure of the mid-latitude lower-stratospheric moist bias. We confirm a moist bias of up to 55 % at 1.3 km altitude above the tropopause and uncover a decreasing bias beyond. Collocated O3 and H2O observations reveal a particularly strong bias in the mixing layer, indicating insufficiently modelled transport processes fostering the bias.
Andreas Alexander Beckert, Lea Eisenstein, Annika Oertel, Timothy Hewson, George C. Craig, and Marc Rautenhaus
Weather Clim. Dynam. Discuss., https://doi.org/10.5194/wcd-2022-36, https://doi.org/10.5194/wcd-2022-36, 2022
Preprint withdrawn
Short summary
Short summary
This study revises and extends a previously presented 3-D objective front detection method and demonstrates its benefits to analyse weather dynamics in numerical simulation data. Based on two case studies of extratropical cyclones, we demonstrate the evaluation of conceptual models from dynamic meteorology, illustrate the benefits of our interactive analysis approach by comparing fronts in data with different model resolutions, and study the impact of convection on fronts.
Yong Wang, Guang J. Zhang, Shaocheng Xie, Wuyin Lin, George C. Craig, Qi Tang, and Hsi-Yen Ma
Geosci. Model Dev., 14, 1575–1593, https://doi.org/10.5194/gmd-14-1575-2021, https://doi.org/10.5194/gmd-14-1575-2021, 2021
Short summary
Short summary
A stochastic deep convection parameterization is implemented into the US Department of Energy Energy Exascale Earth System Model Atmosphere Model version 1 (EAMv1). Compared to the default model, the well-known problem of
too much light rain and too little heavy rainis largely alleviated over the tropics with the stochastic scheme. Results from this study provide important insights into the model performance of EAMv1 when stochasticity is included in the deep convective parameterization.
Cited articles
Bocquet, M., Brajard, J., Carrassi, A., and Bertino, L.: Bayesian inference of chaotic dynamics by merging data assimilation, machine learning and expectation-maximization, Foundations of Data Science, 2, 55–80, https://doi.org/10.3934/fods.2020004, 2020. a
Bolton, T. and Zanna, L.: Applications of Deep Learning to Ocean Data Inference and Subgrid Parameterization, J. Adv. Model. Earth Sy., 11, 376–399, https://doi.org/10.1029/2018MS001472, 2019. a
Brajard, J., Carrassi, A., Bocquet, M., and Bertino, L.: Combining data assimilation and machine learning to emulate a dynamical model from sparse and noisy observations: A case study with the Lorenz 96 model, J. Comput. Sci., 44, 101171, https://doi.org/10.1016/j.jocs.2020.101171, 2020. a
Brajard, J., Carrassi, A., Bocquet, M., and Bertino, L.: Combining data assimilation and machine learning to infer unresolved scale parametrization, Philos. T. Roy. Soc. A, 379, 20200086, https://doi.org/10.1098/rsta.2020.0086, 2021. a
Brenowitz, N. D. and Bretherton, C. S.: Spatially Extended Tests of a Neural Network Parametrization Trained by Coarse-Graining, J. Adv. Model. Earth Sy., 11, 2728–2744, https://doi.org/10.1029/2019MS001711, 2019. a, b
Brunton, S. L., Proctor, J. L., and Kutz, J. N.: Discovering governing equations from data by sparse identification of nonlinear dynamical systems, P. Natl. Acad. Sci. USA, 113, 3932–3937, https://doi.org/10.1073/pnas.1517384113, 2016. a
Bryan, G. H., Wyngaard, J. C., and Fritsch, J. M.: Resolution Requirements for the Simulation of Deep Moist Convection, Mon. Weather Rev., 131, 2394–2416, https://doi.org/10.1175/1520-0493(2003)131<2394:RRFTSO>2.0.CO;2, 2003. a
Chollet, F.: Deep Learning with Python, Manning Publications
Company, Greenwich, CT, USA, ISBN 9781617294433, 2017. a
Chow, F. K., Schär, C., Ban, N., Lundquist, K. A., Schlemmer, L., and Shi, X.: Crossing Multiple Gray Zones in the Transition from Mesoscale to Microscale Simulation over Complex Terrain, Atmosphere, 10, 274, https://doi.org/10.3390/atmos10050274, 2019. a
Dueben, P. D. and Bauer, P.: Challenges and design choices for global weather and climate models based on machine learning, Geosci. Model Dev., 11, 3999–4009, https://doi.org/10.5194/gmd-11-3999-2018, 2018. a
Fablet, R., Ouala, S., and Herzet, C.: Bilinear Residual Neural Network for the Identification and Forecasting of Geophysical Dynamics, in: 2018 26th European Signal Processing Conference (EUSIPCO), 3–7 September 2018, Rome, Italy, 1477–1481, https://doi.org/10.23919/EUSIPCO.2018.8553492, 2018. a
Faranda, D., Lembo, V., Iyer, M., Kuzzay, D., Chibbaro, S., Daviaud, F., and Dubrulle, B.: Computation and Characterization of Local Subfilter-Scale Energy Transfers in Atmospheric Flows, J. Atmos. Sci., 75, 2175–2186, https://doi.org/10.1175/JAS-D-17-0114.1, 2018. a
Faranda, D., Vrac, M., Yiou, P., Pons, F. M. E., Hamid, A., Carella, G., Ngoungue Langue, C., Thao, S., and Gautard, V.: Enhancing geophysical flow machine learning performance via scale separation, Nonlin. Processes Geophys., 28, 423–443, https://doi.org/10.5194/npg-28-423-2021, 2021. a, b
Goodfellow, I., Bengio, Y., and Courville, A.: Deep Learning, MIT Press, http://www.deeplearningbook.org, ISBN: 9780262035613, 2016. a
Honnert, R., Efstathiou, G. A., Beare, R. J., Ito, J., Lock, A., Neggers, R., Plant, R. S., Shin, H. H., Tomassini, L., and Zhou, B.: The Atmospheric Boundary Layer and the “Gray Zone” of Turbulence: A Critical Review, J. Geophys. Res.-Atmos., 125, e2019JD030317, https://doi.org/10.1029/2019JD030317, 2020. a, b
Jeworrek, J., West, G., and Stull, R.: Evaluation of Cumulus and Microphysics Parameterizations in WRF across the Convective Gray Zone, Weather Forecast., 34, 1097–1115, https://doi.org/10.1175/WAF-D-18-0178.1, 2019. a
Jones, T. R. and Randall, D. A.: Quantifying the limits of convective parameterizations, J. Geophys. Res.-Atmos., 116, D08210, https://doi.org/10.1029/2010JD014913, 2011. a
Kent, T., Bokhove, O., and Tobias, S.: Dynamics of an idealized fluid model for investigating convective-scale data assimilation, Tellus A, 69, 1369332, https://doi.org/10.1080/16000870.2017.1369332, 2017. a
Krasnopolsky, V. M., Fox-Rabinovitz, M. S., and Belochitski, A. A.: Using ensemble of neural networks to learn stochastic convection parameterizations for climate and numerical weather prediction models from data simulated by a cloud resolving model, Adv. Artif. Neural Syst., 2013, 485913, https://doi.org/10.1155/2013/485913, 2013. a
Lovejoy, S. and Schertzer, D.: Towards a new synthesis for atmospheric dynamics: Space–time cascades, Atmos. Res., 96, 1–52, https://doi.org/10.1016/j.atmosres.2010.01.004, 2010. a
Marino, R., Mininni, P. D., Rosenberg, D., and Pouquet, A.: Inverse cascades in rotating stratified turbulence: Fast growth of large scales, EPL-Europhys. Lett., 102, 44006, https://doi.org/10.1209/0295-5075/102/44006, 2013. a
O'Gorman, P. A. and Dwyer, J. G.: Using Machine Learning to Parameterize Moist Convection: Potential for Modeling of Climate, Climate Change, and Extreme Events, J. Adv. Model. Earth Sy., 10, 2548–2563, https://doi.org/10.1029/2018MS001351, 2018.
a
Pathak, J., Hunt, B., Girvan, M., Lu, Z., and Ott, E.: Model-Free Prediction of Large Spatiotemporally Chaotic Systems from Data: A Reservoir Computing Approach, Phys. Rev. Lett., 120, 024102, https://doi.org/10.1103/PhysRevLett.120.024102, 2018. a
Randall, D., Khairoutdinov, M., Arakawa, A., and Grabowski, W.: Breaking the Cloud Parameterization Deadlock, B. Am. Meteorol. Soc., 84, 1547–1564, https://doi.org/10.1175/BAMS-84-11-1547, 2003. a
Randall, D. A.: Beyond deadlock, Geophys. Res. Lett., 40, 5970–5976, https://doi.org/10.1002/2013GL057998, 2013. a
Rasp, S.: Coupled online learning as a way to tackle instabilities and biases in neural network parameterizations: general algorithms and Lorenz 96 case study (v1.0), Geosci. Model Dev., 13, 2185–2196, https://doi.org/10.5194/gmd-13-2185-2020, 2020. a
Rasp, S., Pritchard, M. S., and Gentine, P.: Deep learning to represent subgrid processes in climate models, P. Natl. Acad. Sci. USA, 115, 9684–9689, https://doi.org/10.1073/pnas.1810286115, 2018. a
Kriegmair, R.: wavestoweather/NNforModelError: NN to improve simulations in the grey zone (v1.0.0), Zenodo [code], https://doi.org/10.5281/zenodo.4740252, 2021. a
Ruckstuhl, Y. and Janjić, T.: Parameter and state estimation with ensemble Kalman filter based algorithms for convective-scale applications, Q. J. Roy. Meteor. Soc, 144, 826–841, https://doi.org/10.1002/qj.3257, 2018. a
Ruckstuhl, Y., Janjić, T., and Rasp, S.: Training a convolutional neural network to conserve mass in data assimilation, Nonlin. Processes Geophys., 28, 111–119, https://doi.org/10.5194/npg-28-111-2021, 2021. a, b
Scher, S.: Toward Data-Driven Weather and Climate Forecasting: Approximating a Simple General Circulation Model With Deep Learning, Geophys. Res. Lett., 45, 12616–12622, https://doi.org/10.1029/2018GL080704, 2018. a
Stensrud, D.: Parameterization Schemes: Keys to Understanding Numerical Weather Prediction Models, Cambridge University Press, ISBN 978-0-521-12676-2, 2009. a
Wagner, A., Heinzeller, D., Wagner, S., Rummler, T., and Kunstmann, H.: Explicit Convection and Scale-Aware Cumulus Parameterizations: High-Resolution Simulations over Areas of Different Topography in Germany, Mon. Weather Rev., 146, 1925–1944, https://doi.org/10.1175/MWR-D-17-0238.1, 2018. a
Würsch, M. and Craig, G. C.: A simple dynamical model of cumulus convection for data assimilation research, Meteorol. Z., 23, 483–490, https://doi.org/10.1127/0941-2948/2014/0492, 2014. a, b
Zeng, Y., Janjić, T., Ruckstuhl, Y., and Verlaan, M.: Ensemble-type Kalman filter algorithm conserving mass, total energy and enstrophy, Q. J. Roy. Meteor. Soc., 143, 2902–2914, https://doi.org/10.1002/qj.3142, 2017. a
Short summary
Our regional numerical weather prediction models run at kilometer-scale resolutions. Processes that occur at smaller scales not yet resolved contribute significantly to the atmospheric flow. We use a neural network (NN) to represent the unresolved part of physical process such as cumulus clouds. We test this approach on a simplified, yet representative, 1D model and find that the NN corrections vastly improve the model forecast up to a couple of days.
Our regional numerical weather prediction models run at kilometer-scale resolutions. Processes...