Articles | Volume 28, issue 4
https://doi.org/10.5194/npg-28-615-2021
© Author(s) 2021. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/npg-28-615-2021
© Author(s) 2021. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Research article
| 
01 Nov 2021
Research article |
| 01 Nov 2021
| 01 Nov 2021
Reduced non-Gaussianity by 30 s rapid update in convective-scale numerical weather prediction
RIKEN Center for Computational Science, Kobe, Japan
Center for Oceanic and Atmospheric Research (CIMA-UBA/CONICET); Atmospheric and Oceanographic Science Department, FCEyN, University of Buenos Aires; French-Argentinean Institute for the Study of Climate and its Impacts (UMI-IFAECI/CNRS-CONICET-UBA), Buenos Aires, Argentina
Guo-Yuan Lien
Research and Development Center, Central Weather Bureau, Taipei, Taiwan
Keiichi Kondo
Department of Observation and Data Assimilation Research, Meteorological Research Institute, Tsukuba, Japan
Shigenori Otsuka
RIKEN Center for Computational Science, Kobe, Japan
RIKEN Cluster for Pioneering Research, Kobe, Japan
RIKEN Interdisciplinary Theoretical and Mathematical Sciences Program, Kobe, Japan
Takemasa Miyoshi
CORRESPONDING AUTHOR
RIKEN Center for Computational Science, Kobe, Japan
RIKEN Cluster for Pioneering Research, Kobe, Japan
RIKEN Interdisciplinary Theoretical and Mathematical Sciences Program, Kobe, Japan
Atmospheric and Oceanic Science Department, University of Maryland, College Park, Maryland, USA
Japan Agency for Marine-Earth Science and Technology, Yokohama, Japan
Related authors
Juan Martin Guerrieri, Manuel Arturo Pulido, Takemasa Miyoshi, Arata Amemiya, and Juan José Ruiz
EGUsphere, https://doi.org/10.5194/egusphere-2025-2420, https://doi.org/10.5194/egusphere-2025-2420, 2025
Short summary
Short summary
This work extends the Mapping Particle Filter to account for local dependencies. Two localization methods are tested: a global particle flow with local kernels, and iterative local mappings based on correlation radius. Using a two-scale Lorenz-96 truth and a one-scale forecast model, experiments with full/partial and linear/nonlinear observations show Root Mean Square Error (RMSE) reductions using localized Gaussian mixture priors, achieving competitive performance against Gaussian filters.
Pierre Le Bras, Florian Sévellec, Pierre Tandeo, Juan Ruiz, and Pierre Ailliot
Nonlin. Processes Geophys., 31, 303–317, https://doi.org/10.5194/npg-31-303-2024, https://doi.org/10.5194/npg-31-303-2024, 2024
Short summary
Short summary
The goal of this paper is to weight several dynamic models in order to improve the representativeness of a system. It is illustrated using a set of versions of an idealized model describing the Atlantic Meridional Overturning Circulation. The low-cost method is based on data-driven forecasts. It enables model performance to be evaluated on their dynamics. Taking into account both model performance and codependency, the derived weights outperform benchmarks in reconstructing a model distribution.
Juan Ruiz, Pierre Ailliot, Thi Tuyet Trang Chau, Pierre Le Bras, Valérie Monbet, Florian Sévellec, and Pierre Tandeo
Geosci. Model Dev., 15, 7203–7220, https://doi.org/10.5194/gmd-15-7203-2022, https://doi.org/10.5194/gmd-15-7203-2022, 2022
Short summary
Short summary
We present a new approach to validate numerical simulations of the current climate. The method can take advantage of existing climate simulations produced by different centers combining an analog forecasting approach with data assimilation to quantify how well a particular model reproduces a sequence of observed values. The method can be applied with different observations types and is implemented locally in space and time significantly reducing the associated computational cost.
Arata Amemiya and Takemasa Miyoshi
EGUsphere, https://doi.org/10.5194/egusphere-2025-2543, https://doi.org/10.5194/egusphere-2025-2543, 2025
Short summary
Short summary
The accurate estimation of atmospheric state variables from radar observation in rapidly growing deep convection, which causes heavy thunderstorms, is a major challenge. This study examines the advantage of incorporating radar observation data with very high frequency such as 30 seconds compared with the conventional case of 5 minutes, from a theoretical perspective.
Juan Martin Guerrieri, Manuel Arturo Pulido, Takemasa Miyoshi, Arata Amemiya, and Juan José Ruiz
EGUsphere, https://doi.org/10.5194/egusphere-2025-2420, https://doi.org/10.5194/egusphere-2025-2420, 2025
Short summary
Short summary
This work extends the Mapping Particle Filter to account for local dependencies. Two localization methods are tested: a global particle flow with local kernels, and iterative local mappings based on correlation radius. Using a two-scale Lorenz-96 truth and a one-scale forecast model, experiments with full/partial and linear/nonlinear observations show Root Mean Square Error (RMSE) reductions using localized Gaussian mixture priors, achieving competitive performance against Gaussian filters.
Michael Goodliff and Takemasa Miyoshi
EGUsphere, https://doi.org/10.5194/egusphere-2025-933, https://doi.org/10.5194/egusphere-2025-933, 2025
Short summary
Short summary
Data-driven models (DDMs) learn from large datasets to make predictions, but data limitations affect reliability. Data assimilation (DA) improves accuracy by combining real-world observations with computational models. This research explores how DA enhances DDMs despite limited data. We propose an algorithm using DA to refine DDM training iteratively. This work has broad implications for fields like meteorology, engineering, and environmental science, where accurate prediction is critical.
Pierre Le Bras, Florian Sévellec, Pierre Tandeo, Juan Ruiz, and Pierre Ailliot
Nonlin. Processes Geophys., 31, 303–317, https://doi.org/10.5194/npg-31-303-2024, https://doi.org/10.5194/npg-31-303-2024, 2024
Short summary
Short summary
The goal of this paper is to weight several dynamic models in order to improve the representativeness of a system. It is illustrated using a set of versions of an idealized model describing the Atlantic Meridional Overturning Circulation. The low-cost method is based on data-driven forecasts. It enables model performance to be evaluated on their dynamics. Taking into account both model performance and codependency, the derived weights outperform benchmarks in reconstructing a model distribution.
Kenta Kurosawa, Shunji Kotsuki, and Takemasa Miyoshi
Nonlin. Processes Geophys., 30, 457–479, https://doi.org/10.5194/npg-30-457-2023, https://doi.org/10.5194/npg-30-457-2023, 2023
Short summary
Short summary
This study aimed to enhance weather and hydrological forecasts by integrating soil moisture data into a global weather model. By assimilating atmospheric observations and soil moisture data, the accuracy of forecasts was improved, and certain biases were reduced. The method was found to be particularly beneficial in areas like the Sahel and equatorial Africa, where precipitation patterns vary seasonally. This new approach has the potential to improve the precision of weather predictions.
Qiwen Sun, Takemasa Miyoshi, and Serge Richard
Nonlin. Processes Geophys., 30, 117–128, https://doi.org/10.5194/npg-30-117-2023, https://doi.org/10.5194/npg-30-117-2023, 2023
Short summary
Short summary
This paper is a follow-up of a work by Miyoshi and Sun which was published in NPG Letters in 2022. The control simulation experiment is applied to the Lorenz-96 model for avoiding extreme events. The results show that extreme events of this partially and imperfectly observed chaotic system can be avoided by applying pre-designed small perturbations. These investigations may be extended to more realistic numerical weather prediction models.
Tobias Necker, David Hinger, Philipp Johannes Griewank, Takemasa Miyoshi, and Martin Weissmann
Nonlin. Processes Geophys., 30, 13–29, https://doi.org/10.5194/npg-30-13-2023, https://doi.org/10.5194/npg-30-13-2023, 2023
Short summary
Short summary
This study investigates vertical localization based on a convection-permitting 1000-member ensemble simulation. We derive an empirical optimal localization (EOL) that minimizes sampling error in 40-member sub-sample correlations assuming 1000-member correlations as truth. The results will provide guidance for localization in convective-scale ensemble data assimilation systems.
Shun Ohishi, Takemasa Miyoshi, and Misako Kachi
Geosci. Model Dev., 15, 9057–9073, https://doi.org/10.5194/gmd-15-9057-2022, https://doi.org/10.5194/gmd-15-9057-2022, 2022
Short summary
Short summary
An adaptive observation error inflation (AOEI) method was proposed for atmospheric data assimilation to mitigate erroneous analysis updates caused by large observation-minus-forecast differences for satellite brightness temperature around clear- and cloudy-sky boundaries. This study implemented the AOEI with an ocean data assimilation system, leading to an improvement of analysis accuracy and dynamical balance around the frontal regions with large meridional temperature differences.
Shun Ohishi, Tsutomu Hihara, Hidenori Aiki, Joji Ishizaka, Yasumasa Miyazawa, Misako Kachi, and Takemasa Miyoshi
Geosci. Model Dev., 15, 8395–8410, https://doi.org/10.5194/gmd-15-8395-2022, https://doi.org/10.5194/gmd-15-8395-2022, 2022
Short summary
Short summary
We develop an ensemble-Kalman-filter-based regional ocean data assimilation system in which satellite and in situ observations are assimilated at a daily frequency. We find the best setting for dynamical balance and accuracy based on sensitivity experiments focused on how to inflate the ensemble spread and how to apply the analysis update to the model evolution. This study has a broader impact on more general data assimilation systems in which the initial shocks are a significant issue.
Shunji Kotsuki, Takemasa Miyoshi, Keiichi Kondo, and Roland Potthast
Geosci. Model Dev., 15, 8325–8348, https://doi.org/10.5194/gmd-15-8325-2022, https://doi.org/10.5194/gmd-15-8325-2022, 2022
Short summary
Short summary
Data assimilation plays an important part in numerical weather prediction (NWP) in terms of combining forecasted states and observations. While data assimilation methods in NWP usually assume the Gaussian error distribution, some variables in the atmosphere, such as precipitation, are known to have non-Gaussian error statistics. This study extended a widely used ensemble data assimilation algorithm to enable the assimilation of more non-Gaussian observations.
Juan Ruiz, Pierre Ailliot, Thi Tuyet Trang Chau, Pierre Le Bras, Valérie Monbet, Florian Sévellec, and Pierre Tandeo
Geosci. Model Dev., 15, 7203–7220, https://doi.org/10.5194/gmd-15-7203-2022, https://doi.org/10.5194/gmd-15-7203-2022, 2022
Short summary
Short summary
We present a new approach to validate numerical simulations of the current climate. The method can take advantage of existing climate simulations produced by different centers combining an analog forecasting approach with data assimilation to quantify how well a particular model reproduces a sequence of observed values. The method can be applied with different observations types and is implemented locally in space and time significantly reducing the associated computational cost.
Takemasa Miyoshi and Qiwen Sun
Nonlin. Processes Geophys., 29, 133–139, https://doi.org/10.5194/npg-29-133-2022, https://doi.org/10.5194/npg-29-133-2022, 2022
Short summary
Short summary
The weather is chaotic and hard to predict, but the chaos implies an effective control where a small control signal grows rapidly to make a big difference. This study proposes a control simulation experiment where we apply a small signal to control
naturein a computational simulation. Idealized experiments with a low-order chaotic system show successful results by small control signals of only 3 % of the observation error. This is the first step toward realistic weather simulations.
Cited articles
Aksoy, A., Dowell, D. C., and Snyder, C.: A Multicase Comparative Assessment of
the Ensemble Kalman Filter for Assimilation of Radar Observations. Part
I: Storm-Scale Analyses, Mon. Weather Rev., 137, 1805–1824,
https://doi.org/10.1175/2008MWR2691.1, 2009. a
Beljaars, A. C. M. and Holtslag, A. A. M.: Flux Parameterization over Land
Surfaces for Atmospheric Models, J. Appl. Meteorol., 30,
327–341, https://doi.org/10.1175/1520-0450(1991)030<0327:FPOLSF>2.0.CO;2, 1991. a
Bick, T., Simmer, C., Trömel, S., Wapler, K., Hendricks Franssen, H.-J.,
Stephan, K., Blahak, U., Schraff, C., Reich, H., Zeng, Y., and Potthast, R.:
Assimilation of 3D radar reflectivities with an ensemble Kalman filter on the
convective scale, Q. J. Roy. Meteor. Soc., 142,
1490–1504, https://doi.org/10.1002/qj.2751, 2016. a
Evensen, G.: The ensemble Kalman filter for combined state and parameter
estimation, IEEE Contr. Syst. Mag., 29, 83–104,
https://doi.org/10.1109/MCS.2009.932223, 2009. a, b
Honda, T., Miyoshi, T., Lien, G.-Y., Nishizawa, S., Yoshida, R., Adachi, S. A.,
Terasaki, K., Okamoto, K., Tomita, H., and Bessho, K.: Assimilating All-Sky
Himawari-8 Satellite Infrared Radiances: A Case of Typhoon Soudelor (2015),
Mon. Weather Rev., 146, 213–229, https://doi.org/10.1175/MWR-D-16-0357.1, 2018. a
Honda, T., Lien, G.-Y., Amemiya, A., and Yashiro, H.: SCALE-LETKF version for npg-2021-15 manuscript (npg-2021-15), Zenodo [code], https://doi.org/10.5281/zenodo.5540380, 2021. a
Houtekamer, P. L. and Zhang, F.: Review of the Ensemble Kalman Filter for
Atmospheric Data Assimilation, Mon. Weather Rev., 144, 4489–4532,
https://doi.org/10.1175/MWR-D-15-0440.1, 2016. a
Hunt, B. R., Kalnay, E., Kostelich, E. J., Ott, E., Patil, D. J.,
Sauer, T., Szunyogh, I., Yorke, J. A., and Zimin, A. V.:
Four-dimensional ensemble Kalman filtering, Tellus A, 56, 273–277, https://doi.org/10.3402/tellusa.v56i4.14424, 2004. a
Hunt, B. R., Kostelich, E. J., and Szunyogh, I.: Efficient data assimilation
for spatiotemporal chaos: A local ensemble transform Kalman filter, Physica
D, 230, 112–126,
https://doi.org/10.1016/j.physd.2006.11.008, 2007. a
Jacques, D. and Zawadzki, I.: The Impacts of Representing the Correlation of
Errors in Radar Data Assimilation. Part I: Experiments with Simulated
Background and Observation Estimates, Mon. Weather Rev., 142, 3998–4016, https://doi.org/10.1175/MWR-D-14-00104.1, 2014. a
Kawabata, T. and Ueno, G.: Non-Gaussian Probability Densities of Convection
Initiation and Development Investigated Using a Particle Filter with a
Storm-Scale Numerical Weather Prediction Model, Mon. Weather Rev., 148,
3–20, https://doi.org/10.1175/MWR-D-18-0367.1, 2020. a, b
Kondo, K. and Miyoshi, T.: Non-Gaussian statistics in global atmospheric dynamics: a study with a 10 240-member ensemble Kalman filter using an intermediate atmospheric general circulation model, Nonlin. Processes Geophys., 26, 211–225, https://doi.org/10.5194/npg-26-211-2019, 2019. a, b, c, d
Kullback, S. and Leibler, R. A.: On Information and Sufficiency, Ann. Math.
Statist., 22, 79–86, https://doi.org/10.1214/aoms/1177729694, 1951. a
Lange, H. and Craig, G. C.: The Impact of Data Assimilation Length Scales on
Analysis and Prediction of Convective Storms, Mon. Weather Rev., 142,
3781–3808, https://doi.org/10.1175/MWR-D-13-00304.1, 2014. a
Lei, J., Bickel, P., and Snyder, C.: Comparison of Ensemble Kalman Filters
under Non-Gaussianity, Mon. Weather Rev., 138, 1293–1306,
https://doi.org/10.1175/2009MWR3133.1, 2010. a
Lien, G.-Y., Miyoshi, T., Nishizawa, S., Yoshida, R., Yashiro, H., Adachi,
S. A., Yamaura, T., and Tomita, H.: The Near-Real-Time SCALE-LETKF System: A
Case of the September 2015 Kanto-Tohoku Heavy Rainfall, SOLA, 13, 1–6,
https://doi.org/10.2151/sola.2017-001, 2017. a, b, c
Maejima, Y. and Miyoshi, T.: Impact of the Window Length of
Four-Dimensional Local Ensemble Transform Kalman Filter: A Case of Convective
Rain Event, SOLA, 16, 37–42, https://doi.org/10.2151/sola.2020-007, 2020. a, b
Maldonado, P., Ruiz, J., and Saulo, C.: Sensitivity to Initial and Boundary
Perturbations in Convective-Scale Ensemble-Based Data Assimilation:
Imperfect-Model OSSEs, SOLA, 17, 96–102, https://doi.org/10.2151/sola.2021-015, 2021. a
Miyoshi, T., Kondo, K., and Imamura, T.: The 10,240-member ensemble Kalman
filtering with an intermediate AGCM, Geophys. Res. Lett., 41,
5264–5271, https://doi.org/10.1002/2014GL060863, 2014. a
Miyoshi, T., Kondo, K., and Terasaki, K.: Big Ensemble Data Assimilation
in Numerical Weather Prediction, Computer, 48, 15–21,
https://doi.org/10.1109/MC.2015.332, 2015. a
Miyoshi, T., Kunii, M., Ruiz, J., Lien, G.-Y., Satoh, S., Ushio,
T., Bessho, K., Seko, H., Tomita, H., and Ishikawa, Y.: “Big Data
Assimilation” Revolutionizing Severe Weather Prediction, B.
Am. Meteorol. Soc., 97, 1347–1354,
https://doi.org/10.1175/BAMS-D-15-00144.1, 2016a. a, b
Miyoshi, T., Lien, G., Satoh, S., Ushio, T., Bessho, K., Tomita,
H., Nishizawa, S., Yoshida, R., Adachi, S. A., Liao, J., Gerofi,
B., Ishikawa, Y., Kunii, M., Ruiz, J., Maejima, Y., Otsuka, S.,
Otsuka, M., Okamoto, K., and Seko, H.: “Big Data Assimilation”
Toward Post-Petascale Severe Weather Prediction: An Overview and Progress,
Proceedings of the IEEE, 104, 2155–2179, https://doi.org/10.1109/JPROC.2016.2602560,
2016b. a
Nakanishi, M. and Niino, H.: An Improved Mellor–Yamada Level-3 Model with
Condensation Physics: Its Design and Verification, Bound.-Lay.
Meteorol., 112, 1–31, https://doi.org/10.1023/B:BOUN.0000020164.04146.98,
2004. a
National Institute of Information and Communications Technology: Phased Array Weather Radar Real-time observation data, PAWR [data set], available at: https://pawr.nict.go.jp/index_en.html, last access: 18 October 2021. a
Necker, T., Geiss, S., Weissmann, M., Ruiz, J., Miyoshi, T., and
Lien, G.-Y.: A convective-scale 1,000-member ensemble simulation and
potential applications, Q. J. Roy. Meteor.
Soc., 146, 1423–1442, https://doi.org/10.1002/qj.3744, 2020a. a, b
Necker, T., Weissmann, M., Ruckstuhl, Y., Anderson, J., and Miyoshi,
T.: Sampling Error Correction Evaluated Using a Convective-Scale 1000-Member
Ensemble, Mon. Weather Rev., 148, 1229–1249,
https://doi.org/10.1175/MWR-D-19-0154.1, 2020b. a
Nishizawa, S., Yashiro, H., Sato, Y., Miyamoto, Y., and Tomita, H.: Influence of grid aspect ratio on planetary boundary layer turbulence in large-eddy simulations, Geosci. Model Dev., 8, 3393–3419, https://doi.org/10.5194/gmd-8-3393-2015, 2015. a
Nishizawa, S., Yashiro, H., Yamaura, T., Adachi, S. A., Yoshida R., Sato, Y., Sueki, K., Matsushima, T., Kawai, Y., and Tomita, H.: SCALE (5.4.4), Zenodo [code], https://doi.org/10.5281/zenodo.5146864, 2021. a
Ruiz, J. J., Miyoshi, T., Satoh, S., and Ushio, T.: A Quality Control Algorithm
for the Osaka Phased Array Weather Radar, SOLA, 11, 48–52,
https://doi.org/10.2151/sola.2015-011, 2015. a
Saha, S., Moorthi, S., Pan, H.-L., Wu, X., Wang, J., Nadiga, S., Tripp, P.,
Kistler, R., Woollen, J., Behringer, D., Liu, H., Stokes, D., Grumbine, R.,
Gayno, G., Wang, J., Hou, Y.-T., Chuang, H.-y., Juang, H.-M. H., Sela, J.,
Iredell, M., Treadon, R., Kleist, D., Van Delst, P., Keyser, D., Derber, J.,
Ek, M., Meng, J., Wei, H., Yang, R., Lord, S., van den Dool, H., Kumar, A.,
Wang, W., Long, C., Chelliah, M., Xue, Y., Huang, B., Schemm, J.-K.,
Ebisuzaki, W., Lin, R., Xie, P., Chen, M., Zhou, S., Higgins, W., Zou, C.-Z.,
Liu, Q., Chen, Y., Han, Y., Cucurull, L., Reynolds, R. W., Rutledge, G., and
Goldberg, M.: The NCEP Climate Forecast System Reanalysis, B.
Am. Meteorol. Soc., 91, 1015–1058,
https://doi.org/10.1175/2010BAMS3001.1, 2010. a
Sekiguchi, M. and Nakajima, T.: A k-distribution-based radiation code and its
computational optimization for an atmospheric general circulation model,
J. Quant. Spectrosc. Ra., 109, 2779–2793, https://doi.org/10.1016/j.jqsrt.2008.07.013, 2008. a
Stensrud, D. J., Wicker, L. J., Xue, M., Dawson, D. T., Yussouf, N., Wheatley,
D. M., Thompson, T. E., Snook, N. A., Smith, T. M., Schenkman, A. D., Potvin,
C. K., Mansell, E. R., Lei, T., Kuhlman, K. M., Jung, Y., Jones, T. A., Gao,
J., Coniglio, M. C., Brooks, H. E., and Brewster, K. A.: Progress and
challenges with Warn-on-Forecast, 6th European Conference
on Severe Storms 2011, Palma de Mallorca, Spain, 3–7 October 2011, Atmos. Res., 123, 2–16,
https://doi.org/10.1016/j.atmosres.2012.04.004, 2013. a
Sun, J., Xue, M., Wilson, J. W., Zawadzki, I., Ballard, S. P.,
Onvlee-Hooimeyer, J., Joe, P., Barker, D. M., Li, P.-W., Golding, B., Xu, M.,
and Pinto, J.: Use of NWP for Nowcasting Convective Precipitation: Recent
Progress and Challenges, B. Am. Meteorol. Soc., 95,
409–426, https://doi.org/10.1175/BAMS-D-11-00263.1, 2014. a
Tomita, H.: New Microphysical Schemes with Five and Six Categories by
Diagnostic Generation of Cloud Ice, J. Meteorol. Soc.
Jpn. Ser. II, 86A, 121–142, https://doi.org/10.2151/jmsj.86A.121, 2008. a
Whitaker, J. S. and Hamill, T. M.: Evaluating Methods to Account for System
Errors in Ensemble Data Assimilation, Mon. Weather Rev., 140,
3078–3089, https://doi.org/10.1175/MWR-D-11-00276.1, 2012.
a
Yoshikawa, E., Ushio, T., Kawasaki, Z., Yoshida, S., Morimoto, T.,
Mizutani, F., and Wada, M.: MMSE Beam Forming on Fast-Scanning Phased
Array Weather Radar, IEEE T. Geosci. Remote, 51,
3077–3088, https://doi.org/10.1109/TGRS.2012.2211607, 2013. a
Short summary
Effective use of observations with numerical weather prediction models, also known as data assimilation, is a key part of weather forecasting systems. For precise prediction at the scales of thunderstorms, fast nonlinear processes pose a grand challenge because most data assimilation systems are based on linear processes and normal distribution errors. We investigate how, every 30 s, weather radar observations can help reduce the effect of nonlinear processes and nonnormal distributions.
Effective use of observations with numerical weather prediction models, also known as data...
