Articles | Volume 26, issue 3
https://doi.org/10.5194/npg-26-143-2019
© Author(s) 2019. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/npg-26-143-2019
© Author(s) 2019. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Data assimilation as a learning tool to infer ordinary differential equation representations of dynamical models
CEREA, joint laboratory École des Ponts ParisTech and EDF R&D, Université Paris-Est, Champs-sur-Marne, France
Julien Brajard
Sorbonne University, CNRS-IRD-MNHN, LOCEAN, Paris, France
Nansen Environmental and Remote Sensing Center, Bergen, Norway
Alberto Carrassi
Nansen Environmental and Remote Sensing Center, Bergen, Norway
Geophysical Institute, University of Bergen, Bergen, Norway
Laurent Bertino
Nansen Environmental and Remote Sensing Center, Bergen, Norway
Viewed
Total article views: 5,594 (including HTML, PDF, and XML)
Cumulative views and downloads
(calculated since 28 Feb 2019)
HTML | XML | Total | BibTeX | EndNote | |
---|---|---|---|---|---|
3,342 | 2,153 | 99 | 5,594 | 118 | 113 |
- HTML: 3,342
- PDF: 2,153
- XML: 99
- Total: 5,594
- BibTeX: 118
- EndNote: 113
Total article views: 4,215 (including HTML, PDF, and XML)
Cumulative views and downloads
(calculated since 10 Jul 2019)
HTML | XML | Total | BibTeX | EndNote | |
---|---|---|---|---|---|
2,684 | 1,443 | 88 | 4,215 | 95 | 95 |
- HTML: 2,684
- PDF: 1,443
- XML: 88
- Total: 4,215
- BibTeX: 95
- EndNote: 95
Total article views: 1,379 (including HTML, PDF, and XML)
Cumulative views and downloads
(calculated since 28 Feb 2019)
HTML | XML | Total | BibTeX | EndNote | |
---|---|---|---|---|---|
658 | 710 | 11 | 1,379 | 23 | 18 |
- HTML: 658
- PDF: 710
- XML: 11
- Total: 1,379
- BibTeX: 23
- EndNote: 18
Viewed (geographical distribution)
Total article views: 5,594 (including HTML, PDF, and XML)
Thereof 4,802 with geography defined
and 792 with unknown origin.
Total article views: 4,215 (including HTML, PDF, and XML)
Thereof 3,705 with geography defined
and 510 with unknown origin.
Total article views: 1,379 (including HTML, PDF, and XML)
Thereof 1,097 with geography defined
and 282 with unknown origin.
Country | # | Views | % |
---|
Country | # | Views | % |
---|
Country | # | Views | % |
---|
Total: | 0 |
HTML: | 0 |
PDF: | 0 |
XML: | 0 |
- 1
1
Total: | 0 |
HTML: | 0 |
PDF: | 0 |
XML: | 0 |
- 1
1
Total: | 0 |
HTML: | 0 |
PDF: | 0 |
XML: | 0 |
- 1
1
Cited
53 citations as recorded by crossref.
- Deep Emulators for Differentiation, Forecasting, and Parametrization in Earth Science Simulators M. Nonnenmacher & D. Greenberg 10.1029/2021MS002554
- A comprehensive review of Gaussian atmospheric dispersion models: current usage and future perspectives H. Snoun et al. 10.1007/s41207-023-00354-6
- Combining data assimilation and machine learning to emulate a dynamical model from sparse and noisy observations: A case study with the Lorenz 96 model J. Brajard et al. 10.1016/j.jocs.2020.101171
- A comparison of combined data assimilation and machine learning methods for offline and online model error correction A. Farchi et al. 10.1016/j.jocs.2021.101468
- Simulating the land carbon sink: Progresses and challenges of terrestrial ecosystem models W. Yuan et al. 10.1016/j.agrformet.2024.110264
- Differential equation model of financial market stability based on big data L. Hao 10.2478/amns.2021.2.00146
- Bridging observations, theory and numerical simulation of the ocean using machine learning M. Sonnewald et al. 10.1088/1748-9326/ac0eb0
- Using machine learning to correct model error in data assimilation and forecast applications A. Farchi et al. 10.1002/qj.4116
- Model selection of chaotic systems from data with hidden variables using sparse data assimilation H. Ribera et al. 10.1063/5.0066066
- Application of machine learning (individual vs stacking) models on MERRA-2 data to predict surface PM2.5 concentrations over India A. Dhandapani et al. 10.1016/j.chemosphere.2023.139966
- A Deep Neural Network-Ensemble Adjustment Kalman Filter and Its Application on Strongly Coupled Data Assimilation R. Wang & Z. Shen 10.3390/jmse12010108
- Data-driven reconstruction of partially observed dynamical systems P. Tandeo et al. 10.5194/npg-30-129-2023
- Supervised learning from noisy observations: Combining machine-learning techniques with data assimilation G. Gottwald & S. Reich 10.1016/j.physd.2021.132911
- The future of Earth system prediction: Advances in model-data fusion A. Gettelman et al. 10.1126/sciadv.abn3488
- Data assimilation method for improving the global spatiotemporal predictions of epidemic dynamics yielded by an ensemble Kalman filter and Metropolis–Hastings sampling F. Liu et al. 10.1007/s11071-023-08632-2
- Coupling theK-nearest neighbors and locally weighted linear regression with ensemble Kalman filter for data-driven data assimilation M. Fan et al. 10.1515/geo-2020-0312
- Bounded nonlinear forecasts of partially observed geophysical systems with physics-constrained deep learning S. Ouala et al. 10.1016/j.physd.2022.133630
- Deep learning subgrid-scale parametrisations for short-term forecasting of sea-ice dynamics with a Maxwell elasto-brittle rheology T. Finn et al. 10.5194/tc-17-2965-2023
- Law of interest rate changes in financial markets based on the differential equation model of liquidity P. Wan & A. Arbad 10.2478/amns.2021.1.00106
- Artificial Intelligence and Its Application in Numerical Weather Prediction S. Soldatenko 10.3103/S1068373924040010
- Synchronization to Big Data: Nudging the Navier-Stokes Equations for Data Assimilation of Turbulent Flows P. Clark Di Leoni et al. 10.1103/PhysRevX.10.011023
- Super-resolution data assimilation S. Barthélémy et al. 10.1007/s10236-022-01523-x
- Combining data assimilation and machine learning to build data‐driven models for unknown long time dynamics—Applications in cardiovascular modeling F. Regazzoni et al. 10.1002/cnm.3471
- A Four‐Dimensional Variational Constrained Neural Network‐Based Data Assimilation Method W. Wang et al. 10.1029/2023MS003687
- ISANet: Deep Neural Network Approximating Image Sequence Assimilation for Tracking Fluid Flows L. Li & J. Ma 10.1109/TGRS.2023.3334612
- Inferring turbulent environments via machine learning M. Buzzicotti & F. Bonaccorso 10.1140/epje/s10189-022-00258-3
- Hourly and Daily PM2.5 Estimations Using MERRA‐2: A Machine Learning Approach A. Sayeed et al. 10.1029/2022EA002375
- Combining a Fully Connected Neural Network With an Ensemble Kalman Filter to Emulate a Dynamic Model in Data Assimilation M. Fan et al. 10.1109/ACCESS.2021.3120482
- A Physics‐Aware Machine Learning‐Based Framework for Minimizing Prediction Uncertainty of Hydrological Models A. Roy et al. 10.1029/2023WR034630
- On‐line machine‐learning forecast uncertainty estimation for sequential data assimilation M. Sacco et al. 10.1002/qj.4743
- Learning latent dynamics for partially observed chaotic systems S. Ouala et al. 10.1063/5.0019309
- Combining machine learning and data assimilation to forecast dynamical systems from noisy partial observations G. Gottwald & S. Reich 10.1063/5.0066080
- Statistical Post-Processing for Gridded Temperature Prediction Using Encoder–Decoder-Based Deep Convolutional Neural Networks A. KUDO 10.2151/jmsj.2022-011
- Online Model Error Correction With Neural Networks in the Incremental 4D‐Var Framework A. Farchi et al. 10.1029/2022MS003474
- Data Assimilation Networks P. Boudier et al. 10.1029/2022MS003353
- Learning about structural errors in models of complex dynamical systems J. Wu et al. 10.1016/j.jcp.2024.113157
- CNN-based model for the spatial imputation (CMSI version 1.0) of in-situ ozone and PM2.5 measurements A. Sayeed et al. 10.1016/j.atmosenv.2022.119348
- Using data assimilation to train a hybrid forecast system that combines machine-learning and knowledge-based components A. Wikner et al. 10.1063/5.0048050
- Autodifferentiable Ensemble Kalman Filters Y. Chen et al. 10.1137/21M1434477
- Online learning of both state and dynamics using ensemble Kalman filters M. Bocquet et al. 10.3934/fods.2020015
- Discovery of interpretable structural model errors by combining Bayesian sparse regression and data assimilation: A chaotic Kuramoto–Sivashinsky test case R. Mojgani et al. 10.1063/5.0091282
- Coupled online learning as a way to tackle instabilities and biases in neural network parameterizations: general algorithms and Lorenz 96 case study (v1.0) S. Rasp 10.5194/gmd-13-2185-2020
- Combining ensemble Kalman filter and reservoir computing to predict spatiotemporal chaotic systems from imperfect observations and models F. Tomizawa & Y. Sawada 10.5194/gmd-14-5623-2021
- Surrogate modeling for the climate sciences dynamics with machine learning and data assimilation M. Bocquet 10.3389/fams.2023.1133226
- CLIMFILL v0.9: a framework for intelligently gap filling Earth observations V. Bessenbacher et al. 10.5194/gmd-15-4569-2022
- SPLNet: A sequence-to-one learning network with time-variant structure for regional wind speed prediction R. Ye et al. 10.1016/j.ins.2022.07.002
- A Novel Physics‐Aware Machine Learning‐Based Dynamic Error Correction Model for Improving Streamflow Forecast Accuracy A. Roy et al. 10.1029/2022WR033318
- Long short-term memory embedded nudging schemes for nonlinear data assimilation of geophysical flows S. Pawar et al. 10.1063/5.0012853
- A machine‐learning and data assimilation forecasting framework for surface waves P. Pokhrel et al. 10.1002/qj.4631
- Learning earth system models from observations: machine learning or data assimilation? A. Geer 10.1098/rsta.2020.0089
- Accurate deep learning-based filtering for chaotic dynamics by identifying instabilities without an ensemble M. Bocquet et al. 10.1063/5.0230837
- Combining data assimilation and machine learning to infer unresolved scale parametrization J. Brajard et al. 10.1098/rsta.2020.0086
- Law of interest rate changes in financial markets based on the differential equation model of liquidity P. Wan & A. Hamad Arbad 10.2478/amns.2021.1.00081
53 citations as recorded by crossref.
- Deep Emulators for Differentiation, Forecasting, and Parametrization in Earth Science Simulators M. Nonnenmacher & D. Greenberg 10.1029/2021MS002554
- A comprehensive review of Gaussian atmospheric dispersion models: current usage and future perspectives H. Snoun et al. 10.1007/s41207-023-00354-6
- Combining data assimilation and machine learning to emulate a dynamical model from sparse and noisy observations: A case study with the Lorenz 96 model J. Brajard et al. 10.1016/j.jocs.2020.101171
- A comparison of combined data assimilation and machine learning methods for offline and online model error correction A. Farchi et al. 10.1016/j.jocs.2021.101468
- Simulating the land carbon sink: Progresses and challenges of terrestrial ecosystem models W. Yuan et al. 10.1016/j.agrformet.2024.110264
- Differential equation model of financial market stability based on big data L. Hao 10.2478/amns.2021.2.00146
- Bridging observations, theory and numerical simulation of the ocean using machine learning M. Sonnewald et al. 10.1088/1748-9326/ac0eb0
- Using machine learning to correct model error in data assimilation and forecast applications A. Farchi et al. 10.1002/qj.4116
- Model selection of chaotic systems from data with hidden variables using sparse data assimilation H. Ribera et al. 10.1063/5.0066066
- Application of machine learning (individual vs stacking) models on MERRA-2 data to predict surface PM2.5 concentrations over India A. Dhandapani et al. 10.1016/j.chemosphere.2023.139966
- A Deep Neural Network-Ensemble Adjustment Kalman Filter and Its Application on Strongly Coupled Data Assimilation R. Wang & Z. Shen 10.3390/jmse12010108
- Data-driven reconstruction of partially observed dynamical systems P. Tandeo et al. 10.5194/npg-30-129-2023
- Supervised learning from noisy observations: Combining machine-learning techniques with data assimilation G. Gottwald & S. Reich 10.1016/j.physd.2021.132911
- The future of Earth system prediction: Advances in model-data fusion A. Gettelman et al. 10.1126/sciadv.abn3488
- Data assimilation method for improving the global spatiotemporal predictions of epidemic dynamics yielded by an ensemble Kalman filter and Metropolis–Hastings sampling F. Liu et al. 10.1007/s11071-023-08632-2
- Coupling theK-nearest neighbors and locally weighted linear regression with ensemble Kalman filter for data-driven data assimilation M. Fan et al. 10.1515/geo-2020-0312
- Bounded nonlinear forecasts of partially observed geophysical systems with physics-constrained deep learning S. Ouala et al. 10.1016/j.physd.2022.133630
- Deep learning subgrid-scale parametrisations for short-term forecasting of sea-ice dynamics with a Maxwell elasto-brittle rheology T. Finn et al. 10.5194/tc-17-2965-2023
- Law of interest rate changes in financial markets based on the differential equation model of liquidity P. Wan & A. Arbad 10.2478/amns.2021.1.00106
- Artificial Intelligence and Its Application in Numerical Weather Prediction S. Soldatenko 10.3103/S1068373924040010
- Synchronization to Big Data: Nudging the Navier-Stokes Equations for Data Assimilation of Turbulent Flows P. Clark Di Leoni et al. 10.1103/PhysRevX.10.011023
- Super-resolution data assimilation S. Barthélémy et al. 10.1007/s10236-022-01523-x
- Combining data assimilation and machine learning to build data‐driven models for unknown long time dynamics—Applications in cardiovascular modeling F. Regazzoni et al. 10.1002/cnm.3471
- A Four‐Dimensional Variational Constrained Neural Network‐Based Data Assimilation Method W. Wang et al. 10.1029/2023MS003687
- ISANet: Deep Neural Network Approximating Image Sequence Assimilation for Tracking Fluid Flows L. Li & J. Ma 10.1109/TGRS.2023.3334612
- Inferring turbulent environments via machine learning M. Buzzicotti & F. Bonaccorso 10.1140/epje/s10189-022-00258-3
- Hourly and Daily PM2.5 Estimations Using MERRA‐2: A Machine Learning Approach A. Sayeed et al. 10.1029/2022EA002375
- Combining a Fully Connected Neural Network With an Ensemble Kalman Filter to Emulate a Dynamic Model in Data Assimilation M. Fan et al. 10.1109/ACCESS.2021.3120482
- A Physics‐Aware Machine Learning‐Based Framework for Minimizing Prediction Uncertainty of Hydrological Models A. Roy et al. 10.1029/2023WR034630
- On‐line machine‐learning forecast uncertainty estimation for sequential data assimilation M. Sacco et al. 10.1002/qj.4743
- Learning latent dynamics for partially observed chaotic systems S. Ouala et al. 10.1063/5.0019309
- Combining machine learning and data assimilation to forecast dynamical systems from noisy partial observations G. Gottwald & S. Reich 10.1063/5.0066080
- Statistical Post-Processing for Gridded Temperature Prediction Using Encoder–Decoder-Based Deep Convolutional Neural Networks A. KUDO 10.2151/jmsj.2022-011
- Online Model Error Correction With Neural Networks in the Incremental 4D‐Var Framework A. Farchi et al. 10.1029/2022MS003474
- Data Assimilation Networks P. Boudier et al. 10.1029/2022MS003353
- Learning about structural errors in models of complex dynamical systems J. Wu et al. 10.1016/j.jcp.2024.113157
- CNN-based model for the spatial imputation (CMSI version 1.0) of in-situ ozone and PM2.5 measurements A. Sayeed et al. 10.1016/j.atmosenv.2022.119348
- Using data assimilation to train a hybrid forecast system that combines machine-learning and knowledge-based components A. Wikner et al. 10.1063/5.0048050
- Autodifferentiable Ensemble Kalman Filters Y. Chen et al. 10.1137/21M1434477
- Online learning of both state and dynamics using ensemble Kalman filters M. Bocquet et al. 10.3934/fods.2020015
- Discovery of interpretable structural model errors by combining Bayesian sparse regression and data assimilation: A chaotic Kuramoto–Sivashinsky test case R. Mojgani et al. 10.1063/5.0091282
- Coupled online learning as a way to tackle instabilities and biases in neural network parameterizations: general algorithms and Lorenz 96 case study (v1.0) S. Rasp 10.5194/gmd-13-2185-2020
- Combining ensemble Kalman filter and reservoir computing to predict spatiotemporal chaotic systems from imperfect observations and models F. Tomizawa & Y. Sawada 10.5194/gmd-14-5623-2021
- Surrogate modeling for the climate sciences dynamics with machine learning and data assimilation M. Bocquet 10.3389/fams.2023.1133226
- CLIMFILL v0.9: a framework for intelligently gap filling Earth observations V. Bessenbacher et al. 10.5194/gmd-15-4569-2022
- SPLNet: A sequence-to-one learning network with time-variant structure for regional wind speed prediction R. Ye et al. 10.1016/j.ins.2022.07.002
- A Novel Physics‐Aware Machine Learning‐Based Dynamic Error Correction Model for Improving Streamflow Forecast Accuracy A. Roy et al. 10.1029/2022WR033318
- Long short-term memory embedded nudging schemes for nonlinear data assimilation of geophysical flows S. Pawar et al. 10.1063/5.0012853
- A machine‐learning and data assimilation forecasting framework for surface waves P. Pokhrel et al. 10.1002/qj.4631
- Learning earth system models from observations: machine learning or data assimilation? A. Geer 10.1098/rsta.2020.0089
- Accurate deep learning-based filtering for chaotic dynamics by identifying instabilities without an ensemble M. Bocquet et al. 10.1063/5.0230837
- Combining data assimilation and machine learning to infer unresolved scale parametrization J. Brajard et al. 10.1098/rsta.2020.0086
- Law of interest rate changes in financial markets based on the differential equation model of liquidity P. Wan & A. Hamad Arbad 10.2478/amns.2021.1.00081
Latest update: 20 Nov 2024
Short summary
This paper describes an innovative way to use data assimilation to infer the dynamics of a physical system from its observation only. The method can operate with noisy and partial observation of the physical system. It acts as a deep learning technique specialised to dynamical models without the need for machine learning tools. The method is successfully tested on chaotic dynamical systems: the Lorenz-63, Lorenz-96, and Kuramoto–Sivashinski models and a two-scale Lorenz model.
This paper describes an innovative way to use data assimilation to infer the dynamics of a...