**Research article**
14 Jan 2021

**Research article** | 14 Jan 2021

# A methodology to obtain model-error covariances due to the discretization scheme from the parametric Kalman filter perspective

Olivier Pannekoucke Richard Ménard Mohammad El Aabaribaoune and Matthieu Plu

^{1,2,3},

^{4},

^{2,3},

^{2}

**Olivier Pannekoucke et al.**Olivier Pannekoucke Richard Ménard Mohammad El Aabaribaoune and Matthieu Plu

^{1,2,3},

^{4},

^{2,3},

^{2}

^{1}INPT-ENM, Toulouse, France^{2}CNRM, Université de Toulouse, Météo-France, CNRS, Toulouse, France^{3}CERFACS, Toulouse, France^{4}ARQI/Air Quality Research Division, Environment and Climate Change Canada, Dorval, Québec, Canada

^{1}INPT-ENM, Toulouse, France^{2}CNRM, Université de Toulouse, Météo-France, CNRS, Toulouse, France^{3}CERFACS, Toulouse, France^{4}ARQI/Air Quality Research Division, Environment and Climate Change Canada, Dorval, Québec, Canada

**Correspondence**: Olivier Pannekoucke (olivier.pannekoucke@meteo.fr)

**Correspondence**: Olivier Pannekoucke (olivier.pannekoucke@meteo.fr)

Received: 27 Apr 2020 – Discussion started: 08 May 2020 – Revised: 11 Nov 2020 – Accepted: 19 Nov 2020 – Published: 14 Jan 2021

This contribution addresses the characterization of the model-error covariance matrix from the new theoretical perspective provided by the parametric Kalman filter method which approximates the covariance dynamics from the parametric evolution of a covariance model. The classical approach to obtain the modified equation of a dynamics is revisited to formulate a parametric modelling of the model-error covariance matrix which applies when the numerical model is dissipative compared with the true dynamics. As an illustration, the particular case of the advection equation is considered as a simple test bed. After the theoretical derivation of the predictability-error covariance matrices of both the nature and the numerical model, a numerical simulation is proposed which illustrates the properties of the resulting model-error covariance matrix.

A significant portion of the work being carried out in state-of-the-art data assimilation concerns the treatment of the forecast-error covariance matrix. Actually, the forecast error is composed of two parts. While one part of it is related to the uncertainty in the initial condition, another part is due to the model error (Daley, 1991; Dee, 1995). The model error corresponds to the difference between the simulation and the true behaviour of a system, and several representations of the model error can be introduced in numerical weather prediction (NWP) (Houtekamer et al., 2009). For instance, the model error can be related to the misrepresentation of the small scales and how this influences the large scales. Stochastic physics such as stochastic kinetic energy backscatter (Shutts, 2005) or the stochastically perturbed parametrization tendencies (Palmer et al., 2009) are examples of methods encountered in NWP for this part of the model error.

Although some theoretical studies have been conducted in the past, which elucidate the generic behaviour related to the model error from the dynamical system perspective and in connection with the data assimilation (e.g. Nicolis, 2003; Vannitsem and Toth, 2002; Carrassi and Vannitsem, 2010), as far as we know there has been little investigation of the effect of the discretization of partial derivative equations on the model error and on model-error covariance in particular (Dubinkina, 2018; Hatfield et al., 2018; Grudzien et al., 2020). One reason why the effect of numerical schemes is rarely considered is because it tends to be quite difficult to describe the dynamics of large covariance matrices as encountered in the Kalman filter.

It has been noted in Kalman filtering and ensemble Kalman filtering (EnKF) that the propagation of error covariance with a discretized advection model produces a model error (variance) in the form of a variance loss (Ménard et al., 2000, 2020). This error is related to the spatial splitting error in covariance propagation that exists with discretized models and not in continuous propagation of covariance functions, i.e. the propagation by the true equations of the dynamics.

Recently, Pannekoucke et al. (2016, 2018b) (P16) have proposed to solve the Kalman filter equations, and their second-order extension for non-linear dynamics, using approximated covariance matrices through a covariance model characterized by certain parameters, leading to the so-called “parametric Kalman filter” (PKF). With this approximation, the dynamics of the covariances is replaced by the dynamics of the parameters. For instance, when considering the class of covariance matrices parameterized by the variance field and the local anisotropic tensors (VLATcov), the evolution of the matrices is deduced from the evolution of the variance and the local anisotropic tensors (Cohn, 1993; Pannekoucke, 2020). This approach relies on the partial differential equations encountered in geosciences that are often non-linear.

The aims of the present work are to study how the parametric dynamics for covariance matrix evolution can help to characterize the model-error covariance matrix, and more precisely, to determine if is it possible to capture some part of the model-error covariance which is due to the numerical scheme. In this methodological contribution, we will limit ourselves to diffusive numerical errors whose uncertainty dynamics can be explored from the results of Pannekoucke et al. (2018a) (P18).

The paper is organized as follows: the background in data assimilation is reviewed in Sect. 2 from which the formalism of the model-error covariance matrix is detailed with the introduction of modelling that could apply when the numerical model is dissipative. The model-error covariance matrix based on the PKF is illustrated for the particular one-dimensional transport equation in Sect. 3 in the context of the Euler-upwind and semi-Lagrangian schemes. A numerical test bed is proposed in Sect. 4 to assess the ability of the PKF approach to successfully model the flow-dependent part of the model-error covariance matrix to numerical schemes in a one-dimensional setting. A discussion on the results is proposed in Sect. 5. Conclusions and perspectives are given in Sect. 6.

## 2.1 Background in uncertainty propagation and the model error

Here, we assume that the *nature* is governed by
the deterministic equation

where 𝒳 stands for the state. Note that 𝒳 can be
either discrete or continuous: the discrete case leads to matrix of algebraic relations,
while the continuous case is suitable for theoretical treatment with partial
differential equations.
Thereafter, for any state 𝒳 of a suitable set, there exists a single
trajectory ${\mathcal{X}}_{t}={\mathcal{N}}_{t\leftarrow \mathrm{0}}\left(\mathcal{X}\right)$, where 𝒩_{t←0}
stands for the propagator of the dynamics (Eq. 1) from 0 to *t*.
Hence, if ${\mathcal{X}}_{q}^{\mathrm{t}}$ denotes the true state of the nature at time *t*_{q}, then
the true state of the nature at time *t*_{q+1} is

where the subscript *q* is used to denote the time *t*_{q}.

Due to the imperfect knowledge of the nature and the limitations encountered during the computation, the nature dynamics is only approximated by

where ℳ is the numerical dynamics. Compared with the nature, the time evolution of the true state (Eq. 2) is now related to the numerical dynamics as

where ${\mathit{\epsilon}}_{q+\mathrm{1}}^{\mathrm{m}}\left({\mathcal{X}}_{q}^{\mathrm{t}}\right)$ is the *model error* with respect to the
true state, and where ${\mathit{\epsilon}}_{q+\mathrm{1}}^{\mathrm{m}}$ is the vector-valued function defined by

The model error ${\mathit{\epsilon}}_{q+\mathrm{1}}^{\mathrm{m}}\left({\mathcal{X}}_{q}^{\mathrm{t}}\right)$ represents collectively the numerical discretization error and the effect of unresolved processes. It is often modelled as a random field of zero mean, i.e. $\mathbb{E}\left[{\mathit{\epsilon}}_{q+\mathrm{1}}^{\mathrm{m}}\left({\mathcal{X}}_{q}^{\mathrm{t}}\right)\right]=\mathrm{0}$, and of covariance matrix

where 𝔼[⋅] denotes the expectation operator.

In practice, the true state ${\mathcal{X}}_{q}^{\mathrm{t}}$ is unknown and only an estimation can be
deduced from a priori information and the available observations.
This estimation is called the “analysis state”,
𝒳^{a}, and it is expanded as

where ${\mathit{\epsilon}}_{q}^{\mathrm{a}}$ stands for the so-called “analysis error” that is modelled as a random field of zero mean and covariance matrix ${\mathbf{P}}^{a}=\mathbb{E}\left[{\mathit{\epsilon}}_{q}^{\mathrm{a}}({\mathit{\epsilon}}_{q}^{\mathrm{a}}{)}^{T}\right]$. The forecast state is the prediction made from the analysis state,

Similarly to the analysis state, the forecast state expands as

where ${\mathit{\epsilon}}_{q+\mathrm{1}}^{\mathrm{f}}$ stands for the so-called “forecast error” that is modelled as a random field of zero mean and covariance matrix ${\mathbf{P}}^{\mathrm{f}}=\mathbb{E}\left[{\mathit{\epsilon}}_{q+\mathrm{1}}^{\mathrm{f}}({\mathit{\epsilon}}_{q+\mathrm{1}}^{\mathrm{f}}{)}^{T}\right]$.

The forecast-error covariance matrix is related to the analysis-error covariance matrix through a deterministic relation as follows. From the definition of the forecast error (Eq. 9), its dynamics is given by (see Eq. A2 in Appendix A)

where **M** is a simplified notation for ${\mathbf{M}}_{{t}_{q+\mathrm{1}}\leftarrow {t}_{q},{\mathcal{X}}_{q}^{\mathrm{a}}}$ that
is for the tangent linear (TL) propagator along the analysis trajectory.
The TL dynamics, with respect to the analysis state, is defined by

where ${\mathbf{M}}_{t,{\mathcal{X}}_{t}^{\mathrm{a}}}=d{\mathcal{M}}_{|t,{\mathcal{X}}_{t}^{\mathrm{a}}}$ is the differential of
ℳ at $(t,{\mathcal{X}}_{t}^{\mathrm{a}})$. This TL model governs the evolution of small
perturbations along the forecast trajectory starting from the analysis state.
Note that the validity of the TL dynamics depends on the error magnitude
and on the forecast range.
Moreover, the decomposition of the forecast error (Eq. 10) makes the
predictability error *ε*^{p} appear defined by

Consequently, the forecast-error covariance matrix becomes

where

is the predictability-error covariance matrix (Daley, 1992) and ${\mathbf{V}}_{q+\mathrm{1}}^{\mathrm{pm}}=\mathbb{E}\left[{\mathit{\epsilon}}_{q+\mathrm{1}}^{\mathrm{p}}{\left({\mathit{\epsilon}}_{q+\mathrm{1}}^{\mathrm{m}}\left({\mathcal{X}}_{q}^{t}\right)\right)}^{T}\right]$ denotes the cross-covariance matrix between the predictability error and the model error.

When the analysis error and the model error are decorrelated, the forecast-error covariance matrix is written as

Note that, in the case where the true nature is used to forecast the uncertainty, the forecast-error covariance matrix coincides with the predictability-error covariance matrix. In the latter, the predictability error with respect to the nature dynamics plays an important role. So in order to avoid any confusion with the predictability error associated with the numerical model, the notation $\stackrel{\mathrm{\u0303}}{\cdot}$ is used when the dynamics is the nature, i.e.

with ${\stackrel{\mathrm{\u0303}}{\mathbf{P}}}^{\mathrm{f}}=\mathbb{E}\left[{\stackrel{\mathrm{\u0303}}{\mathit{\epsilon}}}^{\mathrm{f}}{\left({\stackrel{\mathrm{\u0303}}{\mathit{\epsilon}}}^{\mathrm{f}}\right)}^{T}\right]$,
where ${\stackrel{\mathrm{\u0303}}{\mathit{\epsilon}}}_{q+\mathrm{1}}^{\mathrm{f}}=\mathbf{N}{\mathit{\epsilon}}_{q}^{\mathrm{a}}$
denotes the forecast error in the particular case where the dynamics is the nature, which coincide
with the predictability error in this case, i.e. ${\stackrel{\mathrm{\u0303}}{\mathit{\epsilon}}}_{q+\mathrm{1}}^{\mathrm{f}}={\stackrel{\mathrm{\u0303}}{\mathit{\epsilon}}}_{q+\mathrm{1}}^{\mathrm{p}}$;
and where
**N** is a simplified notation for the propagator ${\mathbf{N}}_{{t}_{q+\mathrm{1}}\leftarrow {t}_{q},{\mathcal{X}}_{q}^{\mathrm{a}}}$
solution of the TL dynamics governed by
${\mathbf{N}}_{t,{\mathcal{X}}_{t}^{\mathrm{a}}}=d{\mathcal{N}}_{|t,{\mathcal{X}}_{t}^{\mathrm{a}}}$ (the differential of
𝒩 at $(t,{\mathcal{X}}_{t}^{\mathrm{a}})$).

## 2.2 Discussion on the modelling of the model error

The modelling of the model error can be seen as a trade-off between its real properties and the lack of knowledge to address this error. In particular, the various assumptions encountered in data assimilation may be considered as suboptimal ways to model this error. For instance, assuming that the model error is unbiased leads to modelling the bias as some variance and overestimates the effective model-error variance. Then, assuming a decorrelation between the analysis and the model errors is certainly wrong for deterministic error, as for the model error due to the discretization of the dynamics, but it may not apply for highly non-linear processes as for the turbulent processes and transport by the turbulent processes. Again, assuming the decorrelation between the analysis and the model errors leads to overestimating the true effect of the model error with an overestimation of the true forecast-error uncertainty. However, with these assumptions, or actually this modelling, some part of the model-error statistics can be estimated from the data. For instance, with the assumption that the analysis and the model errors are decorrelated, leading to Eq. (15), it is possible to estimate the homogeneous correlation and the stationary part of the climatological model-error covariance (Daley, 1992; Boisserie et al., 2013).

By some aspects, the understanding and the specification of the model-error covariance matrix look like the development of the background-error covariance matrix some decades ago. Indeed, in variational data assimilation, the background-error covariance matrix was a constant matrix, estimated from the climatology (Derber and Bouttier, 1999). Then, the ensemble methods provided an estimation of the predictability error statistics of the day, leading to a flow-dependent background-error covariance matrix (see, e.g. Berre et al., 2007). Nonetheless, the situation of the model-error covariance matrix is different since, up to now, no equations have been known to characterize its properties. It seems that the prospect of estimating the model-error covariance matrix of the day is out of reach.

Because the model error can mean different things, to understand the context in which we are using model error, let us consider the situation sketched in Fig. 1. This figure mimics the evolution of the analysis uncertainty with respect to the nature and the numerical model. The initial Gaussian analysis error is characterized by the analysis state (the black point) and the analysis-error covariance matrix (the black ellipse). Under the TL assumption, the analysis uncertainty evolving by the nature dynamics (blue arrow) is a Gaussian of mean and covariance given, respectively, by the analysis forecasted by the nature (blue point) and by the predictability-error covariance matrix represented by the blue ellipse. Note that in this case, the predictability-error covariance matrix coincides with the forecast-error covariance matrix. Similarly, the analysis evolving by the numerical model (red arrow) is a Gaussian of mean and covariance given, respectively, by the analysis forecasted by the model (red point) and by the predictability-error covariance matrix represented by the red ellipse. The evolution of the true state (pink crosses) is also represented (pink arrow). Figure 1a and b illustrate what would be the forecast-error covariance matrix (orange ellipse) in two situations.

Figure 1a represents the case where the forecast state ${\mathcal{X}}_{q+\mathrm{1}}^{\mathrm{f}}$ is out of the predictability uncertainty of the nature: in that case, a model-error estimate is needed to enlarge the predictability-error covariance of the numerical model so that the forecast-error covariance is large enough to account for the uncertainty of the nature. In this situation, it seems difficult to speculate about what would be the characteristic of the model error beyond any climatological estimate. This situation could be the typical picture for a long-term forecast.

Figure 1b represents the situation where the time integration is not too long, so the forecast state lies within the predictability uncertainty of the nature. This situation is encountered when the numerical model is more dissipative than the nature, e.g. the resolution of an advection by a semi-Lagrangian scheme. Then the model-error uncertainty, required to correct the predictability error of the numerical model, should be at least large enough to provide an uncertainty similar to the predictability-error covariance of the nature. So if we are able to quantify the predictability-error covariances of the nature and of the numerical model, then it would be able to specify a flow-dependent part of the model-error covariance matrix. To account for the bias, a climatological residual covariance matrix would be necessary, which corresponds to a static matrix which depends on the duration of the forecast. Note that this decomposition of the model-error covariance matrix into a flow-dependent and a static part should not be confused with the decomposition of the model error itself. In particular, the decomposition of the model-error covariance matrix does not mean that the part of the model error related to the bias is static; this not true, as the bias depends on the situation. However, the estimation of the bias needs the knowledge of the nature dynamics that is never known. Because the statistical contribution of the bias can only be known from a climatological study, this leads to a static matrix which is not flow dependent.

Thereafter, we consider the situation sketched in Fig. 1b, which suggests decomposing the forecast-error covariance matrix as

where

would account for the flow-dependent part of the model-error covariance matrix, while
the remaining **Q**_{q+1}, a residual model-error covariance, would account for the
bias and could be estimated from the climatology, e.g. by considering a chi-squared diagnostic
(Ménard et al., 2000).

Thus, ${\mathbf{\Pi}}_{q+\mathrm{1}}^{\mathrm{m}}={\stackrel{\mathrm{\u0303}}{\mathbf{P}}}_{q+\mathrm{1}}^{\mathrm{p}}-{\mathbf{P}}_{q+\mathrm{1}}^{\mathrm{p}}$ measures how the predictability-error covariance of the numerical model should be modified to find the one of the nature. We think that ${\mathbf{\Pi}}_{q+\mathrm{1}}^{\mathrm{m}}$ could be a useful proxy to characterize the flow-dependent part of model-error covariance matrix. Note that the matrix ${\mathbf{\Pi}}_{q+\mathrm{1}}^{\mathrm{m}}$ is symmetric but not necessarily positive. However, under the assumption depicted in Fig. 1b, we will assume that ${\mathbf{\Pi}}_{q+\mathrm{1}}^{\mathrm{m}}$ is positive. Note also that ${\mathbf{\Pi}}_{q+\mathrm{1}}^{\mathrm{m}}$ is different from the model-error covariance matrix ${\mathbf{P}}_{q+\mathrm{1}}^{\mathrm{m}}$: if there is no analysis uncertainty, then ${\mathbf{\Pi}}_{q+\mathrm{1}}^{\mathrm{m}}$ is zero.

The decomposition (Eq. 17) can be justified from the decomposition of the forecast error that can be written as (see Eq. A6 in Appendix A)

which makes the forecast error appear, ${\mathit{\epsilon}}_{q+\mathrm{1}}^{\mathrm{f}}$, as the predictability error of the nature, ${\stackrel{\mathrm{\u0303}}{\mathit{\epsilon}}}_{q+\mathrm{1}}^{\mathrm{p}}=\mathbf{N}{\mathit{\epsilon}}_{q}^{\mathrm{a}}$, plus a drift ${\mathit{\epsilon}}_{q+\mathrm{1}}^{\mathrm{m}}\left({\mathcal{X}}_{q}^{\mathrm{a}}\right)$. Note that, with the analysis state ${\mathcal{X}}_{q}^{\mathrm{a}}$ being known, the model error ${\mathit{\epsilon}}_{q+\mathrm{1}}^{\mathrm{m}}\left({\mathcal{X}}_{q}^{\mathrm{a}}\right)$ is easier to handle than ${\mathit{\epsilon}}_{q+\mathrm{1}}^{\mathrm{m}}\left({\mathcal{X}}_{q}^{\mathrm{t}}\right)$ in Eq. (10), which is defined with respect to the true state ${\mathcal{X}}_{q}^{\mathrm{t}}$ that is never known in practice. Now, when assuming that the errors in Eq. (19) are decorrelated and when the model error ${\mathit{\epsilon}}_{q+\mathrm{1}}^{\mathrm{m}}\left({\mathcal{X}}_{q}^{\mathrm{a}}\right)$ is unbiased ($\mathbb{E}\left[{\mathit{\epsilon}}_{q+\mathrm{1}}^{\mathrm{m}}\left({\mathcal{X}}_{q}^{\mathrm{a}}\right)\right]=\mathrm{0}$) and of covariance $\mathbb{E}\left[{\mathit{\epsilon}}_{q+\mathrm{1}}^{\mathrm{m}}\left({\mathcal{X}}_{q}^{\mathrm{a}}\right){\left({\mathit{\epsilon}}_{q+\mathrm{1}}^{\mathrm{m}}\left({\mathcal{X}}_{q}^{\mathrm{a}}\right)\right)}^{T}\right]={\mathbf{Q}}_{q+\mathrm{1}}$, it results that the forecast-error covariance matrix is also written as

Hence, the modelling of the model-error covariance as

allows us to connect the two formulations (Eqs. 15 and 20) of ${\mathbf{P}}_{q+\mathrm{1}}^{\mathrm{f}}$. In fact, while Eqs. (15) and (20) result from a decorrelation assumption of the errors in Eqs. (10) and (19), and because ${\mathbf{\Pi}}_{q+\mathrm{1}}^{\mathrm{m}}$ is not necessarily a covariance matrix, then expression of ${\mathbf{P}}_{q+\mathrm{1}}^{\mathrm{f}}$, proposed in Eq. (17), is more like that of Eq. (13), where there is no decorrelation assumption.

Compared with climatological modelling of the model-error covariance matrix, as usually
encountered in data assimilation, the model for **P**^{m} in Eq. (21)
is a state-dependent model of the model-error covariance.
Note also that, in Fig. 1b, assuming that there
is no bias, while there is one, leads us to interpret the bias as a residual model-error
whose magnitude can be estimated from the climatology.
Hence, **P**^{m} modelled by Eq. (21) is a hybrid model
that balances the model error of the day with the climatological effects of the model error.
In particular, if the initial state is perfectly known, then ${\mathbf{\Pi}}_{q+\mathrm{1}}^{\mathrm{m}}$
is zero, and the model error is characterized by the climatological
residual term **Q**_{q+1}: the source of this uncertainty corresponds to a forcing term
that appears in the dynamics of the model error
(see, e.g. Eq. 4 in Nicolis, 2003); this source term is not explored here
and its contribution is incorporated in **Q** whose magnitude depends on the forecast time.

Note that the modelling equation (Eq. 21) for **P**^{m}
is actually supported by at least one real experiment.
In the assimilation of a chemical tracer using a Kalman
filter, Ménard et al. (2000) and Ménard and Chang (2000) (M2000s)
have observed a loss of variance: the variance they
forecasted was lower than the theoretical variance that was transported by the flow for
the advection equation (Cohn, 1993).
Said differently, in their experiment, the predicability-error variance computed
from the numerical model was lower than the predicability-error variance of the nature they
considered, and M2000s related the loss of variance to the discretization of the continuous
dynamics.
This loss of variance is also encountered when considering an ensemble
forecast of the uncertainty, as later illustrated in
the numerical part (see Sect. 4.2.1) and also observed in 3-D domain simulations
(Ménard et al., 2020).
Accompanying the loss of variance, M2000s also observed that the correlation
length scale they predict was larger, due
to the same diffusive process that gives rise to the loss of variance.
To cope with the loss of variance, M2000s proposed
to correct the predictability-error variance (the diagonal of **P**^{p} in Eq. 14)
so that its magnitude is conserved, as it is supposed to be according to the theory.
This renormalization introduced an increase of correlation length that was
corrected by a Schur product of the new covariances with a homogeneous isotropic
correlation model whose length scale has been determined so that the total covariance
is conserved over time.

Indeed, M2000s introduced a modelling of the model-error covariance matrix similar to Eq. (21) introduced here, although they did not explicitly formalize it in this way: their objective was not to characterize the model-error covariance matrix but to correct the predictability-error covariance matrix that they considered erroneous from a theoretical point of view.

In particular, M2000s have observed that the
Kalman filter, with the corrected predictability-error covariance, required less residual
model error **Q** (see Ménard et al., 2000, Sect. 5)
and improved the analysis-error statistics
(see Ménard et al., 2000, Fig. 11): the flow-dependent modelling (Eq. 21)
of the model error is in better agreement with the real forecast uncertainty.

At a computational level, ${\mathbf{\Pi}}_{q+\mathrm{1}}^{\mathrm{m}}$ in Eq. (18) appears easier to obtain than the model-error covariance matrix ${\mathbf{P}}_{q+\mathrm{1}}^{\mathrm{m}}$, as defined by Eq. (6): the predictability-error covariance matrices of the model ${\mathbf{P}}_{q+\mathrm{1}}^{\mathrm{p}}$ (Eq. 14) and of the nature ${\stackrel{\mathrm{\u0303}}{\mathbf{P}}}_{q+\mathrm{1}}^{\mathrm{p}}$ (Eq. 16) are based only on the TL forecasts with respect to the known analysis state ${\mathcal{X}}_{q}^{\mathrm{a}}$, while the model error ${\mathit{\epsilon}}_{q+\mathrm{1}}^{\mathrm{m}}\left({\mathcal{X}}_{q}^{\mathrm{t}}\right)$ (Eq. 4) depends on the true state ${\mathcal{X}}_{q}^{\mathrm{t}}$ that is never known.

However, computing ${\stackrel{\mathrm{\u0303}}{\mathbf{P}}}_{q+\mathrm{1}}^{\mathrm{p}}$ and ${\mathbf{P}}_{q+\mathrm{1}}^{\mathrm{p}}$ remains a challenge. First of all, the nature dynamics 𝒩 is generally unknown; e.g. primitive equations are only an approximation of the geophysical fluid dynamics. Then, when the nature dynamics is (assumed) known, e.g. when it is given by partial differential equations (PDEs), there is often no analytical solution, which means that the problem must be solved numerically: as ℳ is precisely the numerical approximation of 𝒩, the only way to compute ${\stackrel{\mathrm{\u0303}}{\mathbf{P}}}_{q+\mathrm{1}}^{\mathrm{p}}$ is to introduce a high-order numerical approximation of the nature dynamics, $\widehat{\mathcal{N}}$, whose numerical error is much smaller than the one of ℳ. And finally, it remains to compute ${\stackrel{\mathrm{\u0303}}{\mathbf{P}}}_{q+\mathrm{1}}^{\mathrm{p}}$ and ${\mathbf{P}}_{q+\mathrm{1}}^{\mathrm{p}}$. But due to the large size of the numerical state encountered in practice, the direct computation of ${\stackrel{\mathrm{\u0303}}{\mathbf{P}}}_{q+\mathrm{1}}^{\mathrm{p}}\approx \widehat{\mathbf{N}}{\mathbf{P}}_{q}^{a}{\widehat{\mathbf{N}}}^{T}$ and ${\mathbf{P}}_{q+\mathrm{1}}^{\mathrm{p}}={\mathbf{MP}}_{q}^{a}{\mathbf{M}}^{T}$ is impossible, even on supercomputers, which are only able to handle a few numerical states at full resolution: it is the limitation that motivated the ensemble estimation to solve the Kalman filter equations (Evensen, 2009).

To overcome the above limitations, a high-order discretization $\widehat{\mathcal{N}}$ of 𝒩 will be introduced in the latter numerical simulation in place of 𝒩, e.g. in the ensemble estimation of the covariance matrix ${\stackrel{\mathrm{\u0303}}{\mathbf{P}}}_{q+\mathrm{1}}^{\mathrm{p}}\approx \widehat{\mathbf{N}}{\mathbf{P}}_{q}^{a}{\widehat{\mathbf{N}}}^{T}$ only used for the validation. But the computation of ${\stackrel{\mathrm{\u0303}}{\mathbf{P}}}_{q+\mathrm{1}}^{\mathrm{p}}={\mathbf{NP}}_{q}^{a}{\mathbf{N}}^{T}$ and ${\mathbf{P}}_{q+\mathrm{1}}^{\mathrm{p}}$ is investigated through an alternative to the ensemble estimation, as now introduced in the next section.

## 2.3 Parametric dynamics for VLATcov models

The parametric formulation provides a framework where a limited number of covariance parameters
(based on the continuous PDE) of the nature can be computed. The parametric formulation works
as follows.
If **P**(𝒫) denotes a covariance model characterized by
a set of parameters $\mathcal{P}=({p}_{i}{)}_{i\in I}$, there exists a set
${\mathcal{P}}_{t}^{\mathrm{f}}$ featuring the forecast-error covariance
matrix so that $\mathbf{P}\left({\mathcal{P}}_{t}^{\mathrm{f}}\right)\approx {\mathbf{P}}_{t}^{\mathrm{f}}$;
and there is a set 𝒫^{a} featuring the analysis-error covariance
matrix so that **P**(𝒫^{a})≈**P**^{a}.
In reverse, if the dynamics of the parameters ${\mathcal{P}}_{t}^{\mathrm{f}}$ is known,
then $\mathbf{P}\left({\mathcal{P}}_{t}^{\mathrm{f}}\right)$ approximates the dynamics of ${\mathbf{P}}_{t}^{\mathrm{f}}$ without
using the full matrix computation.
This approach constitutes the so-called parametric
Kalman filter (PKF) approximation, introduced by
Pannekoucke et al. (2016, 2018a) (P16, P18).

The family of covariance models parameterized by the variance field
and the local anisotropic tensors, the VLATcov models, are of particular
interest (Pannekoucke, 2020): their parameters are directly
related to the grid-point statistics of the error field *ε*.
When the error is modelled as an unbiased random differential field,
𝔼[ε]=0, the variance at a point **x** is written as

The anisotropy of the correlation function $\mathit{\rho}(\mathbf{x},\mathbf{y})=\frac{\mathrm{1}}{\sqrt{{V}_{\mathbf{x}}{V}_{\mathbf{y}}}}\mathbb{E}\left[\mathit{\epsilon}\left(\mathbf{x}\right)\mathit{\epsilon}\left(\mathbf{y}\right)\right]$ is defined, from the second-order expansion,

by the local metric tensor **g**(**x**).
An interesting result is that the metric tensor can be obtained from
the error as

(see, e.g. Pannekoucke, 2020, for details).
A VLATcov model is then a covariance model parameterized
by *V* and **g**, which is **P**(*V*,**g**).

For instance, the diffusion operator of Weaver and Courtier (2001)
is an example of a VLATcov model: the local anisotropic tensors
are related to the local diffusion tensors, *ν*, from

where the superscript ^{−1} denotes the matrix inverse operator
(Pannekoucke and Massart, 2008; Weaver and Mirouze, 2013).
Equation (25) holds under the local homogeneous assumption; that is,
when the spatial derivatives are negligible.

Following Pannekoucke et al. (2018a), the parametric dynamics of a VLATcov model is deduced from the dynamics of the errors from

where the expectation operator and the temporal
derivative commute, ${\partial}_{t}\mathbb{E}\left[\cdot \right]=\mathbb{E}\left[{\partial}_{t}\cdot \right]$, as
used in Eq. (26a).
Therefore, the dynamics of the VLATcov model is written
**P**(*V*_{t},**g**_{t}) or
**P**(*V*_{t},*ν*_{t}), which are equivalent.

Now, we apply the parametric covariance dynamics for model-error covariance estimation.

## 2.4 The model-error VLATcov approximation

From now, we will assume that **Π**^{m} is a covariance matrix
and that there is no residual model-error **Q** in order to focus on
**Π**^{m} alone, so that

leads to model the forecast-error covariance matrix as

With the notations of the previous paragraph, a set ${\mathcal{P}}_{t}^{\mathrm{p}}$ also exists for the predictability-error covariance matrix, leading to the approximation $\mathbf{P}\left({\mathcal{P}}_{t}^{\mathrm{p}}\right)\approx {\mathbf{P}}_{t}^{p}$.

If the dynamics of the parameters ${\mathcal{P}}_{t}^{\mathrm{p}}$ is known, then starting from the initial condition ${\mathcal{P}}_{\mathrm{0}}^{\mathrm{p}}={\mathcal{P}}^{\mathrm{a}}$ it is possible to approximately determine ${\mathbf{P}}_{t}^{p}$ without solving Eqs. (14) and (16) explicitly.

Hence, thanks to the parametric dynamics in the case where the nature is
known from its partial derivative equations, a new method to compute the
model-error covariance matrix can be proposed as follows.
By considering the TL dynamics for the numerical model and for the nature,
Eq. (26) provides a way to
compute both the predictability-error covariance matrices **P**^{p} (Eq. 14)
and ${\stackrel{\mathrm{\u0303}}{\mathbf{P}}}^{\mathrm{p}}$ (Eq. 16) from which
the model (Eq. 27) of **P**^{m} can be evaluated.
For the covariance model based on the diffusion equation, the model-error
variance diagnosed from Eq. (18) is the difference:

where ${\stackrel{\mathrm{\u0303}}{V}}^{\mathrm{p}}$ and *V*^{p} denote the predictability-error
variance fields of the nature and of the numerical model.
The field of the metric tensor of the model error is approximately given by

where ${\stackrel{\mathrm{\u0303}}{\mathbf{g}}}^{\mathrm{p}}$ and **g**^{p}, respectively, denote the predictability-error
metric tensor fields of the nature and of the numerical model
(see Appendix B for details).

In the next section, we apply the parametric model-error dynamics to a transport equation.

The transport equation of a passive scalar *c* by the wind *u*(*t*,*x*)
is written as

and takes the place of the nature dynamics (Eq. 1). Note that dynamics (Eq. 30) is linear, meaning that the tangent-linear dynamics is also given by Eq. (30). The advection equation has two aspects. The first side is given by the PDE (Eq. 30), which is referred to as the Euler point of view. The other side is the analytico-geometric perspective known as the method of characteristics (see, e.g. Boyd, 2001, Chap. 14) where the dynamics can be solved as a local system of ordinary differential equations, given by

Each system of Eq. (31) describes the evolution of the couple (*x*(*t*),*c*(*t*))
starting from an initial position *x*(0) where the scalar value is *c*(0,*x*(0)).
At the geometric level, Eq. (31) remains to compute the trajectory of
a mobile point of coordinate *x*(*t*), the characteristic curve,
solution of the dynamics (Eq. 31a)
and transporting the scalar *c* whose value *c*(*t*) coincides with the
field value *c*(*t*,*x*(*t*)). The transported value *c*(*t*) evolves following
Eq. (31b).
In the present situation, since the right-hand side of Eq. (31b) is null,
*c* is conserved along the curve. This second point of view is referred to
as the Lagrangian description for the transport.

Two discretization methods are interesting to study for the transport equation: the finite-difference approach and the semi-Lagrangian method resulting from the Lagrangian interpretation of Eq. (30).

The aim of this section is to detail the model-error covariance matrix for both schemes. This theoretical part is organized as follows. The error covariance parametric dynamics for the nature is first described considering the covariance model based on the diffusion equation; then both finite-difference and semi-Lagrangian schemes are introduced with their particular parametric dynamics.

## 3.1 PKF dynamics for the linear advection equation

To describe the time evolution of the predictability-error covariance matrix, Eq. (16), it is necessary to detail what is the TL dynamics for the linear transport, Eq. (30). Since this transport dynamics is linear, the error evolves according to the same dynamics, and the TL dynamics can be written as

The PKF approximation of the forecast-error covariance matrix relies on the dynamics of the variance and of the diffusion fields deduced from Eq. (26). The equation for the variance is computed from Eq. (26a) by replacing the trend by the TL dynamics (Eq. 32), so that

From ${\partial}_{x}({\stackrel{\mathrm{\u0303}}{\mathit{\epsilon}}}^{\mathrm{p}}{)}^{\mathrm{2}}=\mathrm{2}{\stackrel{\mathrm{\u0303}}{\mathit{\epsilon}}}^{\mathrm{p}}{\partial}_{x}{\stackrel{\mathrm{\u0303}}{\mathit{\epsilon}}}^{\mathrm{p}}$ and by the commutativity between the expectation operator and the spatial derivative, the variance dynamics becomes

By using the definition of the variance (Eq. 22), it results that the dynamics for the variance can be stated as

The computation of the metric dynamics (Eq. 26b) is similar to the above computation made for the variance dynamics and is detailed in P16 and P18, where the interested reader is referred. It results that the PKF evolution for the nature is written as

Note that a similar system has been first obtained, in data assimilation, by Cohn (1993) (see their Eqs. 4.30a and 4.34 when written without stochastic model error).

From Eq. (36), it results that the variance and the diffusion are
independent quantities. The variance is conserved while it is transported by the wind.
The diffusion is not only transported, but it is also modified by the source
term $\left(\mathrm{2}{\partial}_{x}u\right){\stackrel{\mathrm{\u0303}}{\mathit{\nu}}}^{\mathrm{p}}$ which results from the deformation of correlations
by the gradient of the flow *u*: the diffusion tensor is not
conserved by the flow.

Hence, in this subsection, the predicability-error covariance for the nature (Eq. 16) has been computed for the linear transport (Eq. 30) and corresponds to the time integration of the uncoupled system of Eq. (36) starting from prescribed analysis-error variance and diffusion tensor fields.

The finite-difference scheme is now considered as a first numerical integration method for Eq. (30), with the derivation of the predictability-error covariance matrix.

## 3.2 Finite-difference scheme and its equivalent PKF dynamics

When the velocity field *u* is positive (which is assumed from now without
loss of generality),
a conditionally stable discretization scheme is given by the Euler-upwind
scheme:

Stability is assured as long as the Courant–Friedrichs–Lewy (CFL) condition
$\mathit{\delta}t<\mathit{\delta}x/\underset{x}{\text{Max}}\left|u\right|$ is satisfied.
Moreover, the scheme is consistent since in the limit of small
*δ**x* and *δ**t*, the dynamics (Eq. 30) is recovered
from the discrete equation (Eq. 37). Thanks to the consistency and the
stability, the equivalence theorem of Lax and Richtmyer (1956)
assures to the convergence of Eq. (37) toward the true solution.
Equation (37) stands as an illustration of model dynamics
(Eq. 3).

While the numerical solution computed with the aid of a given numerical scheme
can converge toward the true solution as *δ**t*→0 and
*δ**x*→0, when *δ**t* and *δ**x* are of finite amplitude,
the numerical solution often differs from the theoretical one.
Actually, there exists another partial differential equation
which offers a better fit to the numerical solution and highlights the
properties of the numerical scheme (Hirt, 1968): the consistency,
the stability as well as the dissipative and dispersive nature of
the numerical scheme can be deduced from the so-called
“modified equation” (Warming and Hyett, 1974).
Hence, while it is supposed to solve Eq. (30),
the numerical solution computed from Eq. (37) is actually the
solution of the modified equation.

More precisely, if *C* denotes a smooth function solution of the iterations
(Eq. 37) with $C(q\mathit{\delta}t,i\mathit{\delta}x)={C}_{i}^{q}$, then the modified
equation is the partial differential equation verified by *C* and at a
given order of precision in *δ**t* and *δ**x*.
Here, it is straightforward to show that at order 𝒪(*δ**t*^{2},*δ**x*^{2}),
the partial differential equation best fitted by *C* is given by
(see Appendix C)

where

and

are two functions of *t* and *x*.

Compared with the nature (Eq. 30), the modified equation that best fits
the Euler-upwind numerical scheme (Eq. 37) presents
a correction of the wind
which depends on the trend ∂_{t}*u* and the self advection *u*∂_{x}*u*
of the wind *u*. The magnitude of the correction scales as *δ**t*
and is null at the limit *δ**t*→0. But this is not the
only modification of the dynamics, as a more critical difference emerges from the
numerical discretization: a diffusion term whose magnitude depends on the
CFL number *u**δ**t*∕*δ**x*. In particular, the diffusion coefficient is
negative when the CFL number is larger than 1. The diffusion breaks the
conservation property of the initial dynamics (Eq. 30). This example
shows the importance of the modified
equation: this provides a way to understand and characterize the defects due to
the numerical resolution. In one dimension, for the evolution equation,
this can be diffusive processes (associated with derivatives of even order)
or dispersive processes (associated with derivatives of odd order).

From the PKF point of view, the modified equation is crucial since it converts a discrete dynamics into a partial differential equation, which appeared from P16 and P18, which is much simpler to handle when considering error covariance dynamics. Thanks to the modified equation (Eq. 38), it is now possible to compute the TL evolution of the predictability error for the Euler-upwind scheme, which can be expressed as

Equations of the PKF forecast can be computed under a similar derivation as in Sect. 3.1. To simplify the computation workflow, a splitting method has been introduced in P16 and P18. Due to the diffusion process appearing in Eq. (39), the PKF formulation faces a closure issue for which a closure scheme has been successfully proposed in P18: the Gaussian closure. The interested reader is referred to P18 for the details. Note that an alternative to the Gaussian closure can be deduced from the data through machine learning (Pannekoucke and Fablet, 2020). Hence, the resulting dynamics for the parameter of the predictability-error covariance model is given by

Compared with the PKF dynamics of the nature (Eq. 36), the
PKF for the Euler-upwind scheme gives rise to additional terms
which result from the numerical diffusion of magnitude *κ*. Moreover,
this time, the PKF for the Euler-upwind scheme presents a coupling
between the variance and the diffusion, the coupling being a consequence of
the numerical diffusion only. Note that a coupling between the variance and the
correlation scale also appeared in Eqs. (4.30a) and (4.34) of
Cohn (1993) but without a link to the discretization scheme.

The model-error covariance matrix, Eq. (27), associated with the
Euler-upwind scheme can be deduced from the predictability-error covariance
matrix approximations: starting from the
initial analysis-error variance and diffusion field, integration of
the parametric-error covariance equations of the nature
(Eq. 36) and of the numerical discretization (Eq. 40)
provides the predictability-error variances ${\stackrel{\mathrm{\u0303}}{V}}^{\mathrm{p}}$ and *V*^{p}, and the
diffusion ${\stackrel{\mathrm{\u0303}}{\mathit{\nu}}}^{\mathrm{p}}$ and *ν*^{p}, which are used to compute
the model-error covariance parameter (Eq. 29).

As another example, the model-error parameters for the semi-Lagrangian scheme are now discussed.

## 3.3 Semi-Lagrangian scheme and its equivalent PKF dynamics

The modified equation technique has been previously considered for semi-Lagrangian (SL) schemes. For instance, McCalpin (1988) has shown for the case of constant advection velocity that a linear interpolation leads to an effective Laplacian dissipation, while the quadratic and cubic interpolations lead to a biharmonic dissipation.

Because we want to focus on the method to address the issue of the model error, and since uncertainty prediction of diffusive dynamics has been detailed by P18, we limit the presentation to the linear interpolation in the semi-Lagrangian scheme, and we present the modified equation of Eq. (30) for the study of its model error.

The Lagrangian perspective (Eqs. 31 to 30) suggests to build
curves along which *c* is constant. While simple, the drawback of this
analytico-geometric method is the possible occurrence of curve trajectory
collapses which prevent us from describing the time evolution of *c* throughout
the geographical domain. It is possible to take advantage of the geometrical
resolution while avoiding the collapse by considering the so-called
semi-Lagrangian procedure.

In the Lagrangian way of thinking,
starting from a given position *x*_{o}, the question
is where the mobile point lies along the time axis, which evolves
the computation grid forward in time. The semi-Lagrangian perspective reverses
this question by asking from which position ${x}_{o}^{*}$ originates the mobile point
arriving at *x*_{o} at a given time.
Hence, the semi-Lagrangian scheme leaves the computation grid unchanged
over the time steps of the integration while letting the scalar field *c*
evolve.
More precisely for the particular dynamics of Eq. (30), by assuming the
scalar field at time *t* known for each points of the computational grid, for
grid point *x*_{i}, the scalar field evolves as

where ${x}_{i}^{*}$ is the origin of the trajectory at time *t* which
arrives at *x*_{i} at time *t*+*δ**t*. Since the point of origin ${x}_{i}^{*}$
is unlikely to be a point of the computational grid (except for very particular
situations), the value $c(t,{x}_{i}^{*})$ is computed as an interpolation of
the known values of *c* at time *t*.

In its present form, the semi-Lagrangian procedure is not suited to the PKF method since it does not give rise any partial differential equation which lies at the core of the parametric approximation for covariance dynamics. To proceed further and to obtain PDEs, additional assumptions are introduced to translate the semi-Lagrangian procedure (Eq. 41) into a discrete scheme from which the modified equation is deduced.

In the case where the discretization satisfies the CFL condition $\mathit{\delta}t<\mathit{\delta}x/\underset{x}{\text{Max}}\left|u\right(x\left)\right|$ and for linear interpolation, it is straightforward to write the semi-Lagrangian procedure (Eq. 41) into a discrete scheme (see Appendix D for the details) which is stated as follows:

which gives rise to the Euler-upwind/downwind schemes.
Then, following the same derivation as previously presented in Sect. 3.2,
the modified equation resulting from the scheme (Eq. 42)
is given as the PDE verified by a smooth solution *C* of Eq. (42).
From the derivation detailed in Appendix D, the modified
equation is

where

and

are both functions of *t* and *x*.

Hence, since this corresponds mainly to the modified equation
(Eq. 38) encountered for the Euler-upwind scheme (Eq. 37),
the parametric predictability-error covariance is also given by
Eq. (40), replacing *κ* by its SL counterpart value
*κ*^{SL}.

Note that the derivation leading to the Euler-upwind and Euler-downwind schemes is due to the choice of the linear interpolation. The bridge between the SL and the Euler-upwind/downwind procedures is not a novelty. The derivation has been carried out since it offers an insight into how to build a modified equation for the SL scheme and also for the self-consistency of the presentation. In the general situation, the modified equation for the SL scheme is hard to obtain, if at all possible, and it is not the idea to claim the procedure as universal. But it provides a new insight into the model-error covariance matrix for the SL scheme, which is one of the main goals of the present contribution.

The next section presents the numerical experiments carried out to assess the ability of the PKF to characterize the model-error covariance matrix.

## 4.1 Setting and illustration

In this experimental test bed, the domain is assumed to be the one-dimensional
segment [0,*D*) with periodic boundary conditions, where *D*=1.
The domain is discretized into a regular grid of *n*=241 points
*x*_{i}=*i**δ**x* for $i\in [\mathrm{0},\mathrm{240}]$ and $\mathit{\delta}x=D/n\approx \mathrm{4.1}\phantom{\rule{0.125em}{0ex}}{\mathrm{10}}^{-\mathrm{3}}$.

The wind field *u* for one-dimensional transport (Eq. 30) is
set as the stationary field

shown in Fig. 2a, which appears as a jet with the entrance (exit) at
*x*=0.75*D* (*x*=0.25*D*): the flow accelerates (decelerates)
until *x*=0.25*D* (*x*=0.75*D*). For the latter, the lead time is *T*=2.0.

In order to verify the CFL condition, the time step for the numerical
simulation is set to *δ**t*=0.002, leading to a CFL value of 0.48<1.
The magnitude of the numerical diffusion *κ*, Eq. (38c),
associated with this setting is shown in Fig. 2b, normalized by
the diffusion coefficient ${\mathit{\kappa}}_{e}=\mathit{\delta}{x}^{\mathrm{2}}/\mathit{\delta}t$.

For the numerical experiment, the initial state for *c* is set to

while the initial analysis-error covariance matrix is set
as the
homogeneous Gaussian covariance matrix
${\mathbf{P}}_{t=\mathrm{0}}^{\mathrm{f}}(x,y)={e}^{-\frac{d(x,y{)}^{\mathrm{2}}}{\mathrm{2}{l}_{\mathrm{h}}^{\mathrm{2}}}}$
with ${l}_{\mathrm{h}}=\mathrm{0.05}D\approx \mathrm{12}\mathit{\delta}x$, where
$d(x,y)=\frac{D}{\mathit{\pi}}\left|\mathrm{sin}\frac{\mathit{\pi}}{D}\right(x-y\left)\right|$ is the chordal distance between the
two geographical positions *x* and *y* (Pannekoucke et al., 2018a, see Eq. 3).
The analysis-error standard deviation is set to the homogeneous value of 1.0.

For numerical validation, since no simple analytical solution of the partial differential equation (Eq. 30) exists, this dynamics is integrated considering a fourth-order Runge–Kutta time scheme applied on the finite-difference discretization:

where the spatial derivative is approximated by a centred second-order scheme. This constitutes the high-order discretization $\widehat{\mathcal{N}}$ of the nature 𝒩, as introduced in Sect. 2.2: $\widehat{\mathcal{N}}$ is assumed to better reproduce the nature 𝒩 than the model ℳ.

Figure 3 shows the trajectory computed from the nature approximated by
$\widehat{\mathcal{N}}$ and the numerical model ℳ.
Since the transport equation conserves the value of the
field *c*, the extremal values of *c* do not change along the
integration and the wind *u*>0 causes the initial structure to move to
the right. While the field is conserved, it is also deformed by the wind.
For the particular choice of the initial condition made here,
the signal is of larger (smaller) scale in the region
$x\in [\mathrm{0},\mathrm{0.5}]$ ( $x\in [\mathrm{0.5},\mathrm{1}]$) than its initial shape.
Figure 3a shows that the nature approximation $\widehat{\mathcal{N}}$ is
able to reproduce the conservation of *c* as well as the stretching of the
signal along the time axis. Hence, the nature approximation $\widehat{\mathcal{N}}$
is good enough to capture the main features of the nature dynamics, which
justifies the use of this approximation in place of the true dynamics
in the following.
In contrast, the model ℳ fails to maintain the magnitudes of the extrema (Fig. 3b),
in accordance with the modified equation (Eq. 38a)
of the Euler-upwind scheme
(Eq. 37) which presents a non-physical diffusion process resulting from
the numerical discretization.
Note that the coefficient of the numerical diffusion is heterogeneous
over the domain with a typical value of thereabout 0.1*κ*_{e} (see Fig. 2b).
This heterogeneity is due to the scale variation of the signal, stretched by the wind shear:
when the signal is of smaller (larger) scale to its initial shape, the second-order
derivative is larger (smaller), which leads to an intensification
(reduction) in the numerical diffusion term in Eq. (38a).

Having validated the two numerical models $\widehat{\mathcal{N}}$ and ℳ, it is now possible to look at the covariance dynamics and how the model-error covariance error can be estimated from the PKF prediction.

## 4.2 Assessment of the PKF in predicting the predictability-error covariance dynamics of the nature and of the numerical model

The PKF predictability-error covariance matrix dynamics for the
transport equation (Eq. 30) is given by
the system of Eq. (36). The PKF predictability-error covariance
matrix dynamics resulting from the Euler-upwind integration (Eq. 37)
is given by Eq. (40).
Both systems are numerically
integrated by considering, respectively, an explicit RK4 time scheme
for the nature and an Euler time scheme for the Euler-upwind scheme.
The time step used for the integration is *δ**t*=0.002.
The predictability-error variance fields are shown in Fig. 4.
The predictability-error correlation length-scale fields,
defined from the one-dimensional diffusion fields by
${\stackrel{\mathrm{\u0303}}{L}}^{\mathrm{p}}=\sqrt{\mathrm{2}{\stackrel{\mathrm{\u0303}}{\mathit{\nu}}}^{\mathrm{p}}}$ (nature) and
${L}^{\mathrm{p}}=\sqrt{\mathrm{2}{\mathit{\nu}}^{\mathrm{p}}}$ (numerical model),
are shown in Fig. 5. The variance and the length scale
are shown for the PKF and an ensemble estimation, the latter being
only computed for the validation of the PKF (the ensembles are not needed
nor used for the computation of the PKF systems).

To do so, an ensemble of *N*_{e}=6400 analysis errors
has been generated, $({\mathit{\epsilon}}_{\mathrm{0},k}^{\mathrm{a}}{)}_{k\in [\mathrm{1},{N}_{e}]}$, where each member is computed as
${\mathit{\epsilon}}_{\mathrm{0},k}^{\mathrm{a}}=({\mathbf{P}}_{t=\mathrm{0}}^{\mathrm{f}}{)}^{\mathrm{1}/\mathrm{2}}{\mathit{\zeta}}_{k}$ with *ζ*_{k}
a sample of the Gaussian random vector of zero mean and covariance matrix
of the identity matrix **I**.
This large size limits the sampling noise to a relative error of
$\mathrm{1}/\sqrt{{N}_{e}}\approx \mathrm{1.25}\mathit{\%}$.

Because the dynamics are linear, the TL nature and model are independent of any analysis state, and the ensemble is computed from the forecasts by the high-order discretization of the nature $\widehat{\mathcal{N}}$ and the model ℳ of the ensemble of analysis errors $\left({\mathit{\epsilon}}_{\mathrm{0},k}^{\mathrm{a}}\right)$.

### 4.2.1 Validation of the PKF for the nature

The predictability-error covariance dynamics for the nature is first considered.
Since the variance of the nature (Eq. 36a) is conserved,
it results that, with the choice of an initial homogeneous variance,
the trend is null and the variance field is the stationary homogeneous
field (1.0). This theoretical
result is well reproduced in Fig. 4a from the PKF integration, while the
ensemble estimation (Fig. 4c) also shows this as stationary but within
the sampling noise. The length scale (Fig. 5a) shows a periodic
evolution where, starting from the homogeneous field of value *l*_{h},
the length scale first increases (decreases) in the
entrance (exit) of the jet; then these evolutions are attenuated and
then compensated with the transport. Then ensemble estimation (Fig. 5c)
presents the same variations (again to within the sampling noise), which
validates the PKF dynamics for the nature.
As a consequence, the PKF dynamics
(Eq. 36) can be used to understand the dynamics of the uncertainty.
In particular, the length-scale field at *t*=0.1*T* is well explained
by the source/sink term $\mathrm{2}\left({\partial}_{x}u\right){\stackrel{\mathrm{\u0303}}{\mathit{\nu}}}^{\mathrm{p}}$ in Eq. (36b) whose magnitude,
which lies between −0.004 and 0.004, implies a rapid emergence of a heterogeneity leading
to large (small) length scales for $x\in [\mathrm{0},\mathrm{0.25}D]\cup [\mathrm{0.75}D,D]$
(for $x\in [\mathrm{0.25}D,\mathrm{0.75}D])$, where ${\partial}_{x}u>\mathrm{0}$ (${\partial}_{x}u<\mathrm{0}$); and by the transport term
$u{\partial}_{x}{\stackrel{\mathrm{\u0303}}{\mathit{\nu}}}^{\mathrm{p}}$ that shifts the fields to the right.
Note that, by introducing the spatial average operator defined for any function *f*
by $\langle f\rangle \left(t\right)=\frac{\mathrm{1}}{D}\int f(t,x)\mathrm{d}x$ as represented in Fig. 6,
the averaged length scale $\langle {\stackrel{\mathrm{\u0303}}{L}}^{\mathrm{p}}\rangle \left(t\right)$
ranges within [12*δ**x*,17.5*δ**x*] (see Fig. 6b), while the
$\langle {\stackrel{\mathrm{\u0303}}{V}}^{\mathrm{p}}\rangle \left(t\right)$ is a constant 1 (see Fig. 6b).

### 4.2.2 Validation of the PKF for the numerical model

The predictability-error covariance dynamics for the numerical model is now discussed.
For the Euler-upwind scheme, the numerical diffusion
resulting from the spatiotemporal discretization in Eq. (38a)
implies a damping of the variance along the time axis (see Fig. 4b). The
attenuation of the uncertainty governed by Eq. (40) leads to
a heterogeneous damping over the domain
and appears much stronger in the middle of the domain (*x*=0.5) than near the
boundaries (*x*=0 and *x*=1) while transported by the flow.
The length scale (Fig. 5b) increases by the diffusion, while the
shear produces similar patterns as for the forecast-error statistics.
The ensemble estimation in Fig. 4d and Fig. 5d shows the same
signal as the PKF prediction (within the sampling noise)
which validates the system of Eq. (40).
As for the nature, it appears that the PKF dynamics for the numerical model,
Eq. (40), explains the dynamics of the uncertainty.
In particular, again, the length-scale field at *t*=0.1*T* is well explained
by the source/sink strain term $\mathrm{2}\left({\partial}_{x}u\right){\stackrel{\mathrm{\u0303}}{\mathit{\nu}}}^{\mathrm{p}}$ in Eq. (40b)
and by the transport term $u{\partial}_{x}{\stackrel{\mathrm{\u0303}}{\mathit{\nu}}}^{\mathrm{p}}$, but this time, compared with
Eq. (36b), the source term 2*κ* in Eq. (40b) implies an increase
of the length scale *L*^{p}. Note that the influence of the remaining terms in
Eq. (40b) can be neglected at the prime instants of the dynamics: this is because
at *t*=0, *V*^{p} and *ν*^{p} are constant fields (${V}^{\mathrm{p}}(t=\mathrm{0})=\mathrm{1}$ and ${\mathit{\nu}}^{\mathrm{p}}(t=\mathrm{0})={l}_{\mathrm{h}}^{\mathrm{2}}/\mathrm{2}$).
Compared with the nature, the behaviour of the
predictability-error variance of the numerical model presents some
source/sink terms (right-hand side of Eq. 40a) that explain the emergence of a
heterogeneity of the variance field. In particular, with the term $-\frac{\mathit{\kappa}}{{\mathit{\nu}}^{\mathrm{p}}}{V}^{\mathrm{p}}$ being
strictly negative, it is responsible of the damping of the variance; it is also responsible
of the heterogeneity at the prime instants: with the length scale *L*^{p} being heterogeneous,
the damping will be more (less) intense in the areas of small (large) length scales
(compare Fig. 4b with Fig. 5b for *t*=0.1*T*).
In terms of spatial average, with the assumption that
the variations around each averaged field are small so that for any fields *f* and *g* the
approximation 〈*f**g*〉≈〈*f*〉〈*g*〉
applies, the spatial average of the dynamics (Eq. 40) is written as

where the property that for any function *f* and integer *k*>0,
$\langle {\partial}_{x}^{k}f\rangle =\mathrm{0}$, has
been used to eliminate all the other terms. Equation (47) can be solved analytically,
and its solutions are written as

The analytical solution (Eq. 48) successfully reproduces the time evolution of the statistics in the present experiment. For the length scale, Eq. () reproduces the increase (see Fig. 6b), with an underestimation because this solution does not account for the oscillation due to the strain term that has been neglected in the dynamics (Eq. 47). For the variance, Eq. (48a) explains a linear decrease at the prime instant, followed by an attenuation in ${t}^{-\mathrm{1}/\mathrm{2}}$ (see Fig. 6a).

### 4.2.3 Intermediate result

As a conclusion of this section, the PKF appears able to predict the variance and the length-scale features of the predicability-error covariance dynamics of the nature (Eq. 30) and of the numerical model, which corresponds to the discretization of the true dynamics given by Eq. (37). These results are now considered to provide an estimation of the model-error covariances.

## 4.3 Model-error covariance from the PKF prediction

From the previous section, the Euler-upwind discretization of the advection (Eq. 30) leads
to a heterogeneous dissipative term, which affects the dynamics of the numerical model uncertainty by
damping the variance while increasing the correlation length scale. When the bias
due to the model error is lower than the predictability-error variance of the nature and
the numerical model is dissipative, then the modelling (Eq. 21)
of the model-error covariance matrix can be introduced, which is a flow-dependent
modelling of the model-error covariance plus a climatological residual.
This is the situation encountered in the present numerical setting:
the predictability-error variance of the nature is 1, which is larger than the bias
(that is at most 0.2 when comparing the nature and the numerical model evolution
in Fig. 3), while the predictability-error variance of the numerical model rapidly
fails with, at its worst, a reduction of 60 *%* of the predictability-error variance
of the nature (see the reduction at *x*=0.6*D* when comparing Fig. 4a and b).
It results that the flow-dependent modelling (Eq. 21) may apply here.

In order to focus on the flow-dependent part of Eq. (21), the approximation
(Eq. 27) is considered. Here, **P**^{m} is computed from the parametric approach
discussed in Sect. 2.4, with the parameters of Eq. (29),
where the predictability-error covariance statistics are computed from
Eq. (36) for the nature and Eq. (40) for the numerical model.
Note that in this 1-D domain situation, Eq. (29b) is equivalent to the computation of
the local correlation length scales by

The flow-dependent model-error covariance parameters are shown in Fig. 7, with the variance in panel (a) and the length scale in panel (b).

At the initial time, as there is no model error, the model-error variance is zero. But then,
the model-error variance should increase linearly because the sink term $\frac{\mathit{\kappa}}{{\mathit{\nu}}^{\mathrm{p}}}{V}^{\mathrm{p}}$
that is the only non-zero right-hand-side term in Eqs. (36a) and (40a)
(see also the spatially averaged dynamics; Eq. 47a)
is a source of model-error variance at the initial time, so that for small *t*,
the order of magnitude of *V*^{m} is given by

which relates the increase of the model-error variance to the numerical diffusion.
Note that the numerical diffusion is not the only process that induces a model error; e.g.
the phase shift due to the correction of the numerical velocity $\frac{\mathit{\delta}t}{\mathrm{2}}u{\partial}_{x}u$
in Eq. (38b) is also a source term, while it has been removed from by the averaging here.
Hence, Eq. (50) provides the order of magnitude of the model-error variance at time *t*=0.1*T*:
when considering the initial conditions ${\mathit{\nu}}^{\mathrm{p}}(t=\mathrm{0})={l}_{\mathrm{h}}^{\mathrm{2}}/\mathrm{2}$ and ${V}^{\mathrm{p}}(t=\mathrm{0})=\mathrm{1}$,
and the order of magnitude of the diffusion coefficient $\langle \mathit{\kappa}\rangle \sim \mathrm{0.1}\mathit{\delta}{x}^{\mathrm{2}}/\mathit{\delta}t$
(see Fig. 2b),
the typical value of the model-error variance computed from Eq. (50) is
〈*V*^{m}〉(0.1*T*)∼0.12.
This is in accordance with the typical values observed in Fig. 7a for that time.
Note that the heterogeneity of the model-error variance field is due to the
heterogeneity of the diffusion field *ν*^{p} as discussed previously in Sect. 4.2.2.

Then, the model-error variance continues to grow, with a peak of uncertainty that evolves with the flow. In this numerical experiment, with the magnitude of the ${\stackrel{\mathrm{\u0303}}{V}}^{\mathrm{p}}$ being constant and equal to 1, the magnitude of the model-error variance ${V}^{\mathrm{m}}={\stackrel{\mathrm{\u0303}}{V}}^{\mathrm{p}}-{V}^{\mathrm{p}}$, shown in Fig. 6a, evolves from Eq. (48a) as

when using the initial values $\langle {\mathit{\nu}}^{\mathrm{p}}\rangle \left(\mathrm{0}\right)=\frac{\mathrm{1}}{\mathrm{2}}{l}_{\mathrm{h}}^{\mathrm{2}}$ and
〈*V*^{p}〉(0)=1.0.
Note that Eq. (51) asymptotically behaves as $\mathrm{1}-\frac{\mathrm{1}}{\mathrm{2}}{\left(\frac{t}{\mathit{\tau}}\right)}^{-\mathrm{1}/\mathrm{2}}$,
where $\mathit{\tau}=\frac{{l}_{\mathrm{h}}^{\mathrm{2}}}{\langle \mathit{\kappa}\rangle}\approx \mathrm{1.3}T$ is the half-magnitude time,
which is in accordance with the simulation since 〈*V*^{m}〉(*T*)∼0.5
at the end of the simulation.

The model-error length scale, given by Eq. (49), is more difficult to interpret (Fig. 7b) because of the oscillation due to the periodic domain. However, the evolution of the spatial average of the length-scale fields (dashed red line in Fig. 6b) shows an increase of the averaged length scale with the time, which is in accordance with the order of magnitude for the model-error length scale (Eq. 49) computed from the analytical approximations (Eqs. 48 and 51), with $\langle {\stackrel{\mathrm{\u0303}}{V}}^{\mathrm{p}}\rangle \left(t\right)=\mathrm{1}$ and $\langle {\stackrel{\mathrm{\u0303}}{L}}^{\mathrm{p}}\rangle \left(t\right)\sim {l}_{\mathrm{h}}$ (dashed purple line in Fig. 6b).

Note that the model-error length scale is much smaller, but not null, which will balance the
large length scale of the predictability-error covariance matrix **P**^{p}.
Hence, as expected, the model error modelled by
Eq. (21) is a heterogeneous covariance that depends on the state and the time: it
is flow dependent.

It is interesting to compare ${\mathbf{\Pi}}_{q+\mathrm{1}}^{\mathrm{m}}$ with the covariance of the unbiased error ${\mathit{\epsilon}}_{q+\mathrm{1}}^{\mathrm{ma}}=(\mathbf{N}-\mathbf{M}){\mathit{\epsilon}}_{q}^{\mathrm{a}}$ that appears in the decomposition of the forecast error (see Eq. A3 in Appendix A)

Indeed, if the errors on the right-hand side of Eq. (52) were decorrelated (which they are not), then ${\mathbf{\Pi}}_{q+\mathrm{1}}^{\mathrm{m}}$ in Eq. (17) would have been replaced by the covariance matrix ${\mathbf{P}}^{\mathrm{ma}}=\mathbb{E}\left[{\mathit{\epsilon}}_{q+\mathrm{1}}^{\mathrm{ma}}({\mathit{\epsilon}}_{q+\mathrm{1}}^{\mathrm{ma}}{)}^{T}\right]$ given by (see Eq. A5 in Appendix A)

with $\mathbf{D}=\mathbf{M}-\mathbf{N}$.
In practice, **P**^{ma} can be estimated from the ensemble of
6400 errors,
${\mathit{\epsilon}}_{q,k}^{\mathrm{ma}}=\widehat{\mathbf{N}}{\mathit{\epsilon}}_{\mathrm{0},k}^{\mathrm{a}}-\mathbf{M}{\mathit{\epsilon}}_{\mathrm{0},k}^{\mathrm{a}}$, where ${\mathit{\epsilon}}_{\mathrm{0},k}^{\mathrm{a}}$ is one of the analysis
errors detailed in Sect. 4.2 and where $\widehat{\mathbf{N}}$ is the TL dynamics
associated with the high-order numerical approximation $\widehat{\mathcal{N}}$ of 𝒩.
Because in the present experiment the dynamics of the nature and of the model are linear,
${\mathit{\epsilon}}_{q,k}^{\mathrm{ma}}$ is computed here as ${\mathit{\epsilon}}_{q,k}^{\mathrm{ma}}=\widehat{\mathcal{N}}\left({\mathit{\epsilon}}_{\mathrm{0},k}^{\mathrm{a}}\right)-\mathcal{M}\left({\mathit{\epsilon}}_{\mathrm{0},k}^{\mathrm{a}}\right)$.
The estimated variance and length-scale fields of **P**^{ma} are shown in Fig. 7c and d.
Compared with the PKF modelling (Fig. 7a and b), the time evolution shows a similar behaviour,
but the variance of **P**^{ma} is smaller, as well as its length scale. In this simulation,
the contribution of the terms in **D**, Eq. (53), is to reduce the variance with a maximum
of 0.4 at the end of the simulation. However, the minimum of variance of the predictability error
is also nearly 0.4. Thus, if **P**^{ma} was considered in place of **Π**^{m}, then a residual
variance of order 0.2 would be needed (e.g. in **Q**) so to obtain a magnitude of forecast error
similar to the predictability of the nature.

Hence, the present numerical experiment illustrated and characterized the flow-dependent part of the
model-error covariance **P**^{m}, modelled by Eq. (21),
in the situation where the model error is related to the discretization of the advection
by a heterogeneous wind, leading to a numerical model that is more diffusive than
the nature. In this experiment, a linear increase in time, followed by a saturation in ${t}^{-\mathrm{1}/\mathrm{2}}$ has been
found for the order of magnitude of the model-error variance.
The residual climatological covariance, **Q** in Eq. (21), has yet to be estimated
(not considered here).

Before concluding, we end this work by addressing some general points about the flow-dependent model which has been introduced here.

The originality of the present contribution is two-fold. First, we have formulated a theoretical background corresponding to the model-error covariance matrix and introduced a modelling for its flow-dependent part, Eq. (21). This provides a theoretical framework to the correction of the predictability error introduced in M2000s. Then, we have provided theoretical and quantitative results about the diffusive effect due to the discretization that can lead to a loss of variance as observed in M2000s: this has been done by combining the formalism of the PKF and the modified equation. The interest for this modelling of the model-error covariance is supported by the results of M2000s, who have observed an improvement of the quality of the analysis in their data assimilation system of stratospheric observations.

The flow-dependent component of the model-error covariance introduced here can be computed in practice, because it relies on (1) the analysis uncertainty as characterized by the analysis state and its error covariance that can be estimated in data assimilation; and (2) the time evolution of the analysis-error covariance by the nature and by the numerical model that can be computed from an ensemble method or from the PKF approach.

Note that, if the difference between a low- and a high-resolution forecast is often used to compute the model-error at a given time, this does not tell anything about the model-error covariances at that time. At most, the model errors collected for a large number of dates, and for the same forecast time, can be used to compute the climatological bias and the climatological model-error covariance. To capture the error of the day following Eq. (21), the computation of the predictability-error covariance matrices is needed.

Hence, the use of the PKF is important because Eq. (21) needs to estimate not only the predictability-error covariance matrix of the numerical model but also the one of the nature. If an ensemble estimation of the latter matrix is possible in the research, e.g. by computing an ensemble of high-resolution forecast with $\widehat{\mathcal{N}}$ in place of the nature 𝒩, it is too costly for real-time applications. It results that it is difficult to use Eq. (21) in an ensemble method. Compared with an ensemble method, the PKF remains to compute the evolution of a reduced set of covariance parameters by computing equations similar to the one encountered in geosciences. For the passive tracer in 1-D, the PKF dynamics consists in three equations: for the transport of the concentration, the dynamics of the variance and the dynamics of the local anisotropy (here a diffusion coefficient related to the correlation length scale). So, the numerical cost of the PKF (three equations) for the tracer (one equation) is about 3 times the computation of a single forecast compared to the dozens of members often used in ensemble methods (from which the statistics are corrupted by the sampling noise).

For the dynamics of a tracer, the PKF applies in 1-D as well as in 2-D and 3-D domains, where the number of equations are this time of five in 2-D and eight in 3-D (the additional equations are for the components of the local anisotropic tensor). However, in general, the use of the PKF is limited by the knowledge of the parameter dynamics. The formalism of the PKF is adapted for dynamics given by partial differential equations, as for the advection of a tracer, but the design of a multivariate PKF formulation is needed to address multivariate dynamics. Note that for the model error as presented here, the knowledge of the modified equation is a prerequisite that can be difficult to determine in general.

While the PKF is designed from the TL approximation, it is a second-order Gaussian filter that is a particular implementation of non-linear Kalman-like filters (Cohn, 1993): for non-linear dynamics, the PKF equation of the mean state depends on the second-order moments. However, for long-term predictions, or when the magnitude of the error is too large, the PKF would fail to provide an accurate estimation of the covariance matrices.

In this contribution, the part of the model-error covariance due to the spatiotemporal discretization scheme is explored by considering the parametric approximation for the Kalman filter (PKF). The PKF approach applies for a system whose dynamics is given by a set of PDEs. In the PKF formulation, covariances are approximated by covariance models characterized by a set of covariance parameters, whose dynamics is deduced from the PDEs of the system, supplemented by an appropriate closure if necessary. We focused on the class of covariance model distinguished by the variance field and the local anisotropic tensors (VLATcov). Therefore, for VLATcov matrices, the covariance dynamics is given by the dynamics of the variance and the local anisotropic tensors, whose dynamics are deduced from the partial differential equations of the system.

In the case where the numerical model presents a dissipation due to the discretization, or where the numerical model is more dissipative than the nature, we introduced a modelling of the model-error covariance, where its flow-dependent part is approximated as the difference between the parametric approximation of the predictability-error covariance matrix of the nature and of the numerical model, plus a residual climatological covariance matrix. This modelling of the flow-dependent part can be computed in real applications because it relies on quantities that can be estimated: the analysis state and its analysis-error covariance matrix (or some of its characteristics). For a dynamics given by a partial differential equation, the parametric predictability-error covariance matrix of the nature is deduced from the evolution equation, while the predictability-error covariance matrix of the numerical model is computed from the modified evolution, i.e. the partial differential equations that best fits the numerical solution.

The ability of the parametric approach to characterize part of the model-error covariance dynamics has been illustrated in a numerical test bed in 1-D. We have considered the transport of a scalar by a heterogeneous velocity field. In this case, the parametric dynamics of the forecast error shows that the variance is conserved along the flow, while the local anisotropic tensor is transported by the flow and deformed by the gradient of the velocity.

For this transport dynamics, two numerical schemes have been considered:
an Euler-upwind scheme and a semi-Lagrangian scheme in the case of a
linear interpolation.
The modified equations of both schemes make an additional heterogeneous
dissipation and a perturbation of the velocity appear, whose characteristics depend
on the spatiotemporal discretization (d*t*, d*x*), the trend and
the shear of the flow. Because of the numerical diffusion, the variance of the
predictability error is not conserved and a coupling with the anisotropy
appears.
This effect has been noted as well in 3-D global transport models
(Ménard et al., 2020) where the loss of error variance is stronger for
short correlation length scales.

An ensemble of forecasts has been introduced, taken as the reference, to compare the true covariance evolution with the parametric approximation. The numerical experiment shows the ability of the parametric dynamics to reproduce the predictability-error covariance dynamics. Then, the modelling of the flow-dependent part of the model-error covariance matrix has been computed and discussed. In particular, we discussed the growth of the model-error variance from the understanding of the PKF dynamics, showing a linear increase in time followed by a saturation in ${t}^{-\mathrm{1}/\mathrm{2}}$.

With the flow-dependent formulation being introduced for modelling the situation where the numerical model is more dissipative than the nature, the model-error variance provided by the PKF should be a lower bound of the true model-error variance, which needs a residual climatological covariance to account for the bias.

While there is no data assimilation experiment here, this contribution provides a theoretical background on the model-error covariance that sheds light on a study previously done by Ménard et al. (2000) and Ménard and Chang (2000) (M2000s), who have observed a loss of variance in the assimilation of a stratospheric tracer by using a Kalman filter: the variance forecasted was lower than the theoretical variance that is supposed to be conserved for the advection (Cohn, 1993). Actually, interpreted as an account of the model error due to the discretization scheme, the correction made by M2000s is similar to the modelling of the flow-dependent part of the model-error covariance matrix we proposed here. In particular, M2000s have observed that the Kalman filter, with the corrected predictability-error covariance, required less residual climatological model error (see Ménard et al., 2000, Sect. 5) and an improvement of the analysis-error statistics (see Ménard et al., 2000, Fig. 11), and thus indicated that the modelling of the model error, as proposed here, is in better agreement with optimality of the nature. Hence, the benefit of the flow-dependent modelling introduced here appears to be supported by the improvement of the analysis observed by M2000s in their experiment.

The methodology introduced here has shown the potential of exploring the model-error covariance from the parametric dynamics of error covariance. While the characterization of the model-error covariance is a challenge, as in air quality forecasts (Emili et al., 2016), the parametric approach appears as a new theoretical tool to tackle this issue. In order to represent the uncertainty of the small scales, it would be interesting to combine the parametric approach with other new methods, e.g. the modelling under location uncertainty (Resseguier et al., 2017).

However, the parametric dynamics faces closure issues that have to be addressed depending on applications. Here, the investigation of diffusive model errors has been made possible thanks to the Gaussian closure of P18. For other kind of numerical errors, an appropriate closure will have to be specified, either from theoretical closures or from the data as suggested by the data-driven and physics-informed identification of uncertainty dynamics of Pannekoucke and Fablet (2020).

The aim of this section is to provide the demonstrations of some decompositions of the forecast error: the usual expression as encountered in data assimilation, an expression where the model error is considered with respect to the analysis state and an expression that makes the predictability error appear with respect to the nature.

## A1 Expression of the forecast error as usually encountered in data assimilation

The forecast error is defined in Eq. (9) as the difference
${\mathit{\epsilon}}_{q+\mathrm{1}}^{\mathrm{f}}={\mathcal{M}}_{{t}_{q+\mathrm{1}}\leftarrow {t}_{q}}\left({\mathcal{X}}_{q}^{\mathrm{a}}\right)-{\mathcal{X}}_{q+\mathrm{1}}^{\mathrm{t}}$. Thanks to Eq. (4),
the true state at time *t*_{q+1} can be replaced so that

which makes the model error appear, defined by Eq. (5) as ${\mathit{\epsilon}}_{q+\mathrm{1}}^{\mathrm{m}}={\mathcal{M}}_{{t}_{q+\mathrm{1}}\leftarrow {t}_{q}}-{\mathcal{N}}_{{t}_{q+\mathrm{1}}\leftarrow {t}_{q}}$. However, with ${\mathcal{M}}_{{t}_{q+\mathrm{1}}\leftarrow {t}_{q}}\left({\mathcal{X}}_{q}^{\mathrm{t}}\right)={\mathcal{M}}_{{t}_{q+\mathrm{1}}\leftarrow {t}_{q}}({\mathcal{X}}_{q}^{\mathrm{a}}-{\mathit{\epsilon}}_{q}^{\mathrm{a}})$ which expands for small analysis error as

(**M** denotes the propagator of the TL model along the analysis state trajectory;
see Sect. 2.1 for details),
the forecast error (Eq. A1) becomes

which is written as

where ${\mathit{\epsilon}}_{q+\mathrm{1}}^{\mathrm{p}}=\mathbf{M}{\mathit{\epsilon}}_{q}^{\mathrm{a}}$ is the predictability error (Eq. 12) with respect to the model. Equation (A2) is the expression of the forecast error usually introduced in data assimilation (Daley, 1992, see Eq. 2.8). Note that in this expression, the model error is evaluated at the true state ${\mathcal{X}}_{q}^{\mathrm{t}}$, while it is never known in practice. It would be interesting to consider an expression with known quantities, e.g. with the analysis state; this is now detailed in the next subsection.

## A2 Expression of the forecast error considering the model error with respect to the analysis state

The forecast error (Eq. A2) can be obtained by rewriting the model-error term as ${\mathit{\epsilon}}_{q+\mathrm{1}}^{\mathrm{m}}\left({\mathcal{X}}_{q}^{\mathrm{t}}\right)={\mathit{\epsilon}}_{q+\mathrm{1}}^{\mathrm{m}}({\mathcal{X}}_{q}^{\mathrm{a}}-{\mathit{\epsilon}}_{q}^{\mathrm{a}})$. Hence, the Taylor expansion of ${\mathit{\epsilon}}_{q+\mathrm{1}}^{\mathrm{m}}$, with respect to ${\mathcal{X}}_{q}^{\mathrm{a}}$ for small error and lead time, leads to

where *d**ε*^{m} denotes the differential of the model error
${\mathit{\epsilon}}^{\mathrm{m}}=\mathcal{M}-\mathcal{N}$ (Eq. 5) which exists when ℳ and 𝒩
are both differentiable, so that $d{\mathit{\epsilon}}^{\mathrm{m}}=\mathrm{d}\mathcal{M}-\mathrm{d}\mathcal{N}$.
It results that

where **N** is the propagator of the TL nature along the analysis state trajectory
(see Sect. 2.1 for details).
Then, the forecast error (Eq. A2) expands as

where ${\mathit{\epsilon}}_{q+\mathrm{1}}^{\mathrm{ma}}$ is defined by

Note that ${\mathit{\epsilon}}_{q+\mathrm{1}}^{\mathrm{ma}}$ is unbiased (at least when the analysis error is unbiased), i.e. $\mathbb{E}\left[{\mathit{\epsilon}}_{q+\mathrm{1}}^{\mathrm{ma}}\right]=\mathrm{0}$, so that the covariance matrix is ${\mathbf{P}}_{q+\mathrm{1}}^{\mathrm{ma}}=\mathbb{E}\left[{\mathit{\epsilon}}_{q+\mathrm{1}}^{\mathrm{ma}}({\mathit{\epsilon}}_{q+\mathrm{1}}^{\mathrm{ma}}{)}^{T}\right]$, which expands as

Replacing the TL model **M** with $\mathbf{N}=\mathbf{M}-\mathbf{D}$ leads to

where ${\mathbf{\Pi}}_{q+\mathrm{1}}^{\mathrm{m}}={\mathbf{NP}}_{q}^{\mathrm{a}}{\mathbf{N}}^{T}-{\mathbf{MP}}_{q}^{\mathrm{a}}{\mathbf{M}}^{T}$ (see Eq. 18).

As ${\mathit{\epsilon}}_{q+\mathrm{1}}^{\mathrm{ma}}$ contains the predictability error, a final expression of the forecast error can be obtained as shown now.

## A3 Expression of the forecast error formulated in terms of nature predictability

Considering the definition of the predictability error (Eq. 12), the forecast error (Eq. A3) is rewritten as

which makes the predictability error appear with respect to the nature, ${\stackrel{\mathrm{\u0303}}{\mathit{\epsilon}}}_{q+\mathrm{1}}^{\mathrm{p}}=\mathbf{N}{\mathit{\epsilon}}_{q}^{\mathrm{a}}$.

Note that Eq. (A6) can be obtained directly from the definition of the forecast error (Eq. 9) as follows. By replacing the forecast with ${\mathcal{M}}_{{t}_{q+\mathrm{1}}\leftarrow {t}_{q}}\left({\mathcal{X}}_{q}^{\mathrm{a}}\right)={\mathcal{N}}_{{t}_{q+\mathrm{1}}\leftarrow {t}_{q}}\left({\mathcal{X}}_{q}^{\mathrm{a}}\right)+{\mathit{\epsilon}}_{q+\mathrm{1}}^{\mathrm{m}}\left({\mathcal{X}}_{q}^{\mathrm{a}}\right)$, the forecast error is first written as ${\mathit{\epsilon}}_{q+\mathrm{1}}^{\mathrm{f}}={\mathcal{N}}_{{t}_{q+\mathrm{1}}\leftarrow {t}_{q}}\left({\mathcal{X}}_{q}^{\mathrm{a}}\right)-{\mathcal{N}}_{{t}_{q+\mathrm{1}}\leftarrow {t}_{q}}\left({\mathcal{X}}_{q}^{\mathrm{t}}\right)+{\mathit{\epsilon}}_{q+\mathrm{1}}^{\mathrm{m}}\left({\mathcal{X}}_{q}^{\mathrm{a}}\right)$, where the definition of the nature ${\mathcal{X}}_{q+\mathrm{1}}^{\mathrm{t}}={\mathcal{N}}_{{t}_{q+\mathrm{1}}\leftarrow {t}_{q}}\left({\mathcal{X}}_{q}^{\mathrm{t}}\right)$ has been used. Then, rewriting ${\mathcal{N}}_{{t}_{q+\mathrm{1}}\leftarrow {t}_{q}}\left({\mathcal{X}}_{q}^{\mathrm{t}}\right)={\mathcal{N}}_{{t}_{q+\mathrm{1}}\leftarrow {t}_{q}}({\mathcal{X}}_{q}^{\mathrm{a}}-{\mathit{\epsilon}}_{q}^{\mathrm{a}})$, whose Taylor expansion is ${\mathcal{N}}_{{t}_{q+\mathrm{1}}\leftarrow {t}_{q}}\left({\mathcal{X}}_{q}^{\mathrm{t}}\right)={\mathcal{N}}_{{t}_{q+\mathrm{1}}\leftarrow {t}_{q}}\left({\mathcal{X}}_{q}^{\mathrm{a}}\right)-\mathbf{N}{\mathit{\epsilon}}_{q}^{\mathrm{a}}$, leads to the forecast error (Eq. A6).

Here, we consider the particular case where the model-error covariance model is approximated as Eq. (27), i.e.

assuming this matrix is a covariance matrix. The local metric tensor can be diagnosed from the Taylor expansion of the model-error correlation function:

Under an assumption of local homogeneity of the variance, ${\mathbf{P}}^{\mathrm{m}}(\mathbf{x},\mathbf{x})\approx {\mathbf{P}}^{\mathrm{m}}(\mathbf{x}+\mathit{\delta}\mathbf{x},\mathbf{x}+\mathit{\delta}\mathbf{x})$, ${\stackrel{\mathrm{\u0303}}{\mathbf{P}}}^{\mathrm{p}}(\mathbf{x},\mathbf{x})\approx {\stackrel{\mathrm{\u0303}}{\mathbf{P}}}^{\mathrm{p}}(\mathbf{x}+\mathit{\delta}\mathbf{x},\mathbf{x}+\mathit{\delta}\mathbf{x})$ and ${\mathbf{P}}^{\mathrm{p}}(\mathbf{x},\mathbf{x})\approx {\mathbf{P}}^{\mathrm{p}}(\mathbf{x}+\mathit{\delta}\mathbf{x},\mathbf{x}+\mathit{\delta}\mathbf{x})$, which leads to the expansion

Since $\left|\right|\mathit{\delta}\mathbf{x}|{|}_{{\mathbf{g}}_{\mathbf{x}}}^{\mathrm{2}}=\mathit{\delta}{\mathbf{x}}^{T}{\mathbf{g}}_{\mathbf{x}}\mathit{\delta}\mathbf{x}$, the correlation is expanded as

After identification with the expected form of the expansion

it follows that

where the variance is denoted by ${\stackrel{\mathrm{\u0303}}{\mathbf{P}}}^{\mathrm{p}}(\mathbf{x},\mathbf{x})={\stackrel{\mathrm{\u0303}}{V}}^{\mathrm{p}}\left(\mathbf{x}\right)$ and ${\mathbf{P}}^{\mathrm{p}}(\mathbf{x},\mathbf{x})={V}^{\mathrm{p}}\left(\mathbf{x}\right)$.

The modified partial differential equation associated
with the numerical scheme (Eq. 37) is the partial differential equation
of a smooth function *C*, solution of the scheme, so that
$C(q\mathit{\delta}t,i\mathit{\delta}x)={C}_{i}^{q}$, i.e.

for which the Taylor formula in time and space on the order of
𝒪(*δ**t*^{2},*δ**x*^{2}) is

The second-order time derivative can be replaced from the
equation (Eq. C2) itself, at an appropriate order.
Due to the *δ**t*, an expansion at order 𝒪(*δ**t*) only
requires to express the second-order derivative at the lead order,
which is from

Then, from the time derivative, the second-order derivative can be replaced by

Consequently, the second-order derivative ${\partial}_{xt}^{\mathrm{2}}C$ can be deduced from spatial derivative of Eq. (C3) and is written as

It results that Eq. (C2) is written as

so that

where
$U=u-\frac{\mathit{\delta}t}{\mathrm{2}}{\partial}_{t}u+\frac{\mathit{\delta}t}{\mathrm{2}}u{\partial}_{x}u$ and
$\mathit{\kappa}=\frac{u}{\mathrm{2}}\left(\mathit{\delta}x-u\mathit{\delta}t\right)$ are two functions
of *t* and *x*.

The aims of this section are two-fold: the first goal is to obtain a discrete scheme from the semi-Lagrangian procedure, and the second goal is to deduce the modified equation of the discrete scheme.

For the sake of simplicity, the linear advection dynamics
${\partial}_{t}c+u{\partial}_{x}c=\mathrm{0}$ is first considered with a velocity *u*>0.

From the characteristic curve resolution, it follows that
$c({t}_{q+\mathrm{1}},{x}_{i})=c({t}_{q},{x}_{i}^{*})$,
where the originating point ${x}_{i}^{*}$ is assumed in between points
*x*_{i−1} and *x*_{i}, which means that the CFL constraint
*u**δ**t*<*δ**x* is verified. This originating point can be approximated as
${x}_{i}^{*}={x}_{i}-{u}_{i}\mathit{\delta}t$, and if a linear interpolation is considered
for the computation of $c(t,{x}_{i}^{*})$, it follows that

Hence, the numerical scheme is written as

The modified differential equation is obtained by replacing
*c* by a smooth function $\stackrel{\mathrm{\u0303}}{c}$, the solution of the numerical scheme
(Eq. D3). The computation of the modified equation is similar to the
Euler case detailed in Appendix C, leading to

When *u*<0, the differential equation is written as

Hence, in the general situation,

whatever the sign of the velocity *u*.

The data have been generated from a numerical experiment as described in the paper (see Sect. 4.1 and 4.2).

OP and RM conceived the idea to explore the influence of the numerical scheme on the error model. OP linked the modified equation to the parametric formulation of the uncertainty prediction. MEA contributed to the simulation during its training period, supervised by OP and MP.

The authors declare that they have no conflict of interest.

We would like to thank Mateusz Reszka for English proofreading. We would like to thank the three anonymous referees for their fruitful comments which have contributed to improving the manuscript.

This research has been supported by the LEFE INSU (KAPA grant).

This paper was edited by Wansuo Duan and reviewed by three anonymous referees.

Berre, L., Pannekoucke, O., Desroziers, G., Stefanescu, S., Chapnik, B., and Raynaud, L.: A variational assimilation ensemble and the spatial filtering of its error covariances: increase of sample size by local spatial averaging, available at: https://www.ecmwf.int/node/8172 (last access: 13 January 2021), ECMWF Workshop on Flow-dependent aspecyts of data assimilation, Reading, UK, 11–13 June 2007, 151–168, 2007. a

Boisserie, M., Arbogast, P., Descamps, L., Pannekoucke, O., and Raynaud, L.: Estimating and diagnosing model error variances in the Meteo-France global NWP model, Q. J. Roy. Meteor. Soc., 140, 846–854, https://doi.org/10.1002/qj.2173, 2013. a

Boyd, J.: Chebyshev and Fourier Spectral Methods, Dover Publications, Mineola, New York, USA, 2001. a

Carrassi, A. and Vannitsem, S.: Accounting for Model Error in Variational Data Assimilation: A Deterministic Formulation, Mon. Weather Rev., 138, 3369–3386, https://doi.org/10.1175/2010MWR3192.1, 2010. a

Cohn, S.: Dynamics of Short-Term Univariate Forecast Error Covariances, Mon. Weather Rev., 121, 3123–3149, 1993. a, b, c, d, e, f

Daley, R.: Atmospheric Data Analysis, Cambridge University Press, New York, USA, 1991. a

Daley, R.: Estimating Model-Error Covariances for Application to Atmospheric Data Assimilation, Mon. Weather Rev., 120, 1735–1746, 1992. a, b, c

Dee, D.: On-line Estimation of Error Covariance Parameters for Atmospheric Data Assimilation, Mon. Weather Rev., 123, 1128–1145, 1995. a

Derber, J. and Bouttier, F.: A reformulation of the background error covariance in the ECMWF global data assimilation system, Tellus A, 51, 195–221, 1999. a

Dubinkina, S.: Relevance of conservative numerical schemes for an Ensemble Kalman Filter, Q. J. Roy. Meteor. Soc., 144, 468–477, https://doi.org/10.1002/qj.3219, 2018. a

Emili, E., Gürol, S., and Cariolle, D.: Accounting for model error in air quality forecasts: an application of 4DEnVar to the assimilation of atmospheric composition using QG-Chem 1.0, Geosci. Model Dev., 9, 3933–3959, https://doi.org/10.5194/gmd-9-3933-2016, 2016. a

Evensen, G.: Data Assimilation: The Ensemble Kalman Filter, Springer Berlin Heidelberg, https://doi.org/10.1007/978-3-642-03711-5, 2009. a

Grudzien, C., Bocquet, M., and Carrassi, A.: On the numerical integration of the Lorenz-96 model, with scalar additive noise, for benchmark twin experiments, Geosci. Model Dev., 13, 1903–1924, https://doi.org/10.5194/gmd-13-1903-2020, 2020. a

Hatfield, S., Düben, P., Chantry, M., Kondo, K., Miyoshi, T., and Palmer, T.: Choosing the Optimal Numerical Precision for Data Assimilation in the Presence of Model Error, J. Adv. Model. Earth Sy., 10, 2177–2191, https://doi.org/10.1029/2018ms001341, 2018. a

Hirt, C.: Heuristic stability theory for finite-difference equations, J. Comput. Phys., 2, 339–355, https://doi.org/10.1016/0021-9991(68)90041-7, 1968. a

Houtekamer, P. L., Mitchell, H. L., and Deng, X.: Model Error Representation in an Operational Ensemble Kalman Filter, Mon. Weather Rev., 137, 2126–2143, 2009. a

Lax, P. D. and Richtmyer, R. D.: Survey of the stability of linear finite difference equations, Commun. Pur. Appl. Math., 9, 267–293, https://doi.org/10.1002/cpa.3160090206, 1956. a

McCalpin, J. D.: A Quantitative Analysis of the Dissipation Inherent in Semi-Lagrangian Advection, Mon. Weather Rev., 116, 2330–2336, 1988. a

Ménard, R. and Chang, L.-P.: Assimilation of Stratospheric Chemical Tracer Observations Using a Kalman Filter. Part II: chi-2-Validated Results and Analysis of Variance and Correlation Dynamics, Mon. Weather Rev., 128, 2672–2686, https://doi.org/10.1175/1520-0493(2000)128<2672:AOSCTO>2.0.CO;2, 2000. a, b

Ménard, R., Cohn, S., Chang, L.-P., and Lyster, P. M.: Assimilation of Stratospheric Chemical Tracer Observations Using a Kalman Filter. Part I: Formulation, Mon. Weather Rev., 128, 2654–2671, 2000. a, b, c, d, e, f, g, h

Ménard, R., Skachko, S., and Pannekoucke, O.: The role of numerical discretization in variance loss and the need for inflation, in preparation, 2021. a, b, c

Nicolis, C.: Dynamics of Model Error: Some Generic Features, J. Atmos. Sci., 60, 2208–2218, 2003. a, b

Palmer, T. N., Buizza, R., Doblas-Reyes, F., Jung, T., Leutbecher, M., Shutts, G., Steinheimer, M., and Weisheimer, A.: Stochastic Parametrization and Model Uncertainty, Tech Memo 598, ECMWF, Reading, UK, 44 p., 2009. a

Pannekoucke, O.: An anisotropic formulation of the parametric Kalman filter analysis step, Tellus A, submitted, 2020. a, b, c

Pannekoucke, O. and Fablet, R.: PDE-NetGen 1.0: from symbolic partial differential equation (PDE) representations of physical processes to trainable neural network representations, Geosci. Model Dev., 13, 3373–3382, https://doi.org/10.5194/gmd-13-3373-2020, 2020. a, b

Pannekoucke, O. and Massart, S.: Estimation of the local diffusion tensor and normalization for heterogeneous correlation modelling using a diffusion equation., Q. J. Roy. Meteor. Soc., 134, 1425–1438, 2008. a

Pannekoucke, O., Ricci, S., Barthelemy, S., Ménard, R., and Thual, O.: Parametric Kalman Filter for chemical transport model, Tellus A, 68, 31547, https://doi.org/10.3402/tellusa.v68.31547, 2016. a, b

Pannekoucke, O., Bocquet, M., and Ménard, R.: Parametric covariance dynamics for the nonlinear diffusive Burgers equation, Nonlin. Processes Geophys., 25, 481–495, https://doi.org/10.5194/npg-25-481-2018, 2018a. a, b, c, d

Pannekoucke, O., Ricci, S., Barthelemy, S., Ménard, R., and Thual, O.: Parametric Kalman filter for chemical transport models – Corrigendum, Tellus A, 70, 1–2, https://doi.org/10.1080/16000870.2018.1472954, 2018b. a

Resseguier, V., Mémin, E., and Chapron, B.: Geophysical flows under location uncertainty, Part I Random transport and general models, Geophys. Astro. Fluid, 111, 149–176, https://doi.org/10.1080/03091929.2017.1310210, 2017. a

Shutts, G. J.: A kinetic energy backscatter algorithm for use in ensemble prediction systems, Q. J. Roy. Meteor. Soc., 131, 3079–3102, https://doi.org/10.1256/qj.04.106, 2005. a

Vannitsem, S. and Toth, Z.: Short-Term Dynamics of Model Errors, J. Atmos. Sci., 59, 2594–2604, https://doi.org/10.1175/1520-0469(2002)059<2594:STDOME>2.0.CO;2, 2002. a

Warming, R. and Hyett, B.: The modified equation approach to the stability and accuracy analysis of finite-difference methods, J. Comput. Phys., 14, 159–179, https://doi.org/10.1016/0021-9991(74)90011-4, 1974. a

Weaver, A. and Courtier, P.: Correlation modelling on the sphere using a generalized diffusion equation (Tech. Memo. ECMWF, num. 306), Q. J. Roy. Meteor. Soc., 127, 1815–1846, 2001. a

Weaver, A. T. and Mirouze, I.: On the diffusion equation and its application to isotropic and anisotropic correlation modelling in variational assimilation, Q. J. Roy. Meteor. Soc., 139, 242–260, 2013. a

- Abstract
- Introduction
- Theoretical considerations
- Parametric characterization of the model-error covariance for the one-dimensional advection equation
- Numerical validation
- Discussion
- Conclusions
- Appendix A: Expressions for the forecast error
- Appendix B: Approximation of the model-error metric tensor field
- Appendix C: Computation of the modified equation for the Euler scheme
- Appendix D: Computation of the modified equation for a semi-Lagrangian scheme
- Data availability
- Author contributions
- Competing interests
- Acknowledgements
- Financial support
- Review statement
- References

- Abstract
- Introduction
- Theoretical considerations
- Parametric characterization of the model-error covariance for the one-dimensional advection equation
- Numerical validation
- Discussion
- Conclusions
- Appendix A: Expressions for the forecast error
- Appendix B: Approximation of the model-error metric tensor field
- Appendix C: Computation of the modified equation for the Euler scheme
- Appendix D: Computation of the modified equation for a semi-Lagrangian scheme
- Data availability
- Author contributions
- Competing interests
- Acknowledgements
- Financial support
- Review statement
- References