Articles | Volume 30, issue 2
https://doi.org/10.5194/npg-30-237-2023
https://doi.org/10.5194/npg-30-237-2023
Research article
 | 
29 Jun 2023
Research article |  | 29 Jun 2023

Physically constrained covariance inflation from location uncertainty

Yicun Zhen, Valentin Resseguier, and Bertrand Chapron
Abstract

Motivated by the concept of “location uncertainty”, initially introduced in Mémin (2014), a scheme is sought to perturb the “location” of a state variable at every forecast time step. Further considering Brenier's theorem (Brenier1991), asserting that the difference of two positive density fields on the same domain can be represented by a transportation map, we demonstrate that the perturbations consistently define a stochastic partial differential equation (SPDE) from the original PDE. It ensues that certain quantities, up to the user, are conserved at every time step. Remarkably, derivations following both the SALT (stochastic advection by Lie transport; Holm2015) and LU (location uncertainty; Mémin2014; Resseguier et al.2017a) settings can be recovered from this perturbation scheme. Still, it offers broader applicability since it does not explicitly rely on Lagrangian mechanics or Newton's laws of force. For illustration, a stochastic version of the thermal shallow water equation is presented.

1 Introduction

Data assimilation is meant to extract information from measurements to improve the state estimate. Kalman-filter-based and particle-filter-based methods are now commonly used for academic studies and operational forecasts. For both methods, the estimate of a state variable and the uncertainty quantification of the estimate of a state variable are repeated at each data assimilation cycle. In the classical Kalman filter, this uncertainty is represented by a covariance matrix. In Monte Carlo-based methods (i.e., the ensemble Kalman filters and particle filters, etc.), it is represented by the spread of the ensemble members or particles. The uncertainty of the state estimate is further part of the input for the next data assimilation cycle. Frequently observed, the uncertainty can be underestimated in nonlinear numerical experiments when there is no model noise (Schlee et al.1966; Harlim and Majda2010; Franzke et al.2015). As a consequence, the state estimate in the subsequent time steps may not be efficiently adjusted by the physical measurements: the system is over-confident about its current state estimate. This phenomenon is usually referred to as filter divergence, possibly associated with the “curse of dimensionality” (see for instance Daum and Huang2003).

To address the latter issue, “covariance localization” has been developed for both Kalman-filter-based methods and particle filters (Houtekamer and Mitchell2001; Poterjoy2016). To further mitigate filter divergence, a practical strategy is to inflate the uncertainty estimate at each forecast time step or each data assimilation cycle (Anderson2007; Tibshirani and Knight1999; Li et al.2009; Kotsuki et al.2017; Ying and Zhang2015; Miyoshi2011; Raanes et al.2019; Zhen and Harlim2015). For geophysical applications, the uncertainty is then often inflated by rescaling the ensemble covariance in order to match bias and variance. A natural alternative is the addition of noise in the dynamical equations.

In the context of ensemble-/particle-based methods, the uncertainty is usually inflated by artificially perturbing each ensemble member/particle. We refer the reader to Resseguier et al. (2021) for a review on the subject. It is then a natural question to ask whether there is a mathematical principle to guide this uncertainty inflation.

In the fluid dynamics community, random forcings are not introduced for inflation but to mimic the intermittent backscattering of energy from small scales toward large scales. Among those approaches, we may mention the stochastic Lagrangian models (Pope1994) and the Eulerian Gaussian backscatterings of the EDQNM (eddy damped quasi-normal Markovian; Orszag1970; Leith1971) model. Additive noise models, like the linear inverse models (Penland and Sardeshmukh1995), have then also been proposed for filtering purposes and have been thoroughly reviewed by Tandeo et al. (2020). Most methods mainly focus on comparing the estimated uncertainty and the statistics of the innovation process but ignore other mathematical/physical aspects (for instance, conservation laws). Other empirical approaches, referred to as the SPPT (stochastically perturbed parametrization tendency; Buizza et al.1999) scheme and the SKEBS (stochastic kinetic energy backscatter; Berner et al.2009) scheme, introduce multiplicative noise, with success in operational weather and climate forecast centers (Franzke et al.2015). Still many drawbacks have been reported, above all violations of conservation laws (Reynolds et al.2016; Leutbechner et al.2016). Recently, the operational ocean circulation model NEMO has also been randomized (e.g. Leroux et al.2022) but, again, without consideration of conservation.

Several authors proposed schemes specifically to enforce energy conservation or at least a given energy budget (e.g. Sapsis and Majda2013; Gugole and Franzke2019; Resseguier et al.2021). To better constrain non-Gaussian schemes, many authors rely on physics and possibly on time-scale separation. Introduced by Hasselmann (1976), it is generally associated with the rigorous theories of averaging and homogenization. Majda et al. (1999) decomposed the state variable into slow-varying modes xj and fast-varying modes yj. The authors demonstrated that the interaction term between xj and yj, in the equation for xj, can be modeled as a stochastic process solely in terms of xj's, as the ratio of the timescales of xj and yj tends to 0. Nevertheless, homogenization methods, like Majda et al. (1999), may also lead to violation of energy conservation, even though some workarounds exist (Frank and Gottwald2013; Jain et al.2014).

In Brzeźniak et al. (1991), later modified in Mikulevicius and Rozovskii (2004), Flandoli (2011), Mémin (2014), and Resseguier et al. (2017a, 2021), preservation of kinetic energy is specifically emphasized. The true velocity of an incompressible flow is decomposed into a regular component and a turbulent one and the latter modeled by a stochastic noise. Mikulevicius and Rozovskii (2004) and Mémin (2014) further derived stochastic Navier–Stokes equations. For these two approaches, the large-scale advecting velocity differs, induced by different regularization of Newton' second law. Following another path, considering Hamilton’s principle with a stochastic advection constraint on Lagrangian fluid trajectories, Holm (2015) also proposed a consistent stochastic setting, i.e., stochastic advection by Lie transport (SALT). In particular, this derivation preserves Kelvin's circulation. Similarities and differences between these different stochastic frameworks are discussed in Resseguier et al. (2020).

From another perspective, the classical optimal transport theory suggests that the difference of two smooth positive density fields (ρ1 and ρ2) on a bounded domain Ω can be described by a transportation map: T:ΩΩ. More specifically, there exists a diffeomorphism T of Ω to transform ρ1 to ρ2 under the diffeomorphism T with a minimal cost. Broadly speaking, T can be interpreted as how much ρ2 differs from ρ1, and T operates as a location correction. Indeed, starting from the same initial condition ρ(t), suppose that ρ1=ρmodel(t+Δt) is the model forecast and ρ2=ρ(t+Δt) is the true forecast. The additional uncertainty of ρ1 due to model error can then be represented by a random T. It further suggests that the inflation of uncertainty can be achieved by casting a random T on each ensemble member/particle.

Motivated by such an optimal transport perspective and the concept of “location uncertainty”, proposed in Mémin (2014), a new strategy can thus seek to design a well-constrained “location perturbation” of the state variable.

Specifically, the idea of covariance inflation can be informally generalized to physical fields that are not always positive, i.e., physical fields other than the density field. Mathematically, a density field ρ is naturally associated with a differential n form θρ, where n=dimΩ. The statement “ρ1 transforms to ρ2 under the diffeomorphism T” is equivalent to the mathematical relation θρ1=T*θρ2, where T*, acting on all differential forms, is the pull-back operator induced by T or, equivalently, θρ2=(T-1)*θρ1. Therefore, a random T (or equivalently, T−1) could induce a perturbation of any differential k form.

To implement a physically constrained perturbation scheme, the state variable S under consideration must then be associated with some differential form θ, i.e., construct a one-to-one correspondence between snapshots of S and snapshots of θ. Note that this can be generalized to other types of tensor fields.

It will be demonstrated (Sect. 5) that it is indeed sometimes helpful to choose θ to be a contravariant tensor field other than differential forms. Yet, it must be stressed that associating the state variable S with a differential form θ is a key important step.

Correspondingly, at each forecast time step, the covariance inflation should follow four steps.

  • Step 1: find θ(t) based on S(t).

  • Step 2: construct a random diffeomorphism T:ΩΩ.

  • Step 3: replace θ(t) with T*θ(t) and calculate S(t) based on the new value of θ(t).

  • Step 4: calculate the forecast S(tt) based on the new value of S(t).

Associating S with different θ shall then be constrained by different conservation laws for the perturbation scheme. More precisely, certain physical quantities are conserved in step 3, no matter how T is constructed or realized in step 2. We emphasize that the conservation law of the perturbation scheme merely depends on the choice of θ but is independent of the dynamics of the original deterministic system. A resulting stochastic partial differential equation (SPDE) will conserve a given quantity only if both the perturbation scheme and the original deterministic system conserve that quantity. We also remark that this scheme can not conserve all the physical quantities at the same time unless additional constraints upon the parameters are imposed. Hence the users must choose by themselves which physical quantity to conserve.

In summary, the key perspective of this paper is that the displacement vector field of physical state variables should be determined by the tensor fields associated with the physical fields. The advantage of this perspective is that certain physical quantities can be conserved while applying a displacement vector field to transfer the original physical field. A direct application of this perspective is the physically constrained covariance inflation scheme proposed in this paper. When the tensor fields are positive n forms on a bounded domain that have the same total mass, Brenier's theorem shows that the “optimal” displacement vector field exists and is unique, for a given cost function. In this case, the optimality of displacement vector field is well-defined. In other cases, the issue of “optimality” together with the existence and uniqueness of the optimal displacement vector field need to be carefully explored. We reserve this for future study.

This paper is organized as follows. Section 2 is a brief introduction of optimal transport theory. In Sect. 3 we present the perturbation scheme in detail, including the motivation, the specific techniques in derivation, and several examples. In Sect. 4, the resulting perturbation scheme is then compared with the stochastic advection by Lie transport (SALT) equations (Holm2015) and the location uncertainty (LU) equations (Mémin2014). For properly chosen θ and Tt, it is demonstrated that both SALT and LU settings are recovered within the proposed framework. To illustrate our purpose, a stochastic version of the thermal shallow water equation is then derived in Sect. 5. A final conclusion and discussion is given in Sect. 6.

The conventions of notation are as follows:

  • The letter i only refer to the ith independent Brownian motion. The letters p, q, j, and k refer to the components if p, q, j, and k are upper indices.

  • For Einstein's convention on summation (applies to all indices except i and j), if p is shown in both upper and lower indices, then the summation over p automatically applies.

  • Summation over i, j, and p automatically applies in all equations. For instance, ei refers to iei, and yj refers to jyj.

2 Monge's formulation of optimal transport problem and Brenier's answer

Hereafter we briefly summarize some necessary concepts and results in optimal transport theory. Let Ω be a bounded domain in a n-dimensional Euclidean space.

Definition 2.0.1 (Monge's optimal transport problem). Given the cost function c(x,y)0 and probability measures μ,νP(Ω),

(1) minimize  M ( T ) = Ω c ( x , T ( x ) ) d μ ( x )

over μ measurable maps T:ΩΩ subject to ν=Tno.μ.

Here the probability measures μ and ν are interpreted as mass distributions with total mass equal to 1. The map T is called a transport plan which moves the mass dμ(x) at location x to location T(x), with the cost c(x,T(x)) per unit of mass. Therefore the quantity 𝕄(T) is the total cost of the transport plan T. The constraint ν=Tno.μ is interpreted as T transporting the mass distribution μ to the mass distribution ν. In the case that T is a diffeomorphism and that both ν and μ have smooth densities, i.e., assuming that dν(x)=f(x)dnx and dμ(x)=g(x)dnx for some smooth functions f,g on Ω,

(2) ν = T no . μ g ( x ) = f ( T ( x ) ) | J T ( x ) | ,

where JT(x) refers to the Jacobian matrix of T at x. If we associate ν and μ with differential n forms θν=fdx1dxn and θμ=gdx1dxn, then

(3) ν = T no . μ θ μ = T * θ ν .

Brenier (1991) proved the existence and uniqueness of the solution to Monge's optimal transport problem for c(x,y)=|x-y|2. To better illustrate how optimal transport theory motivates us, we consider the following simplified version of Brenier's theorem.

Theorem 1.
Brenier, simplified version

Let μ and ν be measures with bounded smooth density on a bounded domain Ω⊂ℝn. Let c(x,y)=|x-y|2. Then there is a convex function ϕ:ΩR, such that (ϕ)no.μ=ν. And ϕ:xx+ϕ|x, defined μ almost everywhere, is the unique solution to Monge's optimal transport problem.

The convexity of ϕ implies that the map ϕ is one to one. Broadly speaking, Brenier's theorem implies that the difference of two density fields can be represented by a transportation map T.

3 The perturbation scheme

Consider a compressible flow on a bounded domain Ω. Let ρ denote the density field. Let ρmodel(tt) and ρtrue(tt) be the model forecast and the true forecast starting from the same density field at time t. If we assume that the model forecast and the truth have the same total mass, Brenier's theorem says that there exists a diffeomorphism T:ΩΩ, so that

(4) ρ true ( x , t + Δ t ) = ρ model ( T ( x ) , t + Δ t ) J T ( x ) .

Note that the transportation T hereinafter is equivalent to the mapping T−1 used in the Introduction. Equation (4) can further be written in terms of differential form. Let θρ=ρdx1dxn, then Eq. (4) is equivalent to

(5) T * θ ρ model ( t + Δ t ) = θ ρ true ( t + Δ t ) .

For general differential forms θ, it is unclear whether a diffeomorphism T always exists that satisfies Eq. (5). However, Eq. (5) provides us with a tool for covariance inflation by constructing a random T at every infinitesimal time step.

At each time step we construct a small perturbation T:

(6) T t ( x ) = x + a ( t , x ) Δ t + e i ( t , x ) Δ η i ( t ) ,

where a(t,x),ei(t,x)Rn, Δηi(t)N(0,Δt) is a random number. Essentially, Tt(x)−x can be interpreted as a “location error” caused by the model error. In Eq. (6), a(t,xt refers to a systematic location error, and eiΔηi refers to a random location error.

Stated in the Introduction, the state variable S must first be associated with a differential form θ. Then at every time step, Tt induces a perturbation of θ(t) by θ(t)Tt*θ(t). It hence induces a perturbation of the state variable S(t). A forecast is then performed based on the perturbed state. Consequently, this perturbation scheme derives an SPDE from the original PDE.

This procedure can also be generalized to other types of tensor fields. We refer to Chern et al. (1999) for a rigorous definition of the tensor fields and the wedge algebra. For instance, we may choose θ=ρx1xn, where {xi}in forms a global basis of the tangent field. Then Tt induces a perturbation of θ by θ(t)Tt*θ, where Tt* is the push-forward operator induced by Tt. In Sect. 5, such a generalization is found useful in the example of thermal shallow water equation.

Remark 1. When θ is a mixture of covariant and contravariant tensor fields, the perturbation scheme is slightly more complicated. Assume that Tt:Ω1Ω2 is a diffeomorphism, and θ=vω, where v and ω are contravariant or covariant tensor fields respectively on Ω2. Then Tt*ω is a covariant tensor field on Ω1. However, Tt can not directly induce a contravariant tensor field on Ω1. In order to get a tensor field on Ω1, we consider Tt-1:Ω2Ω1 and apply the push-forward operator on v. In sum, we may define the perturbation to be

(7) θ ( t ) ( ( T t - 1 ) * v ) ( T t * ω ) .

Appendix A derives the expression of Tt-1 directly from the expression of Tt.

3.1 Calculation of Tt*θ (or Tt*θ)

A rigorous mathematical definition and calculation of Tt and Tt* should be given in terms of stochastic flows of diffeomorphisms and its Lie derivatives. A brief discussion of the relationship between Tt* and the Lie derivative is given in Sect. 4.1. We further refer to Leon (2021) for a detailed definition of the Lie derivative. Yet, to rapidly assess Tt*θ (or Tt*θ), a Taylor expansion and Ito^'s lemma can be used.

Given coordinates (x1,,xn), when θ is a differential k form, it can be written as

(8) θ = i 1 < < i k f i 1 , , i k d x i 1 d x i k .

Then

(9) T t * θ = i 1 < < i k f i 1 , , i k ( T t ( x ) ) T t * ( d x i 1 d x i k ) .

Given in Appendix B, a Taylor expansion and Itô's lemma are applied to expand Tt*θ, leading us to compactly write

(10) T t * θ = θ + M ( θ ) Δ t + N i ( θ ) Δ η i ,

for some differential k forms ℳ(θ) and 𝒩i(θ). Hereafter, several examples of Tt*θ are presented.

The full derivation of these examples is skipped. We further express all the terms in coordinates. For instance, we replace 〈∇fa with ajxjf, where, by convention of notation, ajxjf=jajfxj. Similarly, eiHfei is replaced with eipeiqxpxqf.

Remark 2. When θ=fxi1xik is a contravariant tensor field,

(11) T t * θ = f ( T t - 1 ( x ) ) T t * x i 1 x i k .

The formula for Tt-1 is derived in Appendix A. Then the expression of f(Tt-1(x)), Tt*xi1xik and Tt*θ can be derived step by step in a similar way to that in the Appendix B.

Example 3.1.1 When θ=f is a function (differential 0 form),

(12) ( T t * θ ) = f + ( a j x j f + 1 2 e i p e i q x p x q f ) Δ t + e i p x p f Δ η i .

Example 3.1.2 When θ=dx1dx2dxn,

(13) T t * θ = { 1 + ( x p a p + 1 2 J i ) Δ t + x p e i p Δ η i } θ ,

where Ji=xpeipxqeiq-xpeiqxqeip.

Example 3.1.3 When θ=fdx1dxn,

(14) T t * θ = { f + ( ( x p a p + 1 2 J i ) f + ( a p + e i p x q e i q ) x p f + 1 2 e i p e i q x p x q f ) Δ t + ( x p e i p f + e i p x p f ) Δ η i } d x 1 d x n .

Example 3.1.4 When θ=fjdxj (note that by the convention of notation, fjdxj=j=1nfjdxj),

(15) T t * θ = { f j + ( a p x p f j + 1 2 e i p e i q x p x q f j + x j a p f p + x j e i p e i q x q f p ) Δ t + ( e i p x p f j + x j e i p f p ) Δ η i } d x j .

Example 3.1.5 When θ=fx1xn,

(16) T t * θ = { f + ( ( x p a p + 1 2 J i ) f + ( - ( a p + e i p x q e i q ) + x q e i p e i q ) x p f + 1 2 e i p e i q x p x q f ) Δ t + ( x p e i p f - e i p x p f ) Δ η i } x 1 x n .

3.2 Derivation of the SPDE

Suppose S is the full state variable of the dynamical system:

(17) S t = g ( S ) .

Let f be a component or a collection of components of S. We then associate f with a differential form θ in the perturbation scheme; i.e., there is an invertible map that maps the space of f to the space of θ, such that ℱ(f)=θ. In the examples in this paper, the corresponding map is obvious. When f refers to a scalar quantity on the domain. We can choose to associate a differential n form θ=fdx1dxn with f, as in Example 3.1.3, an n vector θ=fx1xn as in Example 3.1.5, or a differential 0 form (function) θ=f. When f refers to a vector-valued function f=(f1,,fn), we can associate the differential 1 form f=f1dx1++fndxn with f. It is not hard to see that is obvious once the type of tensor field is chosen. Suppose the propagation equation for f is

(18) d f = g f ( S ) d t .

This implies a propagation equation for θ:

(19) d θ = g θ ( S ) d t .

The discrete-time perturbed forecast at each time step consists of the following two steps:

(20)θ̃(t+Δt)=θ(t)+gθ(S(t))Δt(21)θ(t+Δt)=Tt*θ̃(t+Δt),

with Tt*θ̃(t+Δt)=θ̃(t+Δt)+M(θ̃(t+Δt))Δt+Ni(θ̃(t+Δt))Δηi+o(Δt) for some differential forms M(θ̃) and Ni(θ̃).

As the physical PDE (Eq. 20) is deterministic, θ̃(t+Δt)-θ(t) scales in Ot). Indeed, there is no noise term to induce a scaling in O(Δt). Therefore, it can be assumed that there exists C>0 so that M(θ̃(t+Δt))-M(θ(t))<CΔt and Ni(θ̃(t+Δt))-Ni(θ(t))<CΔt, for Δt small enough. Then

(22) T t * θ ̃ ( t + Δ t ) = θ ̃ ( t + Δ t ) + ( M ( θ ( t ) ) + O ( Δ t ) ) Δ t + ( N i ( θ ( t ) ) + O ( Δ t ) ) Δ η i + o ( Δ t ) = θ ̃ ( t + Δ t ) + M ( θ ( t ) ) Δ t + N i ( θ ( t ) ) Δ η i + o ( Δ t ) .

Therefore,

(23) θ ( t + Δ t ) = θ ( t ) + g θ ( S ( t ) ) Δ t + M ( θ ( t ) ) Δ t + N i ( θ ( t ) ) Δ η i + o ( Δ t ) .

This suggests the following stochastic propagation equation for θ:

(24) d θ = g θ ( S ) d t + M ( θ ) d t + N i ( θ ) d η i .

Since there is a one-to-one correspondence between θ and f, Eq. (19) also suggests a stochastic propagation equation for f, which can be written as

(25) d f = g f ( S ) d t + M f ( f ) d t + N i f ( f ) d η i .

We denote the additional terms in Eq. (25) by

(26) d s f := M f ( f ) d t + N i f ( f ) d η i .

Then Eq. (25) can be written as

(27) d f = g f ( S ) d t + d s f .

Remark 3. (dsf is not directly related to the original dynamics). dsf is completely determined by Tt*θ but is not directly related to the original dynamics Eq. (18). Therefore, once the expression of T in Eq. (6) and the choice of θ are determined, the perturbation term dsf is prescribed. However, the choice of θ is up to the user and may then be related to the original dynamics.

Remark 4. In particular, there is no noise in the original dynamics (Eq. 18) which could be correlated with the noise of the resulting stochastic scheme (21). That is why the Itō lemma directly applies in the Taylor development (B4) of f and then in the Eq. (22), leading to Eq. (23) and the final SPDE. Indeed, unlike the Itō–Wentzell formula (Kunita1997) – a cornerstone of the LU scheme – there is no additional cross-correlation term between Tt* and θ̃(t+Δt). The final SPDE (24) makes the link between the solution θ and the Brownian motions ηi clear. But, at a given time step t, since Eq. (18) has no noise term, θ̃(t+Δt) is correlated with the tηi(t) for t<t only and is independent of the new Brownian increment Δηi(t) generating Tt. Therefore, there is no cross-correlation term between Tt* and θ̃(t+Δt).

Remark 5. For a numerical implementation of our stochastic scheme, the time integration of the SPDE (25) may require a smaller time step Δt than the time integration of the deterministic PDE (18) for two reasons. First, the available SDE (stochastic differential equation) time integration schemes are often less accurate than their deterministic counterparts. Secondly, the modified dynamics may involve additional Courant–Friedrichs–Lewy (CFL) constraints, related to for instance noise-induced diffusion.

Example 3.2.1. When θ=f, Example (3.1.1),

(28) T t * θ - θ = ( a p x p f + 1 2 e i p e i q x p x q f ) Δ t + e i p x p f Δ η i .

This implies that

(29) d s f = ( a p x p f + 1 2 e i p e i q x p x q f ) d t + e i p x p f d η i .

To physically interpret this equation, we rewrite

(30) d s f d t + V p x p f = x p 1 2 e i p e i q x q f ,

where

(31) V p = - a p + 1 2 x q ( e i p e i q ) - e i p d η i d t .

Terms of advection and diffusion are recognized. The matrix 12eieiT is symmetric and non-negative and represents a diffusion matrix. The pth component of the advecting velocity Vp is composed of the drift ap, a correction 12xq(eipeiq), and a stochastic advecting velocity -eipdηidt.

If the original deterministic PDE (18) is an advection–diffusion equation, with advecting velocity u and diffusion coefficient D, the final SPDE to simulate (Eq. 25) is now a stochastic advection–diffusion equation, with advecting velocity u+V and diffusion matrix DId+12eieiT:

(32) d f d t + ( u p + V p ) x p f = x p ( D δ p q + 1 2 e i p e i q ) x q f .

This type of SPDE appears in the LU framework, detailed in Sect. 4.2.1.

Example 3.2.2. When θ=fdx1dxn, Example 3.1.3,

(33) T t * θ - θ = { ( ( x p a p + 1 2 J i ) f + ( a p + e i p x q e i q ) x p f + 1 2 e i p e i q x p x q f ) Δ + ( x p e i p f + e i p x p f ) Δ η i } d x 1 d x n .

This implies that

(34) d s f = ( ( x p a p + 1 2 J i ) f + ( a p + e i p x q e i q ) x p f + 1 2 e i p e i q x p x q f ) d t + ( x p e i p f + e i p x p f ) d η i .

Rewritten, it leads to

(35) d s f d t + x p V ̃ p f = x p 1 2 e i p e i q x q f ,

where

(36) V ̃ p = V p - ( e i p x q e i q ) = - a p + 1 2 ( x q e i p e i q - e i p x q e i q ) - e i p d η i d t .

Again an advection–diffusion equation is recognized but of a different nature. Indeed, as expected for an n form, the PDE is similar to a density conservation equation. Moreover, the advecting drift is slightly different to take into account the cross-correlations between f(Tt(x)) and Tt*(dx1dxn).

Recall, in fluid dynamics, that the Reynolds transport theorem provides an integral conservation equation for the transport of any conserved quantity within a fluid, connected to its corresponding differential equation. The Reynolds transport theorem is central to the LU setting. The present example thus already outlines a closed link between the proposed perturbation approach and the LU formulation. Accordingly, the SPDE (35) naturally appears in the LU framework, as detailed in Sect. 4.2.2.

Example 3.2.3. When θ=fjdxj, Example 3.1.4,

(37) T t * θ - θ = { ( a p x p f j + 1 2 e i p e i q x p x q f j + x j a p f p + x j e i p e i q x q f p ) Δ t + ( e i p x p f j + x j e i p f p ) Δ η i } d x j .

For each j, the coefficients of dxj in Tt*θ-θ and those in θ can be compared, to lead to

(38) d s f j = ( a p x p f j + 1 2 e i p e i q x p x q f j + x j a p f p + x j e i p e i q x q f p ) d t + ( e i p x p f j + x j e i p f p ) d η i .

Regrouping the terms for physical interpretation, it reads

(39) d s f j d t + V p x p f j + x j - a p - e i p d η i d t f p - x j e i p e i q x q f p = x p ( 1 2 e i p e i q ) x q f j .

Two additional terms complete the advection–diffusion term. The first one, xj-ap-eipdηidtfp, is reminiscent of the additional terms appearing in SALT momentum equations (Holm2015; Resseguier et al.2020). The second term, -xjeipeiqxqfp, comes from the cross-correlation in Itô notation.

Example 3.2.4. When θ=fx1xn, Example 3.1.5,

(40) T t * θ - θ = { ( ( x p a p + 1 2 J i ) f + ( - ( a p + e i p x q e i q ) + x q e i p e i q ) x p f + 1 2 e i p e i q x p x q f ) Δ t + ( x p e i p f - e i p x p f ) Δ η i } x 1 x n .

This implies

(41) d s f = ( ( x p a p + 1 2 J i ) f + ( - ( a p + e i p x q e i q ) + x q e i p e i q ) x p f + 1 2 e i p e i q x p x q f ) d t + ( x p e i p f - e i p x p f ) d η i .

It can then be verified that

(42) d s f d t + x p V ̃ p f - V ̃ ̃ p x p f = x p ( 1 2 e i p e i q ) x q f ,

where

(43) V ̃ ̃ p = V ̃ p - ( e i p x q e i q ) = V p - 2 ( e i p x q e i q ) .

We recognize a diffusion term, xp(12eipeiq)xqf, a velocity divergence term, xpṼpf, and the advection term, -Ṽ̃pxpf. The divergence term is comparable to one appearing in the density equation.

However, the velocity fields appearing in the divergent and advecting terms do not coincide. Indeed, they are even opposite for divergence-free noise (xqeiq=0). This type of equation may appear uncommon but will be shown useful when applied to randomized thermal shallow water equations.

3.3 Conservation laws related to dsf

A major advantage of the proposed perturbation scheme is to possibly prescribe θ to ensure that certain quantities are conserved. Define the discrete time version of dsf as

(44) Δ s f = M f ( f ) Δ t + N i f ( f ) Δ η i .

In general, conservation laws can be derived from the following two identities about the pull-back operator:

(45)(Tt*θ1)(Tt*θ2)=Tt*(θ1θ2)(46)dTt*θ=Ttdθ,

where d refers to the differential operator acting on differential forms. Hereafter, we present how to derive the conservation laws for two particular examples.

Example 3.3.1. Suppose θ1=fdx1dxn and define

(47)θ^1=Tt*θ1(48)f^=f+Δsf.

Then θ^1=f^dx1dxn. Therefore,

(49) Ω f ^ d x 1 d x n = Ω θ ^ 1 = Ω T t * θ 1 = T t ( Ω ) θ 1 = Ω θ 1 = Ω f d x 1 d x n .

Equation (49) implies that the total integral of f is not changed by the perturbation scheme. Next, suppose that θ2=g is a function. Similarly, we define

(50)θ^2=Tt*θ2(51)g^=g+Δsg.

Applying Eq. (45),

(52) Ω f ^ g ^ d x 1 d x n = Ω θ ^ 1 θ ^ 2 = Ω T t * ( θ 1 θ 2 ) = T t ( Ω ) θ 1 θ 2 = Ω θ 1 θ 2 = Ω f g d x 1 . d x n .

The total integral of fg is thus also conserved by the perturbation scheme. Similarly for any integer m≥0, fgm is conserved by the perturbation scheme.

Example 3.3.2. Suppose n=2 and θ=udx+vdy, where u=(u,v) is the velocity field. The vorticity ω=xv-yu corresponds to the differential 2 form dθ:

(53) d θ = ω d x 1 d x 2 .

Define θ^:=Tt*θ=u^dx1+v^dx2 and ω^=xv^-yu^. Then dθ^=ω^dx1dx2, and

(54) Ω ω ^ d x 1 d x 2 = Ω d θ ^ = ω d T t * θ = Ω T t * d θ = T t ( Ω ) d θ = Ω ω d x 1 d x 2 .

Therefore, the vorticity is conserved by the perturbation scheme.

Example 3.3.3. Suppose n=3 and θ=udx+vdy+wdz, where u=(u,v,w) is the velocity field. The vorticity ω=(yw-zv,zu-xw,xv-yu) corresponds to the differential 2 form dθ:

(55) d θ = ( y w - z v ) d y d z + ( x v - y u ) d z d x + ( x v - y u ) d x d y .

The helicity Θ=u(yw-zv)+v(xv-yu)+w(xv-yu) corresponds to the differential 3 form:

(56) d θ θ = ( u ( y w - z v ) + v ( x v - y u ) + w ( x v - y u ) ) d x d y d z .

Similarly, we define Θ^ by dθ^θ^=Θ^dxdydz. Then,

(57) Ω Θ ^ d x d y d z = Ω d θ ^ θ ^ = Ω ( d T t * θ ) ( T t * θ ) = Ω ( T t * d θ ) ( T t * θ ) = Ω T t * ( d θ θ ) = T t ( Ω ) d θ θ = Ω Θ d x d y d z .

Hence, in this case, the total amount of helicity is conserved.

Example 3.3.4. Suppose that θ1=fdx1dxn and that θ2=gx1xn. There exists a pairing 〈〉 for the differential n forms and the contravariant n vectors; i.e., θ1θ2〉=fg is a function on Ω. Define

(58)θ^1=Tt*θ1=f^dx1dxn(59)θ^2=(Tt-1)*θ2=g^x1xn.

Then we have

(60) f ^ g ^ ( T t - 1 ( x ) ) = θ ^ 1 θ ^ 2 | T t - 1 ( x ) = θ 1 θ 2 | x = f g ( x ) ,

and

(61) Ω f ^ 2 g ^ d x 1 d x n = Ω θ ^ 1 θ ^ 2 θ 1 = Ω θ 1 θ 2 θ 1 = Ω f 2 g d x 1 d x n .

Remark 6 (The conservation law of the perturbation scheme is independent of the conservation law of the original dynamical system). The derivation of Eqs. (49), (52), (54), (57), and (61) is based on the generic properties of the pull-back and push-forward operator of tensor fields. Since the choice of θ is not directly determined by the dynamical system, the conservation law of the perturbation scheme is independent of the original dynamical system. Recall that the perturbed forecast consists of two steps: Eqs. (20) and (21). The conservation law of the perturbation scheme implies that certain quantities are conserved in the second step. On the other hand, the original dynamical system (Eq. 20) might enjoy some other conservation law. If a quantity is conserved by both the original dynamical system and the perturbation scheme, then this quantity must be conserved by the final stochastic PDE. If a quantity is conserved by only one of Eqs. (20) and (21), then it can not be concluded that this quantity is conserved by the final SPDE.

4 Comparison with other perturbation schemes

In this section, we demonstrate that both the stochastic advection by Lie transport (SALT) equation (Holm2015) and the location uncertainty (LU) equation (Mémin2014; Resseguier et al.2017a, 2020) can be recovered using the proposed perturbation scheme and properly choosing θ and the parameters a,ei.

Note that the original LU paper (Mémin2014) assumed strong smoothness properties (finite variations in time) of the stochastic Navier–Stokes equations solution, to eventually remove the noises terms of this original Navier–Stokes equations under location uncertainty. Since Resseguier et al. (2017a, b), this assumption was removed, in order to keep the important noise terms. Accordingly, the original deterministic LU Navier–Stokes equations from Mémin (2014) have been referred to as pseudo-stochastic Navier–Stokes equations (Resseguier et al.2021). Being deterministic, these pseudo-stochastic equations cannot be recovered by our stochastic scheme, whereas we can recover the stochastic LU Navier–Stokes equations that originated from Resseguier et al. (2017a).

4.1 Comparison with SALT equation

The original SALT equation (Holm2015) is derived based on a stochastically constrained variational principle δS=0, for which

(62) S ( u , q ) = ( u , q ) d t d q + L d x t q = 0 ,

where ℓ(u,q) is the Lagrangian of the system, 𝔏 is the Lie derivative, and xt(x) is defined by (using our notation)

(63) x t ( x ) = x 0 ( x ) + 0 t u ( x , s ) d s - 0 t e i ( x ) d η i ( s ) ,

in which u is the velocity vector field, and the means that the integral is defined in the Stratonovich sense, instead of in the Itô sense. Hence, dxt=u(x,t)dt-eidηi refers to an infinitesimal stochastic tangent field on the domain. Broadly speaking, we can express dxt=Tt(x)-x+udt. Note the difference between Itô's notation and Stratonovich's notation; i.e., eidηieidηi. Our expression of Tt essentially follows Itô's notation, and Tt(x)x-eiΔηi in this subsection. Instead, it becomes Tt(x)=x+12eipxpeiΔt-eiΔηi.

In the second part of Eq. (62), q is assumed to be a quantity advected by the flow. q can correspond to any differential form that is not uniquely determined by the velocity (since the SALT equation for the velocity is usually determined by the first equation of Eq. 62). In Holm (2015), the Lie derivative Ldxtq is calculated using Cartan's formula:

(64) L d x t q = d ( i d x t q ) + i d x t d q .

Essentially, the Lie derivative Ldxtq corresponds to Tt*q-q+fq(S)dt, if we assume that the deterministic forecast of q is simply the advection of q by u. More generally, Ldxt-udtq=Tt*q-q. Therefore, the SALT equation for q is the same as our equation for q. We remark that Cartan's formula can not be directly applied to calculate the Lie derivative if the expression of dxt is in Itô's notation.

The SALT equation regarding the velocity u comes from the first equation of Eq. (62). For most cases, the velocity u is associated with the momentum, a differential 1 form m=ujdxj=u1dx1++undxn. In the examples discussed in Holm (2015), it is observed that, when the Lagrangian includes the kinetic energy, the stochastic noise contributes a term Ldxtθ, where θ is a differential 1 form related to the momentum 1 form. For instance, θ=m in the example of “Stratonovich stochastic Euler–Poincaré flow” in Holm (2015), and θ=m+Rjdxj in the example of “stochastic Euler–Boussinesq equations of a rotating stratified incompressible fluid” in Holm (2015). Already pointed out, the operator Ldxt is closely related to Tt*, and the momentum equation in SALT can be derived using our proposed scheme by properly choosing θ.

Holm (2015) requires that q is a differential form since Cartan's formula is only useful for differential forms q. This restriction can be relaxed by employing the original definition of Lie derivative with respect to a deterministic/stochastic flow of diffeomorphism discussed in Leon (2021), so that Ldxtq can be generalized to the case where q is a mixed-tensor field. This corresponds to Eq. (7) of the current paper.

Compared with Holm (2015) and Leon (2021), the proposed perturbation approach seems more flexible and does not have to rely on the Lagrangian mechanics. In particular, the velocity field can be associated with other tensor fields than the momentum 1 form. The perturbation, not directly related to the physics, can then be applied to any PDE. Moreover, our approach provides a new interpretation of Ldxt-udt in terms of the optimal transportation associated with the infinitesimal forecast error at each time step. This interpretation certainly suggests practical numerical methods to infer a,ei. Given a long sequence of reanalysis data or simulated high-resolution data, the one-step forecast can be evaluated using the low-resolution model, with the high-resolution state at each time step being the initial condition. Tt is then estimated at each time step by comparing the low-resolution forecast and the high-resolution forecast. Finally, a and ei could be learned from these samples of Tt.

4.2 Comparison with the LU equation

Mentioned above, the Reynolds transport theorem is central to the LU setting, and we already outlined a closed link between the proposed perturbation approach and the LU formulation. This link – related to differential n forms – will be described precisely later in this subsection. But, before this, we focus on another key ingredient of LU: the stochastic material derivative of functions (differential 0 forms).

4.2.1 0 forms in the LU framework

Dropping the forcing terms, the LU equation for compressible and incompressible flow reads (Resseguier et al.2017a)

(65)tf+wf=12af-σB˙f(66)w=w-12(a)+σ(σ),

where f can be any quantity that is assumed to be transported by the flow, i.e., Df/Dt=0, where D/Dt is the Itō material derivative. For instance, f could be the velocity (dropping forces in the SPDE), the temperature, or the buoyancy. Compared to SALT notations, eidηi is denoted σdB=σidBi. We refer to Resseguier et al. (2020, Appendix A) for the complete table of SALT–LU notation correspondences. Derived in Resseguier (2017, Appendix 10.1) and Resseguier et al. (2021, 6.1.3), we can rewrite it as

(67)tf+wSf=12(σi)(σif)-(σB˙)f,(68)=-(σB˙)f,(69)wS=w+wSc(70)wSc=-12(a)+12σ(σ),(71)=-12(σi)σi,

where σB˙ is the Stratonovich noise of the SPDE, and w and wS (denoted u in the SALT framework) are the Itō drift and the Stratonovich drift of the fluid flow respectively. Separating the terms of the SPDE related to the deterministic dynamics from the term associated with the stochastic scheme results in

(72) d LU f = g f ( S ) d t + d s LU f ,

where

(73)gf(S)=-wf(74)dsLUf=-wScfdt+12(σi)(σif)dt-(σdB)f.

Terms in Eqs. (65) and (66) translate to our notation in the following way:

-wScfdt=12eiqxqeipxpf12(σi)(σif)=12eipxp(eiqxqf)=12(eipxpeiqxqf+eipeiqxpxqf)-σdBf=eipxpfdηi.

Hence,

(75) d s LU f = ( e i q x q e i p x p f + 1 2 e i p e i q x p x q f ) d t + e i p x p f d η i .

Recall that Eq. (29) can be obtained by our perturbation scheme, while f is associated with a differential 0 form. Direct calculation means that Eq. (75) coincides with Eq. (29) when

(76) T t ( x ) = x + e i q x q e i Δ t + e i Δ η i = x - w S c Δ t + ( - w S c Δ t - σ Δ B ) .

The LU equation can thus be derived by choosing θ=f and Tt by Eq. (76). At first glance, it does not seem straightforward to make such a choice. Nevertheless, it can be recognized that the term (-wScΔt-σΔB)=(12eiqxqeiΔt+eiΔηi) is the Itō noise and its Itō-to-Stratonovich correction. Hence, it corresponds to the Stratonovich noise ei∘dηi of the flow associated with Tt. The additional drift -wScΔt is different in nature. It is related to the advection correction wScf in the LU setting. Indeed, in the LU framework, the Itō drift, w, is seen as the resolved large-scale velocity. That is why, in this framework, the deterministic dynamics (74) involves the Itō drift, w. This is also the reason why, under the LU derivation, the advected velocity is assumed to be given by the Itō drift, w. It differs from the Stratonovich drift wS=w+wSc, used as an advection velocity in the SALT approach or in Mikulevicius and Rozovskii (2004) (where the Stratonovich drift is denoted u). Interested readers are referred to Resseguier et al. (2020, Appendix A) for a discussion on these assumptions. Note however that in all these approaches, the advecting velocity is always the Stratonovich drift. This can be seen, e.g., in the Stratonovich form of LU Eq. (68).

To also understand Eq. (76), the inverse flow can be considered. According to Appendix (A),

(77) T t - 1 ( x ) = x - e i Δ η i = x + σ Δ B .

Considering Tt to represent how much the model forecast differs from the true forecast at every time step, Tt-1 can be understood to represent how much the true forecast differs from the model forecast at each time step. Therefore, the LU equation can be derived using the proposed perturbation scheme, choosing θ=f and assuming that the true forecast differs from the model forecast by a displacement prescribed by Eq. (77).

4.2.2n forms in the LU framework

The LU physical justification relies on a stochastic interpretation of fundamental conservation laws, typically conservation of extensive properties (i.e., integrals of functions over a spatial volume) like momentum, mass, matter, and energy (Resseguier et al.2017a). These extensive properties can be expressed by integrals of differential n forms. For instance, the mass and the momentum are integrals of the differential n forms ρdx1dxn and ρwdx1dxn, respectively. In the LU framework, a stochastic version of the Reynolds transport theorem (Resseguier et al.2017a, Eq. 28) is used to deal with these differential n forms θ=fdx1dxn. Assuming an integral conservation ddtV(t)f=0 on a spatial domain V(t) transported by the flow, that theorem leads to the following SPDE:

(78) D f D t + ( w + σ B ˙ ) f = d d t 0 t D t f , 0 t σ B ˙ = ( σ i ) ( σ i ) T f ,

where D/Dt denotes the Itō material derivative. Here again, forcing terms are dropped for the sake of readability. This SPDE can be rewritten using the expression of that material derivative (Eqs. 9 and 10 of Resseguier et al.2017a):

(79)tf+(wSf)=12(af)+12(σi(σi)Tf)-(σB˙f)(80)=12(σi((σif))T)-(σB˙f)(81)=-(σB˙f).

The original deterministic equation and stochastic perturbation correspond to

(82)gf(S)=-(wf)(83)dsLUf=(-(wScf)+12(af)+12(σi(σi)Tf))dt-(σdBf)(84)=12aTdt-σdBf+12afdt.

Identifying a=σiσiT=eieiT and σB˙=-eidηi, Eq. (35) corresponds to Example 3.2.2 about n forms, with

(85) V ̃ = - a p + 1 2 ( x q e i p e i q - e i p x q e i q ) - e i p d η i d t = - 1 2 a T + σ B ˙ ;

i.e.,

(86) a p = x q ( e i p e i q ) - ( e i p x q e i q ) = e i q x q e i p .

Again, the remapping is obtained,

(87) T t ( x ) = x + e i q x q e i Δ t + e i Δ η i = x - w S c Δ t + ( - w S c Δ t - σ Δ B ) ,

previously derived for the differential 0 form in LU framework (Eq. 76). Therefore, the proposed approach also generalizes the LU framework for n forms and its capacity – given by the Reynolds transport theorem – to deal with extensive properties.

Remark 7. For incompressible flows, the LU equation further imposes that

(88) σ = 0 a = 0 .

Translating it into our notation, it reads

xpeip=0 for eachixpxq(eipeiq)=0.

Applying the result in Example 3.1.2, straightforward calculation means Eq. (88) is equivalent to Tt*θ=θ for θ=dx1dxn. Such a result was expected since constraints (Eq. 88) are obtained from the LU density conservation.

5 A stochastic version of thermal shallow water equation

In this section, the proposed approach is applied to derive a stochastic version of thermal shallow water equation. Another stochastic version of thermal shallow water equation can be found in Holm and Luesink (2021). The thermal shallow water equation is derived in Warneford and Dellar (2013):

(89)ht+(hu)=0,(90)Θt+(u)Θ=-κ(hΘ-h0Θ0),(91)ut+(u)u+fz^×u=-(hΘ)+12hΘ.

This model can be used to describe a two-layer system under equivalent barotropic approximation. The upper layer is active but with a spatiotemporal varying density ρ(x,t), while the lower layer is quiescent with a fixed constant density ρ0. The state variable h represents the height of the active layer, and Θ=g(ρ0-ρ)/ρ0 is the density contrast. u is the averaged horizontal velocity of the active layer at each column. Note that ρ<ρ0 (hence Θ>0) in the scenario of equivalent barotropic approximation (Warneford and Dellar2013).

Stated in Warneford and Dellar (2013), the following physical quantities are conserved up to the forcing.

(92)Total energy: E=Ω12(h|u|2+h2Θ)d2x.(93)Total mass: M=Ωhd2x.(94)Total momentum: M=Ωhud2x.

The objective is thus to choose proper tensor fields θu,θh, and θΘ for the state variables u,h, and Θ, respectively, so that E,M, and M are conserved by the perturbation scheme. Again, it must be emphasized that the conservation law of the perturbation scheme does not directly imply that the same quantities are conserved by the final SPDE.

The domain is 2-dimensional. To conserve mass, the only choice for θh is θh=hdx1dx2, which is a differential 2 form. It plays the role of density. In order to conserve the momentum, we need the momentum to be a differential 2 form as well. Hence we must choose θu to be a function (differential 0 form). Therefore, the only choice for θu is θu=u. This choice of θu and θh implies that h|u|2 also corresponds to a 2 form |u|2θh. Hence the kinetic energy is automatically conserved by the perturbation scheme. This means that if we want E to be conserved, we must select θΘ so that h2Θ corresponds to a differential 2 form. Note that θh is already a 2 form. We must thus select θΘ so that hΘ corresponds to a function. The only choice for θΘ is the contravariant tensor θΘ=Θx1x2. In this case, hΘ corresponds to the differential 0 form θhθΘ〉=hΘ, where 〈,〉 in this section is the natural pairing of covariant n-tensor fields and contravariant n-tensor fields.

In sum, we have chosen the following tensor fields:

(95)θh=hdx1dx2(96)θuj=uj(forj=1,2)(97)θΘ=Θx1x2.

For

(98) T t ( x ) = x + a Δ t + e i Δ η i ,

we have

(99) T t - 1 ( x ) = x + ( - a + e i p x p e i ) Δ t - e i Δ η i .

Then Tt*θh, Tt*θu, and (Tt-1)*θΘ can be calculated following Examples 3.1.3, 3.1.1, and 3.1.5. This further implies dsh,dsu, and dsΘ, as shown in Examples 3.2.2, 3.2.1, and 3.2.4. Note that Tt-1 instead of Tt is applied to θΘ, as shown in Eq. (7). Finally, we end up with the following SPDE:

(100)dh=-(hu)dt+(h(xpap+12Ji)+apxph+12eipeiqxpxqh+xpheipxqeiq)dt+(hxpeip+xpheip)dηi(101)dΘ={-(u)Θ-κ(hΘ-h0Θ0)}dt+(Θ(-xpap+xp(xqeieiq)p+12Ji)+xpΘap+12eipeiqxpxqΘ-xpΘeipxqeiq)dt-(Θxpeip-xpΘeip)dηi(102)duj=-{(u)u-fz^×u-(hΘ)+12hΘ}jdt+(xpujap+12eipeiqxpxquj)dt+xpujeipdηi,

where Ji=xpeipxqeiq-xqeipxpeiq. And the total mass, total momentum and the total energy shall all be conserved by the perturbation scheme.

6 Conclusions

The starting point of this work was to question how the location of the state variable can be consistently perturbed, motivated by Brenier's theorem (Brenier1991) which suggests that the difference of two density fields can be represented by a transport map T. Noting that optimal transportation has a clean representation in terms of differential n forms, we proposed to perturb the “location” of the state variable S, at every forecast time step, by perturbing the corresponding differential k forms θ by θTt*θ, where Tt is a random diffeomorphism which deviates from the identity map infinitesimally.

Under this framework, we end up with a stochastic PDE of the state variable S in the form

(103) d S = f ( S ) d t + d s S ,

where f(S)dt is the incremental of S given by the original deterministic system. The term dsS is the additional stochastic incremental of S caused by the perturbation scheme.

In this paper, we generalize this scheme to a mixed type of tensor fields θ. A key point is indeed to link the state variable S with some tensor field θ. The choice of θ can then correspond to the conservation laws of certain quantities. We describe in detail how to calculate Tt* and Tt* and present results for several examples corresponding to different choices of θ. We also discussed about the conservation laws for these examples. We emphasize that Brenier's theorem merely serves as the motivation but not the theoretical foundation of the proposed scheme, since the optimality of the displacement vector field needs to be rigorously defined for general tensor fields θ that are not positive differential n forms.

Interestingly, similarities and differences can be studied between the proposed perturbation scheme and the existing stochastic physical SALT and LU settings (Holm2015; Mémin2014; Resseguier et al.2017a). In particular, both SALT and LU equations can be recovered using a prescribed definition of the random diffeomorphism Tt used by the perturbation scheme. For illustration, a stochastic version of the thermal shallow water equation is presented. Compared with SALT and LU settings (Holm2015; Mémin2014; Resseguier et al.2017a), the proposed perturbation scheme does not directly rely on the physics. Hence it is more flexible and can be applied to any PDE. Yet, the proposed derivation also provides interesting means to interpret the operator Ldxt-udt, appearing in the SALT equation. In terms of the optimal transportation, this term represents the infinitesimal forecast error at every forecast time step.

In order to apply the proposed perturbation scheme to any specific model, the parameters a and ei must be determined specifically. Hence it is necessary to learn these parameters from existing data, experimental runs, or additional physical considerations (Resseguier et al.2020, 2021). We anticipate this framework naturally provides a new perspective on how to learn these parameters. Likely, this task will invoke the need of numerical algorithms to estimate the optimal transportation map for general differential k forms or even mixed type of tensor fields. This will be the subject of future investigations.

Appendix A: Calculation of Tt-1

Suppose that

(A1) T t ( x ) = x + a Δ t + e i Δ η i .

We assume that Tt-1 has the following form of expression:

(A2) T t - 1 ( x ) = x + z Δ t + b i Δ η i .

Our goal is to find z and bi. Then we have

(A3) x = T t ( T t - 1 ( x ) ) = T t ( x + z Δ t + b i Δ η i ) = x + z Δ t + b i Δ η i + a | x + z Δ t + b i Δ η i Δ t + e i | x + z Δ t + b i Δ η i Δ η i .

Similar to the derivation in Sect. 3.1, we apply Taylor expansion and Itô's lemma and drop the terms of the higher-order infinitesimal:

(A4) a | x + a Δ t + b i Δ η i Δ t = a | x Δ t + o ( Δ t ) e i | x + z Δ t + b i Δ η i Δ η i = e i | x Δ η i + e i p b i p | x Δ t + o ( Δ t ) .

Therefore,

(A5) x = T t ( T t - 1 ( x ) ) = x + ( z + a + e i p b i p ) Δ t + ( b i + e i ) Δ η i + o ( Δ t ) .

This implies that

(A6)bi+ei=0(A7)z+a+eipbip=0.

Therefore,

(A8)bi=-ei(A9)z=-a+eipeip,

or equivalently,

(A10) T t - 1 ( x ) = x + ( - a + e i p e i p ) Δ t - e i Δ η i .
Appendix B: Derivation of Tt*θ

Given coordinates (x1,,xn), when θ is a differential k form, it can be written as

(B1) θ = i 1 < < i k f i 1 , , i k d x i 1 d x i k .

Since Tt* is linear, we may assume that

(B2) θ = f d x i 1 d x i k

for some 1i1<<ikn. Let Tt(x)=(Tt1(x),,Ttn(x)), then

(B3) ( T t * θ ) ( x ) = f ( T t ( x ) ) d T t i 1 d T t i k .

We calculate f(Tt(x)) and dTti1dTtik separately. We denote Δx=Tt(x)-x=aΔt+eiΔηi and Hf the Hessian matrix of f. At a given time t, f is assumed independent from the noise Δηi(t). Then

(B4)f(Tt(x))=f(x+Δx)=f(x)+fΔx+12(Δx)HfΔx+o((Δx)2)(B5)=f(x)+faΔt+eiΔηi+12eiHfei(Δηi)2(B6)+O((Δt)2)+O(ΔtΔηi)+o((Δt)2)+o((Δηi)2)+o(ΔtΔηi).

According to Itô's lemma, dηdη=dt, and we can replace ηi)2 with Δt. Hence,

(B7)f(Tt(x))=f(x)+faΔt+feiΔηi+12eiHfeiΔt+o(Δt)(B8)=f(x)+(fa+12eiHfei)Δt+feiΔηi+o(Δt).

Next,

(B9) T t * ( d x i 1 d x i k ) = d T t i 1 d T t i k = ( d x i 1 + d a i 1 Δ t + d e i i 1 Δ η i ) ( d x i k + d a i k Δ t + d e i i k Δ η i ) .

Note that daij and deiij refer to the spatial differentiation. Again, we apply the “discrete version” of Itô's rule ηi)2t and collect all the terms of order 𝒪(Δt) and 𝒪(Δηi):

(B10) T t * ( d x i 1 d x i k ) = d x i 1 d x i k + ( s = 1 k d x i 1 d a i s d x i k ) Δ t + ( s = 1 k d x i 1 d e i i s d x i k ) Δ η i + ( s < r d x i 1 d e i i s d e i i r d x i k ) Δ t + o ( Δ t ) .

According to the chain rule, dais=xjaisdxj, deiis=xjeiisdxj. Note that xjeiis refers to the isth component of xjei, where xjei=eixj and ei(x)∈ℝn is the ith basis vector field of Tt. Hence,

(B11) T t * ( d x i 1 d x i k ) = d x i 1 d x i k + ( s = 1 k x j a i s d x i 1 d x j d x i k ) Δ t + ( s = 1 k x j e i i s d x i 1 d x j d x i k ) Δ η i + ( s < r x j e i i s x l e i i r d x i 1 d x j d x l d x i k ) Δ t + o ( Δ t ) .

Combining Eqs. (B8) and (B11), with application of Itô's lemma, all terms of order ot) are then removed, to obtain

(B12) T t * θ = f ( T t ( x ) ) T t * ( d x i 1 d x i k ) = θ + { ( f a + 1 2 e i H f e i ) d x i 1 d x i n + s = 1 k f x j a i s d x i 1 d x j d x i k + ( s < r f x j e i i s x l e i i r d x i 1 d x j d x l d x i k ) + ( s = 1 k f e i x j e i i s d x i 1 d x j d x i k ) } Δ t + { f e i d x i 1 d x i k + s = 1 k f x j e i i s d x i 1 d x j d x i k } Δ η i + o ( Δ t ) .

To simplify Eq. (B12), wedge algebra is applied, and the high-order infinitesimal ot) is ignored. Accordingly, Tt*θ is more compactly written as

(B13) T t * θ = θ + M ( θ ) Δ t + N i ( θ ) Δ η i ,

for some differential k forms ℳ(θ) and 𝒩i(θ).

Data availability

No data sets were used in this article.

Author contributions

YZ contributed the main idea and mathematical derivation and wrote the first draft of the paper. VR contributed all the physical interpretations of the derived equations, a much more detailed introduction, and a more detailed comparison of the proposed scheme with the LU equation. BC contributed his insight and enthusiasm to this problem and worked on the writing of the draft. This work was done based on the fruitful discussion of all the three authors since a very early stage.

Competing interests

The contact author has declared that none of the authors has any competing interests.

Disclaimer

Publisher’s note: Copernicus Publications remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Acknowledgements

The authors would like to express their gratitude towards Wei Pan, Darryl Holm, Dan Crisan, Long Li, and Etienne Mémin for their patient explanation and insightful discussion. The research of Yicun Zhen was supported by the ANR Melody project when he was a postdoc at Ifremer. The research of Valentin Resseguier is supported by the company SCALIAN DS and by France Relance through the MORAANE project. The research of Bertrand Chapron is supported by ERC EU SYNERGY project no. 856408-STUOD and the ANR Melody project.

Financial support

This research has been supported by the Agence Nationale de la Recherche, Labex Immuno-Oncology (Melody), the European Research Council, H2020 (grant no. STUOD (856408)), the company SCALIAN DS and France Relance through the MORAANE project.

Review statement

This paper was edited by Jinqiao Duan and reviewed by Daniel Goodair and Baylor Fox-Kemper.

References

Anderson, J. L.: An adaptive covariance inflation error correction algorithm for ensemble filters, Tellus A, 59, 210–224, 2007. a

Berner, J., Shutts, G., Leutbecher, M., and Palmer, T.: A spectral stochastic kinetic energy backscatter scheme and its impact on flow-dependent predictability in the ECMWF ensemble prediction system, J. Atmos. Sci., 66, 603–626, 2009. a

Brenier, Y.: Polar factorization and monotone rearrangement of vector-valued functions, Commun. Pur. Appl. Math., 44, 375–417, 1991. a, b, c

Brzeźniak, Z., Capiński, M., and Flandoli, F.: Stochastic partial differential equations and turbulence, Math. Models Methods Appl. Sci., 1, 41–59, 1991. a

Buizza, R., Miller, M., and Palmer, T.: Stochastic representation of model uncertainties in the ECMWF Ensemble Prediction System, Q. J. Roy. Meteor. Soc., 125, 2887–2908, 1999. a

Chern, S. S., Chen, W. H., and Lam, K. S.: Lectures on Differential Geometry, World Scientific, https://doi.org/10.1142/3812, 1999. a

Daum, F. E. and Huang, J.: Curse of dimensionality and particle filters, 2003 IEEE Aerospace Conference Proceedings (Cat. No.03TH8652), 4, 4_1979–4_1993, Big Sky, MT, USA, 8–15 March 2003, https://doi.org/10.1109/AERO.2003.1235126, 2003. a

Flandoli, F.: The interaction between noise and transport mechanisms in PDEs, Milan J. Math., 79, 543–560, 2011. a

Frank, J. E. and Gottwald, G. A.: Stochastic homogenization for an energy conserving multi-scale toy model of the atmosphere, Physica D, 254, 46–56, 2013. a

Franzke, C., O'Kane, T., Berner, J., Williams, P., and Lucarini, V.: Stochastic climate theory and modeling, Wiley Interdiscip. Rev.: Clim. Change, 6, 63–78, https://doi.org/10.1002/wcc.318, 2015. a, b

Gugole, F. and Franzke, C.: Numerical development and evaluation of an energy conserving conceptual stochastic climate model, Math. Clim. Weather Forecast., 5, 45–64, https://doi.org/10.1515/mcwf-2019-0004, 2019. a

Harlim, J. and Majda, A. J.: Catastrophic filter divergence in filtering nonlinear dissipative systems, Commun. Math. Sci., 8, 27–43, 2010. a

Hasselmann, K.: Stochastic climate models. Part I: theory, Tellus, 28, 473–485, 1976. a

Holm, D. D.: Variational principles for stochastic fluid dynamics, Proc. Math. Phys. Eng. Sci., 471, https://doi.org/10.1098/rspa.2014.0963, 2015. a, b, c, d, e, f, g, h, i, j, k, l, m, n

Holm, D. D. and Luesink, E.: Stochastic Wave–Current Interaction in Thermal Shallow Water Dynamics, J. Nonlinear Sci., 31, 29, https://doi.org/10.1007/s00332-021-09682-9, 2021. a

Houtekamer, P. and Mitchell, H. L.: A Sequential Ensemble Kalman Filter for Atmospheric Data Assimilation, Mon. Wather Rev., 129, 123–137, 2001. a

Jain, A., Timofeyev, I., and Vanden-Eijnden, E.: Stochastic mode-reduction in models with conservative fast sub-systems, arXiv [preprint], https://doi.org/10.48550/arXiv.1410.3004, 2014. a

Kotsuki, S., Ota, Y., and Miyoshi, T.: Adaptive covariance relaxation methods for ensemble data assimilation: Experiments in the real atmosphere, Q. J. Roy. Meteor. Soc., 143, 2001–2015, 2017. a

Kunita, H.: Stochastic flows and stochastic differential equations, vol. 24, Cambridge university press, 1997. a

Leith, C.: Atmospheric predictability and two-dimensional turbulence, J. Atmos. Sci., 28, 145–161, 1971. a

Leon, A. B. D.: On the effect of stochastic Lie transport noise on fluid dynamic equations, PhD thesis, Imperial College London, https://doi.org/10.25560/89936, 2021. a, b, c

Leroux, S., Brankart, J.-M., Albert, A., Brodeau, L., Molines, J.-M., Jamet, Q., Le Sommer, J., Penduff, T., and Brasseur, P.: Ensemble quantification of short-term predictability of the ocean dynamics at a kilometric-scale resolution: a Western Mediterranean test case, Ocean Sci., 18, 1619–1644, https://doi.org/10.5194/os-18-1619-2022, 2022. a

Leutbechner, M., Ollinaha, P., Lock, S.-J., Lang, S., Bechtold, P., Beljaars, A., Bozzo, A., Forbes, R., Haiden, T. Hogan, R., and Sandu, I.: Stochastic representations of model uncertainties in the IFS, in: ECMWF/WWRP Workshop: Model Uncertainty, ECMWF, Reading, 2016. a

Li, H., Kalnay, E., and Miyoshi, T.: Simultaneous estimation of covariance inflation and observation errors within an ensemble Kalman filter, Q. J. Roy. Meteor. Soc., 135, https://doi.org/10.1002/qj.371, 2009. a

Majda, A. J., Timofeyev, I., and VandenEijnden, E.: Models for stochastic climate prediction, P. Natl. Acad. Sci. USA, 96 26, 14687–14691, 1999. a, b

Mémin, E.: Fluid flow dynamics under location uncertainty, Geophys. Astro. Fluid, 108, 119–146, 2014. a, b, c, d, e, f, g, h, i, j, k

Mikulevicius, R. and Rozovskii, B.: Stochastic Navier-Stokes Equations for Turbulent Flows, SIAM J. Math. Anal., 35, 1250–1310, 2004. a, b, c

Miyoshi, T.: The Gaussian Approach to Adaptive Covariance Inflation and Its Implementation with the Local Ensemble Transform Kalman Filter, Mon. Wather Rev., 139, 1519–1535, 2011. a

Orszag, S.: Analytical theories of turbulence, J. Fluid Mech., 41, 363–386, 1970. a

Penland, C. and Sardeshmukh, P.: The optimal growth of tropical sea surface temperature anomalies, J. Climate, 8, 1999–2024, 1995.  a

Pope, S.: Lagrangian PDF methods for turbulent flows, Annu. Rev. Fluid Mech., 26, 23–63, 1994. a

Poterjoy, J.: A Localized Particle Filter for High-Dimensional Nonlinear Systems, Mon. Wather Rev., 144, 59–76, 2016. a

Raanes, P. N., Bocquet, M., and Carrassi, A.: Adaptive covariance inflation in the ensemble Kalman filter by Gaussian scale mixtures, Q. J. Roy. Meteor. Soc., 145, 53–75, 2019. a

Resseguier, V.: Mixing and fluid dynamics under location uncertainty, PhD thesis, Université Rennes 1, 2017. a

Resseguier, V., Mémin, E., and Chapron, B.: Geophysical flows under location uncertainty, Part I Random transport and general models, Geophys. Astro. Fluid, 111, 149–176, 2017a. a, b, c, d, e, f, g, h, i, j, k

Resseguier, V., Mémin, E., and Chapron, B.: Geophysical flows under location uncertainty, Part II Quasi-geostrophy and efficient ensemble spreading, Geophys. Astro. Fluid, 111, 177–208, 2017b. a

Resseguier, V., Pan, W., and Fox-Kemper, B.: Data-driven versus self-similar parameterizations for stochastic advection by Lie transport and location uncertainty, Nonlin. Processes Geophys., 27, 209–234, https://doi.org/10.5194/npg-27-209-2020, 2020. a, b, c, d, e, f

Resseguier, V., Li, L., Jouan, G., Dérian, P., Mémin, E., and Chapron, B.: New trends in ensemble forecast strategy: uncertainty quantification for coarse-grid computational fluid dynamics, Arch. Comput. Methods E., 28, 215–261, 2021. a, b, c, d, e, f

Reynolds, C., Leutbecher, M., Batté, L., Chen, S., Christensen, H., Klasa, C., Pegion, P., Plant, B., Raynaud, L., Roberts, N., Sandu, I., Singleton, A., Sommer, M., Swinbank, R., Tennant, W., and Theis, S.: Reports from working group 3 : What are the pros/cons of existing model uncertainty schemes and how should these be measured?, in: ECMWF/WWRP Workshop: Model Uncertainty, ECMWF, Reading, 2016. a

Sapsis, T. and Majda, A.: A statistically accurate modified quasilinear Gaussian closure for uncertainty quantification in turbulent dynamical systems, Physica D, 252, 34–45, 2013. a

Schlee, F. H., Standish, C. J., and Toda, N. F.: Divergence in the Kalman Filter, AIAA J., 5, 1114–1120, 1966. a

Tandeo, P., Ailliot, P., Bocquet, M., Carrassi, A., Carrassi, A., Miyoshi, T., Pulido, M., Pulido, M., and Zhen, Y.: A Review of Innovation-Based Methods to Jointly Estimate Model and Observation Error Covariance Matrices in Ensemble Data Assimilation, Mon. Wather Rev., 3973–3994, https://doi.org/10.1175/MWR-D-19-0240.1, 2020. a

Tibshirani, R. and Knight, K.: The Covariance Inflation Criterion for Adaptive Model Selection, J. R. Stat. Soc. B, 61, 529–546, https://doi.org/10.1111/1467-9868.00191, 1999. a

Warneford, E. S. and Dellar, P. J.: The quasi-geostrophic theory of the thermal shallow water equations, J. Fluid Mech., 723, 374–403, 2013. a, b, c

Ying, Y. and Zhang, F.: An adaptive covariance relaxation method for ensemble data assimilation, Q. J. Roy. Meteor. Soc., 141, 2898—2906, https://doi.org/10.1002/qj.2576, 2015. a

Zhen, Y. and Harlim, J.: Adaptive error covariances estimation methods for ensemble Kalman filters, J. Comput. Phys., 294, 619–638, 2015. a

Download
Short summary
This paper provides perspective that the displacement vector field of physical state fields should be determined by the tensor fields associated with the physical fields. The advantage of this perspective is that certain physical quantities can be conserved while applying a displacement vector field to transfer the original physical field. A direct application of this perspective is the physically constrained covariance inflation scheme proposed in this paper.