the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Ensemble Kalman-guided model predictive path integral control for spatially localized suppression of extremes in chaotic geophysical flows
Haru Kuroki
Kazumune Hashimoto
Yuki Uehara
Yohei Sawada
Duc Le
Masashi Minamide
The possibility of influencing extreme weather phenomena has been discussed for decades; however, it remains far from operational practice, and there is still no established framework for designing small, spatially localized perturbations that can reliably steer chaotic geophysical flows. In this study, we propose a hybrid control method, termed ensemble-Kalman-guided model predictive path integral control (EKG-MPPI), which combines ensemble Kalman control (EnKC) with model predictive path integral (MPPI) control. Within a control simulation experiment framework, an ensemble Kalman filter is first used for state estimation, after which EnKC computes a candidate perturbation by treating the control objective as a pseudo-observation. An adaptive thresholding procedure then enforces spatial sparsity, so that the EnKC perturbation identifies candidate actuator locations and their nominal amplitudes. This information is embedded into the mean and covariance of Gaussian proposal distributions for MPPI, which subsequently refines the perturbation through sampling-based optimization with nonlinear rollouts, without linearizing the dynamics or computing gradients. Numerical experiments with the Lorenz-96 model and the surface quasi-geostrophic (SQG) model demonstrate that EKG-MPPI can suppress extremes in state variables and regional wind speed more effectively than EnKC alone, while using comparable or smaller control inputs. These results highlight EKG-MPPI as a promising building block for simulation-based assessment of localized intervention strategies in geophysical flows.
- Article
(2764 KB) - Full-text XML
- BibTeX
- EndNote
The idea of deliberately influencing extreme weather phenomena, such as tropical cyclones (TCs), has been discussed for decades. However, it remains far from operational practice and there is still no established framework for designing small, spatially localized interventions with predictable effects. For example, Project STORMFURY attempted to weaken maximum wind speeds by artificially inducing convection around the TC eyewall, but its lack of effectiveness was reported by Willoughby et al. (1985). More recently, several studies have explored potential intervention mechanisms primarily in numerical modeling settings: based on simulations by Zhang et al. (2007), Cotton et al. (2007) discussed the possibility that mineral dust injection could suppress TC development, and Saharan dust has been shown to exert a strong influence on TCs. Furthermore, Latham et al. (2012) investigated TC weakening via sea-surface-temperature reduction, and Jacobson and Kempton (2014) demonstrated in simulations that arrays of offshore wind turbines can suppress near-surface wind speeds. A comprehensive review of these proposed approaches, together with feasibility and governance considerations, is provided by Miller et al. (2023). While these studies identify candidate actuators such as aerosols, mineral dust, and wind turbines, achieving concrete objectives (e.g., a substantial reduction in maximum wind speed) requires more than selecting an actuator type. It also calls for a mathematical framework that systematically optimizes where, when, and how strongly perturbations should be applied. This need is particularly acute because realistic anthropogenic influences are inherently local, weak, and intermittent. Therefore, it is crucial to devise methods that can efficiently identify “small perturbations” that can nevertheless meaningfully steer the evolution of chaotic geophysical flows, at least in simulation-based assessment settings.
An early step in this direction was taken by Henderson et al. (2005), who applied four-dimensional variational data assimilation (4D-Var), widely used in numerical weather prediction, to derive optimal initial perturbations for mitigating damage from tropical cyclones. This approach assumes that perturbations are applied only at the initial time. In contrast, Miyoshi and Sun (2022) proposed a framework in which small perturbations are applied continuously and adaptively. This concept, referred to as control simulation experiments (CSEs), has subsequently been employed and extended in later studies, including Kawasaki and Kotsuki (2024) and Ouyang et al. (2023), and has emerged as a practical approach for systematically evaluating the feasibility and potential side effects of candidate intervention strategies.
More recently, Sawada (2024b) introduced ensemble Kalman control (EnKC), which leverages the EnKF/EnKS framework to compute control increments by assimilating the control objective as a pseudo–observation, and demonstrated its effectiveness in numerical experiments with the Lorenz-63 model. Building on this, Sawada (2024a) proposed a strategy to reduce the magnitude of EnKC control inputs and to enforce spatial sparsity, with demonstrations in the Lorenz-96 model. While these studies Sawada (2024b, a) indicate that EnKC can identify effective perturbations, its computation relies on an approximate linearization of the dynamics over the prediction horizon, motivating strategies that can more fully exploit nonlinear dynamics.
To address the linearization limitation of EnKC while retaining a derivative-free formulation, we combine EnKC with model predictive path integral (MPPI) control. Like EnKC, MPPI is derivative-free; however, it evaluates candidate perturbations through nonlinear forward rollouts rather than linearized dynamics. At the same time, MPPI can be sample-inefficient when informative prior knowledge about the control distribution is unavailable, particularly in high-dimensional control spaces Power and Berenson (2022). We therefore introduce EnKC-guided MPPI (EKG-MPPI), which uses the sparse perturbations obtained from EnKC to construct an informative sampling distribution for MPPI. In this way, EnKC provides ensemble-based candidate perturbations that encode where control is likely to be effective and their nominal magnitude, while MPPI refines them via sampling-based optimization under the full nonlinear model without computing gradients. We demonstrate the effectiveness of the proposed method through numerical experiments with the Lorenz-96 model and the surface quasi-geostrophic (SQG) model.
This paper makes three contributions: (i) we propose EKG-MPPI, a hybrid framework that couples EnKC-based sparse actuation proposals with MPPI-based nonlinear refinement; (ii) we provide an explicit algorithmic formulation of EKG-MPPI, including a practical procedure for embedding EnKC-derived actuator locations and amplitudes into Gaussian sampling distributions for MPPI; and (iii) through numerical experiments with the Lorenz-96 and SQG models, we show that EKG-MPPI suppresses target extremes more strongly than EnKC while using comparable or smaller control inputs.
This section reviews the Ensemble Kalman filter/control and Model Predictive Path Integral control.
2.1 Ensemble Kalman Filter (EnKF)
Let us first review the EnKF. Consider a discrete-time state–space system
where xt denotes the state vector, M the forecast model, qt−1 the model error or the system noise, the observation vector, H the observation operator, and rt the observation error or the measurement noise. At an assimilation time t, the EnKF updates the model forecast by approximately minimizing the quadratic cost function
where and Pb are the ensemble mean and background error covariance, and R is the observation error covariance matrix. The analysis ensemble is obtained by applying the EnKF update
where and denote the ith forecast and analysis ensemble members, respectively, and H denotes the matrix representation of the (possibly linearized) observation operator H. In practice, the products PbH⊤ and HPbH⊤ are computed using ensemble statistics, so that the full covariance matrix Pb need not be formed explicitly. This ensemble representation enables the EnKF to handle high-dimensional systems efficiently. To mitigate sampling errors arising from the use of a finite ensemble, covariance localization is commonly employed. The localized Kalman gain is written as
where ∘ denotes the Schur (element-wise) product and
is a smooth correlation function defined in terms of the distance d(i,j) between grid points and a localization length scale L. This localization suppresses spurious long-range correlations, thereby improving the stability and accuracy of the EnKF updates.
Closely related to the EnKF is the ensemble Kalman smoother (EnKS), which extends the filter in time by estimating the state over an assimilation window using both past and future observations. Operationally, the EnKS can be implemented by propagating an ensemble forward with EnKF updates at each observation time and then applying a backward smoothing step that uses ensemble-based cross-covariances between states at different times and the observations. Readers interested in further details of the EnKF/EnKS family are referred to Houtekamer and Zhang (2016) for a comprehensive review.
2.2 Ensemble Kalman Control (EnKC)
EnKC builds directly on the EnKF and EnKS framework to formulate and solve an optimal control problem for various state-space (dynamical) systems. After the EnKF analysis at time t, let denote the analysis ensemble, with mean and error covariance Pa. Over a prediction horizon TEnKC, EnKC considers the quadratic cost function
subject to the model dynamics
Here, is a prescribed reference (target) vector at time t+TEnKC, Hc maps the state variables to the control criteria (e.g., a regional average or maximum of a physical quantity), Rc is a user-defined weight (pseudo–observation error covariance), and denotes the analysis ensemble mean. The first term penalizes the size of the perturbation to the initial analysis state, while the second term penalizes the mismatch between the predicted future state and the control objective. Assuming that the dynamics over the prediction horizon are approximately linear, the minimizer of Jc can be obtained by applying an EnKS. In this formulation, the reference vector is assimilated as a “pseudo–observation” with error covariance Rc. The resulting EnKS analysis at time t,
yields the optimal perturbation to be applied to the system. The Kalman gain K is computed from the cross–covariance between the analysis ensemble at time t and the ensemble prediction at t+TEnKC, and from the covariance of the projected prediction, in direct analogy with standard EnKF/EnKS formulations.
The EnKC algorithm can be summarized as follows:
-
Apply EnKF with real observations to obtain the analysis ensemble at time t.
-
From the analysis ensemble, perform ensemble forecasting up to t+TEnKC and project the predicted states onto the control criteria via Hc.
-
Run EnKS, assimilating as a pseudo–observation with error covariance Rc, and obtain the perturbation .
-
Add this perturbation to the real system and to all analysis ensemble members, thereby updating the controlled “nature” and its ensemble representation.
-
Propagate the updated ensemble to the next data assimilation time. The resulting forecast serves as the new background for the next EnKF cycle, thus completing the loop and returning to Step 1.
In this way, EnKC integrates ensemble data assimilation and model predictive control by treating the control objective as a pseudo–observation within an EnKS framework, and by interpreting the resulting analysis increment as the optimal small perturbation to steer the system toward the desired future state. The control perturbation estimated by EnKC (Sawada, 2024a), , has the same dimension as the full model state. In practical applications such as weather modification, however, it is unrealistic to apply perturbations to all state variables at every control step. It is therefore desirable to enforce spatial sparsity so that only a limited number of grid points (or regions) are actively perturbed, which naturally aligns with the interpretation of actuators placed at specific locations. Ideally, such sparsity can be promoted by augmenting the EnKC cost function with an ℓ0-norm penalty:
where counts the number of nonzero elements (i.e., ℓ0-norm) and λs controls the strength of the sparsity constraint. However, direct minimization of this objective is computationally demanding for high-dimensional systems, so an empirical yet effective strategy is adopted.
Following the idea of Schneider et al. (2022), we impose sparsity on the EnKC-estimated perturbation by applying a thresholding operator to its components. Specifically, after computing the standard EnKC update, we apply a thresholding operator T(θ) to each entry of so that small-magnitude components are discarded as noise and only sufficiently large perturbations are retained:
While Schneider et al. (2022) treated as a fixed hyperparameter, the present study adopts an adaptive formulation in which the threshold depends on the amplitude of the EnKC-derived perturbation at each control step. More precisely, the threshold parameter is updated as
where Λ is a user-specified coefficient that controls the enforced sparsity. This adaptive thresholding allows the sparsity level to automatically adjust to the magnitude of the EnKC-derived perturbations, thereby concentrating actuator effort on only the most influential grid points. In particular, choosing Λ=1 retains only the grid point with the largest perturbation, which is consistent with the actuator-placement interpretation in which localized increments indicate candidate actuator locations.
2.3 Model Predictive Path Integral Control (MPPI)
We next summarize the MPPI control framework. MPPI is a sample-based model predictive control (MPC) method grounded in probabilistic inference (Williams et al., 2018). MPPI considers the following nonlinear dynamical system:
At each time step, MPPI optimizes an open-loop control sequence over a finite horizon of length T. Let denote the mean control sequence. MPPI introduces stochastic exploration by sampling control sequences from a Gaussian distribution centered at U:
where is a user-specified positive definite covariance matrix. Equivalently, one may write with . Given a sampled control sequence V, the system is rolled out according to (starting from the current state), and we define the total trajectory cost functional as
Under this setup, the stochastic optimal control problem at each time step is
MPPI can be derived via a variational free-energy bound. Let p(V) denote a base (prior) distribution over control sequences (typically chosen as a Gaussian), and define the free energy
Then, for any distribution r(V), the following inequality holds:
where DKL is the Kullback–Leibler divergence. The minimizer of the right-hand side of Eq. (19) is the optimal distribution
and substituting into Eq. (19) yields equality (see Williams et al., 2018, for details). In practice, MPPI restricts r(V) to a Gaussian family with fixed covariance Σ and optimizes only the mean U. This corresponds to the KL projection
whose minimizer satisfies, for fixed Σ,
Since direct sampling from q* is intractable, we estimate Eq. (22) by Monte Carlo sampling with importance weights. When samples are drawn from the base distribution p(V), Eq. (22) can be written as a normalized weighted average:
with log-weights and normalized weights
(If samples are drawn from a proposal distribution g(V)≠p(V), the weights are modified by the standard importance-sampling factor .)
Typically, only the first element of the optimized control sequence is applied as the control input at each time step, after which the horizon is shifted forward and the procedure is repeated. As can be seen from Eq. (23) through Eq. (25), the weights for all samples can be computed in parallel, allowing efficient implementation on GPUs. Moreover, MPPI does not require gradient information of the dynamics or cost function and can be implemented using only forward simulations of the model.
3.1 Overall framework
EnKC provides a principled framework for determining small yet effective perturbations at each control step. However, EnKC computes the control increment by (approximately) linearizing the system dynamics over a finite prediction horizon, and its performance may therefore deteriorate when the dynamics are strongly nonlinear. To overcome this limitation, we propose a hybrid control scheme, termed EnKC-guided MPPI (EKG-MPPI), which combines EnKC with MPPI. In contrast to EnKC, MPPI evaluates candidate perturbations via nonlinear forward rollouts and thus can handle nonlinear dynamics without linearization. Nevertheless, as pointed out by Power and Berenson (2022), MPPI may suffer from poor sampling efficiency when applied without informative prior knowledge of the control distribution. This issue is particularly severe in high-dimensional geophysical systems, where the control space is large and naive sampling may fail to discover effective perturbations under a realistic computational budget.
EKG-MPPI addresses this issue by using the EnKC perturbation as prior information for MPPI. Intuitively, EnKC provides a sparse and physically informed guess of (i) where the system is most sensitive and (ii) how strongly it should be perturbed. We embed this information into the mean and variance (or covariance) of Gaussian sampling distributions, from which MPPI draws candidate actuator locations and magnitudes. MPPI then refines the perturbation through sampling-based optimization based on nonlinear rollouts, without any linearization or gradient computation.
The proposed EKG-MPPI scheme is implemented within the CSE framework, and the overall workflow is summarized in Fig. 1. At each data-assimilation time, we first apply the EnKF to assimilate observations and estimate the current state (Step 1). We then run EnKC using the analysis ensemble to obtain a sparse perturbation (Step 2). This perturbation is interpreted as a candidate actuator configuration and mapped to the parameters of Gaussian sampling distributions for actuator location and control magnitude. MPPI samples multiple candidate control inputs from these distributions, evaluates their performance over a prediction horizon, and computes a weighted average to obtain the final control input (Steps 3–4). In the CSE framework, the model trajectory obtained by integrating the forecast model without any control perturbation is referred to as the nature run, which serves as a proxy for the true atmosphere. The computed control is applied both to the nature run and to the analysis ensemble, after which the forecast–assimilation–control loop continues to the next time step.
3.2 Algorithmic steps (Step 1–5)
In this section we describe the EKG-MPPI procedure at a single control time t. We denote the ensemble size by N and the current analysis ensemble by .
Step 1: EnKF state estimation
As in standard CSE studies, accurate estimation of the system state is a prerequisite for effective control. At each assimilation time t, we apply the EnKF to assimilate the available observations and update the forecast ensemble. The EnKF update is given in Sect. 2.1 and yields the analysis ensemble . We then compute the analysis ensemble mean
which serves as the current state estimate used to initialize the subsequent control computation.
Step 2: EnKC-based control perturbation
In the second step, we apply EnKC (Sect. 2.2) to compute a control perturbation that will serve as prior information for MPPI. EnKC minimizes the quadratic cost function in Eq. (8) via an EnKS, interpreting the control objective as a pseudo–observation. The resulting control perturbation is then sparsified by the adaptive thresholding procedure described in Sect. 2.2. Among the information contained in the sparsified control vector, the key components for localized intervention are (i) the indices of its nonzero entries, which indicate candidate actuator locations, and (ii) the corresponding magnitudes, which represent nominal control amplitudes at those locations. To simplify the presentation, we set Λ=1 in Eq. (13), so that only the grid point with the largest perturbation remains nonzero. The resulting sparse control vector is denoted by , and encodes both the actuator location and its nominal control magnitude to be exploited by MPPI.
Step 3: EnKC-informed sampling of actuator location and magnitude
The third step embeds the information contained in into the sampling distributions from which MPPI draws candidate control inputs. In this study, we parameterize each candidate actuator configuration by its location and magnitude. Let μloc,t and Σloc,t denote the mean and variance (scalar in the single-actuator case) that determine the sampling distribution of actuator locations, and let μmag,t and Σmag,t denote the corresponding quantities for the control magnitude. We define
where floc and fmag map the EnKC output to the means of the sampling distributions for the actuator location and magnitude, respectively, and gloc and gmag define the corresponding sampling variances used by MPPI. Using the parameters in Eq. (27), we draw KMPPI samples of actuator locations and magnitudes,
where denotes a Gaussian distribution. Because actuator locations correspond to discrete grid indices, we round lt,i to the nearest integer and clip it to the valid index range; with a slight abuse of notation, we denote the resulting index again by lt,i. Each pair specifies one candidate actuator configuration for MPPI.
Step 4: MPPI rollout and importance weighting
In the fourth step, we evaluate the sampled actuator configurations via MPPI rollouts and compute their importance weights. Let denote the current state estimate (i.e., the state from which MPPI rolls out). Let nu denote the dimension of the control input, and let be the ℓth standard basis vector. For each sample , we construct a sparse control vector
Starting from , we propagate the system over the MPPI prediction horizon TMPPI as
where 0 denotes the zero control input. That is, the perturbation is applied only at the first rollout step, and no further input is provided during the remaining rollout. This reflects the single-step actuation setting used in our CSEs and also reduces the effective dimension of the control space, thereby improving sampling efficiency.
Let be a state-dependent cost functional that quantifies the performance of the ith control sample. In our implementation, the EnKC-informed Gaussian distribution in Step 3 is used as the base distribution of MPPI, and therefore no importance-sampling correction term is required. The (unnormalized) log-weight is computed as
where λ is the temperature parameter in MPPI. The normalized weight is then computed as
Finally, we first compute the weighted-average control vector
and then project it to a single-actuator (1-sparse) control by keeping only the largest-magnitude component:
Algorithm 1EKG-MPPI algorithm.
.
Step 5: Feedback
In the final step, the optimal control computed in Eq. (36) is applied both to the nature run and to each member of the analysis ensemble, i.e.
The updated ensemble is then advanced by the forecast model until the next assimilation time, at which point the procedure returns to Step 1.
3.3 Pseudocode of EKG-MPPI
The EKG-MPPI procedure described above can be summarized by Algorithm 1, where EnKF (line 3) denotes the ensemble Kalman filter used for state estimation and EnKC (line 5) denotes the ensemble Kalman control scheme that computes sparse optimal perturbations as described in Sect. 2.2.
3.4 Single-step setting and motivation for MPPI
In the current implementation, the control perturbation is applied only at the first rollout step, and no further input is provided during the remaining horizon. The resulting optimization problem at each control decision is therefore effectively single-step. This approach is adopted as a proof of concept for localized intervention in chaotic flows and also reduces the effective dimension of the control space, thereby improving sampling efficiency. Nevertheless, we retain the MPPI formulation because rollout evaluation and importance-weight computation can be performed in parallel for a batch of samples, which is advantageous when forward simulation is the dominant computational cost. In addition, the same algorithmic framework extends naturally to multi-step control sequences and multiple actuators. To examine whether this choice remains competitive even in the present single-step setting, we provide a direct comparison with a standalone Bayesian optimization (BO) baseline (for details, see Sect. 4.1.2 and Appendix A).
We demonstrate the effectiveness of EKG-MPPI through numerical experiments using the Lorenz-96 model and the SQG model.
4.1 Lorenz-96 model
Following the methodology of Sun et al. (2023) and Sawada (2024a), we conduct a control simulation experiment (CSE) aimed at mitigating extreme values in the Lorenz-96 system (Lorenz, 1995). The Lorenz-96 system is governed by
where K=40 in this study, and the external forcing parameter is set to F=8.0. Cyclic boundary conditions are imposed such that the indices are taken modulo K, i.e. . Equation (38) is numerically integrated using the fourth-order Runge–Kutta method with a time step of Δt=0.05. We perform numerical simulations over 160 600 model time steps. During the first 14 600 time steps, neither EnKC nor EKG-MPPI is applied; only EnKF is used to synchronize the estimated state with the uncontrolled nature run (spin-up period). Control is activated for the remaining 146 000 time steps, during which EnKF, EnKC, and EKG-MPPI are all executed. All diagnostics reported below are computed over this controlled period.
4.1.1 EnKC vs. EKG-MPPI
In this Section, we evaluate the effectiveness of the proposed EKG-MPPI method in comparison with EnKC. The hyperparameter settings for the two methods are as follows. For EnKC, observations are assumed to be available at every other grid point. The observation-error covariance matrix R is set to the identity matrix. The ensemble size is N=40, and the localization length scale is L=2. The prediction horizon is set to TEnKC=0.2, corresponding to four time steps. The state threshold is set to . The pseudo-observation matrix is defined so that grid points whose predicted states at time t+TEnKC exceed the threshold are selected as observation points. The control-weight matrix Rc is set to 10−4.
For EKG-MPPI, the EnKC-related parameters are set identically to those of EnKC. In addition, the temperature parameter is set to λ=0.25, the number of samples is KMPPI=40, and the MPPI prediction horizon is set to TMPPI=4. The embedding functions in Eq. (27) are specified as
where argnz (⋅) returns the index of the nonzero entry of its argument. For the initial solution of MPPI, we adopt the perturbations obtained by EnKC, as represented by floc and fmag. The running state-cost function is defined as
Under these settings, we conducted 10 simulations with different random seeds. For each method, we computed the mean and standard deviation over the 10 runs of (i) the number of state components exceeding the threshold value of 12 and (ii) the control-input magnitude. The results are summarized in Table 1. EKG-MPPI achieved a lower extreme-event count (7622±146) than EnKC (7820±142), while also requiring a smaller control-input magnitude (0.166±0.002 for EKG-MPPI versus 0.191±0.001 for EnKC).
Table 1Comparison of EKG-MPPI and EnKC in the Lorenz-96 control simulation experiment. The second column reports the extreme-event count, defined as , where #{⋅} denotes set cardinality. The third column reports the input magnitude, defined as , where 𝒯ctrl denotes the set of time steps at which control is applied during the simulation horizon Tsim, and . All values are shown as mean ± standard deviation over 10 simulations with different random seeds.
These results demonstrate that EKG-MPPI outperforms EnKC in terms of both suppressing extreme events and reducing control effort. We attribute the improvement over EnKC to the nonlinear evaluation introduced in the MPPI refinement stage.
4.1.2 Comparison with Bayesian optimization in the single-step setting
Since the control perturbation is applied only at the first rollout step, the optimization performed at each control decision reduces to the selection of a single localized perturbation. Bayesian optimization (BO) is a standard framework for sample-efficient optimization of expensive black-box functions (see, e.g., Shahriari et al., 2016), and thus it provides a natural baseline for the present single-step setting. We therefore compare EKG-MPPI with a standalone BO controller to assess whether the MPPI-based formulation remains advantageous even in this simplified setting. For a fair comparison, the BO baseline optimizes the same single-step control parameterization as EKG-MPPI, using the same prediction horizon and the same state-cost function.
The objective function used by the BO baseline is designed to balance the severity of extreme events against the intervention cost. Specifically, the cost function is defined as
where denotes the jth component of the predicted state, K is the state dimension, and TBO is the prediction horizon. The state trajectory is obtained by propagating the model dynamics as
The first term measures the cumulative exceedance above the threshold over the prediction horizon, while the second term penalizes the intervention magnitude. The parameter α controls the trade-off between intervention effectiveness and intervention cost. We employ the Expected Improvement (EI) acquisition function Jones et al. (1998), set the search interval to , use α=1, and perform 7 BO iterations at each control decision. Although this is a modest BO budget, it already leads to a substantially larger computation time per decision than that of EKG-MPPI; see Table 3 for the runtime comparison.
Table 2 summarizes the results. As in Sect. 4.1.1, the experiments are repeated over 10 different random seeds. EKG-MPPI yields fewer extreme events than BO (7622±146 vs. 8299±255) and a smaller mean control-input magnitude (0.166±0.002 vs. 0.340±0.004). These results indicate that EKG-MPPI remains effective in the present single-step setting, outperforming the standalone BO baseline in both reported metrics. For completeness, Appendix A reports the corresponding comparison between standalone BO and vanilla MPPI under the same single-step setting.
Table 2Comparison between EKG-MPPI and a standalone BO baseline in the single-step Lorenz-96 control setting. The second and third columns report the extreme-event count and the mean input magnitude, respectively, defined in the same manner as in Table 1.
4.1.3 BO-informed prior vs. EnKC-informed prior in MPPI
To further examine the prior design used in EKG-MPPI, we introduce an additional baseline, denoted BO-MPPI, in which Bayesian optimization is used to estimate the intervention location and magnitude that define the prior supplied to MPPI. Unlike the standalone BO baseline in Sect. 4.1.2, the purpose of this comparison is not to contrast BO with EKG-MPPI. Rather, because BO-MPPI and EKG-MPPI share the same MPPI refinement stage, this comparison isolates the effect of the prior used to guide MPPI. BO-MPPI therefore serves as an ablation baseline for the prior construction.
For the BO component of BO-MPPI, the optimization iterations and the search interval for the intervention are set in the same way as in Sect. 4.1.2. The hyperparameters of EKG-MPPI are set as in Sect. 4.1.1. Under these settings, for each , we conduct experiments by varying the BO-MPPI parameter α over . For ease of visualization, both the average intervention magnitude and the intervention-effectiveness metric are rescaled; see Appendix B for details.
Figure 2 compares EKG-MPPI and BO-MPPI for . In each panel, the EKG-MPPI result is located below the empirical lower envelope, i.e., the Pareto-like trade-off curve, formed by the BO-MPPI results obtained by varying α. This indicates that, for a comparable level of intervention effectiveness, EKG-MPPI achieves a smaller average intervention magnitude than BO-MPPI. In other words, the EnKC-informed prior yields a more favorable trade-off between intervention effectiveness and control magnitude than the BO-informed prior across the tested values of λ. These results suggest that the advantage of EKG-MPPI is robust to the choice of λ rather than being driven by a particular hyperparameter setting.
4.1.4 Sensitivity analysis of EKG-MPPI hyperparameters
We next examine the sensitivity of EKG-MPPI to its two main hyperparameters: the temperature parameter λ and the number of MPPI samples KMPPI. We vary λ over and KMPPI over . For each configuration, we record the number of threshold exceedances, the mean control-input magnitude, and the number of time steps at which control is applied. The results are shown in Fig. 3.
Figure 3 shows a clear overall tendency: decreasing λ increases the mean control-input magnitude while reducing the frequency of control application. In MPPI, λ determines how strongly the importance weights concentrate on low-cost samples. Smaller values of λ therefore produce more peaked weights and drive the update toward more aggressive perturbations identified in the sampled rollouts. In EKG-MPPI, the sampling distribution is centered on the EnKC-informed proposal . A smaller λ thus induces a stronger shift away from this EnKC-guided proposal toward samples with particularly low rollout cost. This tendency becomes more pronounced when λ is very small (e.g., 0.01 or 0.001). In that regime, increasing KMPPI tends to further increase the mean control-input magnitude and decrease the control frequency. A plausible explanation is that a larger sample set more often contains rare but highly effective perturbations; when λ is small, the weight update becomes strongly concentrated on such samples, thereby amplifying the resulting control magnitude. Figure 3 also indicates that smaller λ and larger KMPPI generally reduce the number of threshold exceedances, suggesting stronger suppression of extremes. At the same time, the mean input magnitude exhibits a non-monotonic dependence on λ, with the smallest value occurring around λ=1 in the present experiment. Although one might expect a larger value such as λ=10 to yield smaller inputs, an excessively large λ produces diffuse weights and hence overly conservative updates. Such conservative control may allow extremes to persist, which can in turn require larger or more sustained interventions later.
4.1.5 Computation time
We next compare the computation time of EnKC, BO, BO-MPPI, and EKG-MPPI. For EnKC, BO and EKG-MPPI, the parameter settings are the same as those in Sect. 4.1.1 and in Sect. 4.1.2. For BO-MPPI, the search interval for the intervention is set to , and the number of BO iterations is set to 7. At each control decision, we measure the time required to compute the control input and summarize it by its mean and standard deviation. The results are listed in Table 3. For EKG-MPPI, the mean runtime per control decision is for the EnKC part and for the MPPI rollout and weight computation, giving a total mean runtime of per decision. Thus, approximately 16 % of the runtime is attributable to the EnKC part and 84 % to the MPPI part. This indicates that the dominant computational cost in EKG-MPPI arises from rollout evaluation rather than from construction of the EnKC-informed prior. The additional overhead introduced by the prior estimation is therefore modest in the present setting. Table 3 also shows that EKG-MPPI is substantially faster than BO-MPPI. The mean runtime of BO-MPPI is 0.216±0.104 s per control decision, whereas the total mean runtime of EKG-MPPI is , making BO-MPPI approximately 5.6×102 times slower in the present experiment. Moreover, the total runtime of EKG-MPPI is much shorter than one model time step, Δt=0.05, indicating that the method is computationally feasible for the present online-control setting. Finally, the present experiment uses KMPPI=40 samples. Under ideal parallel execution, the MPPI component could in principle be reduced to approximately one-fortieth of its current runtime, i.e., about . This observation further suggests that EKG-MPPI is well suited to parallel hardware when forward rollout evaluation dominates the computational cost.
4.2 Surface quasi-geostrophic model
The quasi-geostrophic (QG) model is a standard framework for describing mesoscale barotropic and baroclinic dynamics; for a comprehensive review, see Vallis (2017). The surface quasi-geostrophic (SQG) model is derived from the QG model under the assumption of uniform interior potential vorticity. A key feature of the SQG model is that the surface buoyancy acts as an active tracer from which the horizontal velocity field is diagnosed. All numerical experiments follow the setup and parameter values in Resseguier et al. (2017).
4.2.1 SQG dynamics and diagnostic velocity
Let b(x,t) denote the surface buoyancy on a doubly periodic domain . In the SQG model, b evolves as an active tracer and the velocity is diagnosed from b via a streamfunction ψ:
Here 𝒟(b) denotes a dissipation operator and f is an external forcing term. Equivalently, in Fourier space, for k≠0, with the mean mode set to zero; see Resseguier et al. (2017) for numerical implementation details. We discretize b on a 128×128 grid and denote the vectorized buoyancy field at discrete time t by xt∈ℝn with n=1282. Let be the one-step forecast model corresponding to the numerical time integrator of Eq. (43) (including the SQG inversion in Eq. 45):
It is assumed that the surface buoyancy can be controlled via a small, spatially localized increment. Accordingly, we model the actuation as an additive perturbation applied at the control time t:
followed by the uncontrolled model integration. Thus, the controlled forecast model M used in Step 4 (Sect. 3.2) is defined by
This is consistent with the single-step actuation setting assumed in Step 4 (Sect. 3.2), where the perturbation is applied only at the first rollout step and no further input is provided during the remaining rollout. We consider a single localized actuator at each control time. Let denote the actuator location on the 128×128 grid and mt∈ℝ its magnitude. Let be the standard basis vector corresponding to grid point lt (i.e., a Kronecker delta on the vectorized grid). The control input is then
In the EKG-MPPI/MPPI sampling step, lt is sampled in ℝ2 and then rounded to the nearest integer grid index and clipped to the valid range in each coordinate, following the same discretization convention as in Sect. 3.2. Given a buoyancy state xt, we diagnose the streamfunction and velocity using Eq. (44) through Eq. (45), and define the wind-speed magnitude field as
Let Ωtar denote a prescribed target region (a set of grid points). Our control objective is to suppress wind speed within Ωtar, and we define the running state-cost function as
where target (⋅) aggregates wind speed within Ωtar (e.g., regional mean or maximum). See Resseguier et al. (2017) for numerical details of the SQG inversion and the diagnostic computation of w(⋅).
4.2.2 Simulation Results
To compare the control performance of EKG-MPPI and EnKC, we conduct control simulations on a 128×128 grid map under eight different target regions: , , , , , , and . Hereafter, these experiments are referred to as exp1 through exp8. For each scenario, five simulations are conducted using different random seeds, resulting in a total of 40 simulations. The mean and standard deviation of the maximum wind speed and the average intervention amount are then computed for comparison. The total number of simulation steps in each run is set to 10 118, which corresponds to approximately 10 d of real time. For EnKC, the ensemble size is set to N=40, the prediction horizon is set to TEnKC=500 steps (approximately 12 h), and the control weight is set to 10. For EKG-MPPI, the number of samples is set to KMPPI=40, and the prediction horizon is also set to 500 steps. The embedding function into the prior distribution is defined as follows:
The state cost function for EKG-MPPI is defined as follows:
where w(⋅) is a function that converts the buoyancy state xt into the corresponding wind speed, and target (⋅) is a function that computes the magnitude of the wind speed within the target region. Here wth denotes the wind speed threshold, and in this study we set wth=2. For details of the function w(⋅), the reader is referred to Resseguier et al. (2017).
Figure 4Mean and standard deviation of (a) the maximum wind speed and (b) the mean input magnitude for each scenario. Smaller values indicate better performance in terms of extreme-event suppression and control effort, respectively. The panels display raw values for each scenario rather than percentage differences.
Figure 5Wind-speed fields for the target region . Panels (a–c), (d–f), and (g–i) show the no-control, EnKC, and EKG-MPPI cases, respectively; the three columns correspond to days 4, 5, and 6. The white rectangle denotes the target region for wind-speed suppression.
The results are shown in Fig. 4. Focusing on the mean maximum wind speed and the mean intervention magnitude, we observe that EKG-MPPI achieves effective wind-speed suppression with smaller interventions in almost all scenarios. In particular, EKG-MPPI attains lower maximum wind speeds in the target region than EnKC (Fig. 4a), while requiring smaller mean control magnitudes (Fig. 4b). One reason why EKG-MPPI demonstrates superior control performance compared to EnKC is that EKG-MPPI leverages prior information provided by EnKC to perform MPPI with high sample efficiency, enabling the computation of control inputs that explicitly account for the nonlinear dynamics of the atmospheric system. On the other hand, the standard deviation of the intervention magnitude tends to be larger for EKG-MPPI. A possible reason is the additional exploration introduced by the sampling process in the MPPI component. In large-scale systems such as atmospheric dynamics, control performance is likely to vary significantly depending on the quality of the sampled intervention sequences, which can lead to larger variability in the required control effort. Another interesting observation is that the standard deviation of the maximum wind speed is particularly large in Scenarios 7 and 8. A possible reason is that, in these scenarios, it takes a relatively long time from the beginning of the simulation for the wind speed to intensify. As a result, the effects of interventions at each time step may accumulate over time, leading to more complex behavior of the atmospheric field.
For clarity, Fig. 5 shows visualizations of the no-control, EnKC, and EKG-MPPI simulations for the target region . Panels (a)–(c) show that strong winds occur in the target region in the absence of control. Panels (d)–(f) show that EnKC suppresses the wind speed relative to the no-control case, although localized regions of strong wind remain. Panels (g)–(i) show that EKG-MPPI achieves stronger wind-speed suppression in the target region than EnKC.
We developed EnKC-guided MPPI (EKG-MPPI), a hybrid control scheme that uses EnKC to obtain a sparse candidate perturbation and then refines it by MPPI using nonlinear forward rollouts. The EnKC output is used to shape the sampling distribution in MPPI, so that exploration is concentrated around plausible actuator locations and magnitudes instead of relying on uninformed sampling.
In the Lorenz-96 control simulation experiment, EKG-MPPI reduced the extreme-event count relative to EnKC while requiring a smaller input magnitude. Specifically, for X≥12, the extreme-event count decreased from 7820±142 for EnKC to 7622±146 for EKG-MPPI, while the input magnitude decreased from 0.191±0.001 to 0.166±0.002. In the SQG experiments over eight target regions, EKG-MPPI also achieved lower maximum wind speeds in the target region than EnKC, while using smaller mean control magnitudes.
The current implementation assumes localized actuation (a single or very sparse actuator) and applies the perturbation as a one-step input within each MPPI rollout, and it does not yet impose hard physical constraints. Future work will address multi-actuator and multi-step actuation, constraint-aware formulations, and evaluation metrics that explicitly quantify non-target impacts and robustness to model/observation uncertainty, in addition to improving computational efficiency for higher-dimensional models.
For completeness, we report here the comparison between standalone BO and vanilla MPPI in the same single-step Lorenz-96 setting as in Sect. 4.1.2. This appendix is included as a supplementary reference for the single-step setting. The parameter settings of vanilla MPPI are almost the same as those used for EKG-MPPI in Sect. 4.1.1. However, unlike EKG-MPPI, vanilla MPPI does not use EnKC-informed prior information for the intervention location or magnitude. Accordingly, the sampling distributions for the intervention location and intervention magnitude are fixed to 𝒩(0,20.0) and 𝒩(0,0.5), respectively. The parameter settings of BO are the same as those used in Sect. 4.1.2. As in Sect. 4.1.2, the experiments were repeated over 10 simulations with different random seeds, and we report the mean and standard deviation of each metric.
The results are summarized in Table A1. Vanilla MPPI yields fewer extreme events than standalone BO while requiring a comparable mean input magnitude. For reference, EKG-MPPI in Table 1 yields 7622±146 threshold exceedances with a mean input magnitude of 0.166±0.002, whereas vanilla MPPI yields 6650±138 threshold exceedances with a mean input magnitude of 0.335±0.003. Thus, in the present setting, vanilla MPPI achieves a lower threshold-exceedance count, whereas EKG-MPPI requires approximately half the mean control-input magnitude. These results indicate a trade-off between extreme-event suppression and control effort. Even without EnKC-informed guidance, vanilla MPPI therefore remains a competitive baseline in the present single-step setting.
Table A1Comparison between vanilla MPPI and a standalone BO baseline in the single-step Lorenz-96 control setting. The second and third columns report the extreme-event count and the mean input magnitude, respectively, defined in the same manner as in Table 1. All values are shown as mean ± standard deviation over 10 simulations with different random seeds.
To facilitate visual comparison in the two-dimensional performance–control plots, we rescale both the average intervention magnitude and the threshold-exceedance count (the horizontal-axis performance metric) by the corresponding mean over the five BO-MPPI runs for the same fixed value of λ. This rescaling is used only for visualization. Because each quantity is divided by a reference mean rather than mapped to the interval [0,1], we refer to the resulting quantities as rescaled (or mean-scaled) values rather than normalized values. All qualitative comparisons reported in the text are unchanged when the original, unscaled metrics are used. For each fixed λ, let . Let mEKG and mα denote the average intervention magnitudes obtained by EKG-MPPI and BO-MPPI, respectively. We define the BO-MPPI reference mean by
and the corresponding rescaled quantities by
Similarly, let eEKG and eα denote the threshold-exceedance counts used on the horizontal axis. We define
and
Values below 1 therefore indicate performance better than the BO-MPPI mean for the same λ on the corresponding axis. Smaller horizontal values indicate fewer threshold exceedances, and smaller vertical values indicate a smaller average intervention magnitude. Since each axis is rescaled by a common positive constant within each panel, this transformation does not change the within-panel ordering or Pareto dominance relations; it only changes the axis units for visualization.
The source code is not currently publicly accessible because it is research software that is still being consolidated and documented for reuse. It is available from the corresponding author upon reasonable request.
No external research data sets were used in this study. All data analyzed in this study were generated by the numerical simulations described in Sect. 4.1 and 4.2. The complete raw simulation outputs are not publicly archived because of their size and because they can be regenerated using the model and parameter settings described in the paper. The processed data underlying the figures and tables are available from the corresponding author upon reasonable request.
HK: Conceptualization; investigation; methodology; validation; visualization; writing–original draft. KH: Investigation; methodology; supervision; funding acquisition. YU: Investigation; methodology; YS: Investigation; methodology; supervision; funding acquisition. DL: Investigation; methodology; MM: Investigation; writing–review and editing.
The contact author has declared that none of the authors has any competing interests.
Publisher's note: Copernicus Publications remains neutral with regard to jurisdictional claims made in the text, published maps, institutional affiliations, or any other geographical representation in this paper. The authors bear the ultimate responsibility for providing appropriate place names. Views expressed in the text are those of the authors and do not necessarily reflect the views of the publisher.
This research has been supported by the JST Moonshot R&D program (grant no. JMPJMS2281).
This paper was edited by Pierre Tandeo and reviewed by two anonymous referees.
Cotton, W. R., Zhang, H., McFarquhar, G. M., and Saleeby, S. M.: Should we consider polluting hurricanes to reduce their intensity, J. Weather Mod., 39, 70–73, https://doi.org/10.54782/001c.132992, 2007. a
Henderson, J. M., Hoffman, R. N., Leidner, S. M., Nehrkorn, T., and Grassotti, C.: A 4D-Var study on the potential of weather control and exigent weather forecasting, Q. J. Roy. Meteor. Soc., 131, 3037–3051, https://doi.org/10.1256/qj.05.72, 2005. a
Houtekamer, P. L. and Zhang, F.: Review of the Ensemble Kalman Filter for Atmospheric Data Assimilation, Mon. Weather Rev., 144, 4489–4532, https://doi.org/10.1175/MWR-D-15-0440.1, 2016. a
Jacobson, M. and Kempton, W.: Taming hurricanes with arrays of offshore wind turbines, Nat. Clim. Change, 4, https://doi.org/10.1038/nclimate2120, 2014. a
Jones, D. R., Schonlau, M., and Welch, W. J.: Efficient Global Optimization of Expensive Black-Box Functions, J. Global Optim., 13, 455–492, 1998. a
Kawasaki, F. and Kotsuki, S.: Leading the Lorenz 63 system toward the prescribed regime by model predictive control coupled with data assimilation, Nonlin. Processes Geophys., 31, 319–333, https://doi.org/10.5194/npg-31-319-2024, 2024. a
Latham, J., Parkes, B., Gadian, A., and Salter, S.: Weakening of hurricanes via marine cloud brightening (MCB), Atmos. Sci. Lett., 13, 231–237, https://doi.org/10.1002/asl.402, 2012. a
Lorenz, E. N.: Predictability: a problem partly solved, in: Seminar on Predictability, Vol. I, ECMWF, Shinfield Park, Reading, UK, 1–18, https://www.ecmwf.int/en/elibrary/75462-predictability-problem-partly-solved (last access: 28 August 2026), 1995. a
Miller, J., Tang, A., Tran, T. L., Prinsley, R., and Howden, M.: The Feasibility and Governance of Cyclone Interventions, Climate Risk Management, 41, 100535, https://doi.org/10.1016/j.crm.2023.100535, 2023. a
Miyoshi, T. and Sun, Q.: Control simulation experiment with Lorenz's butterfly attractor, Nonlin. Processes Geophys., 29, 133–139, https://doi.org/10.5194/npg-29-133-2022, 2022. a
Ouyang, M., Tokuda, K., and Kotsuki, S.: Reducing manipulations in a control simulation experiment based on instability vectors with the Lorenz-63 model, Nonlin. Processes Geophys., 30, 183–193, https://doi.org/10.5194/npg-30-183-2023, 2023. a
Power, T. and Berenson, D.: Variational Inference MPC using Normalizing Flows and Out-of-Distribution Projection, arXiv [preprint], https://doi.org/10.48550/arXiv.2205.04667, 2022. a, b
Resseguier, V., Mémin, E., and Chapron, B.: Geophysical flows under location uncertainty, Part III SQG and frontal dynamics under strong turbulence conditions, Geophys. Astro. Fluid, 111, 209–227, https://doi.org/10.1080/03091929.2017.1312102, 2017. a, b, c, d
Sawada, Y.: Quest for an efficient mathematical and computational method to explore optimal extreme weather modification, arXiv [preprint], https://doi.org/10.48550/arXiv.2405.08387, 2024a. a, b, c, d
Sawada, Y.: Ensemble Kalman filter meets model predictive control in chaotic systems, SOLA, 20, 400–407, https://doi.org/10.2151/sola.2024-053, 2024b. a, b
Schneider, T., Stuart, A. M., and Wu, J.-L.: Ensemble Kalman inversion for sparse learning of dynamical systems from time-averaged data, J. Comput. Phys., 470, 111559, https://doi.org/10.1016/j.jcp.2022.111559, 2022. a, b
Shahriari, B., Swersky, K., Wang, Z., Adams, R. P., and de Freitas, N.: Taking the Human Out of the Loop: A Review of Bayesian Optimization, P. IEEE, 104, 148–175, 2016. a
Sun, Q., Miyoshi, T., and Richard, S.: Control simulation experiments of extreme events with the Lorenz-96 model, Nonlin. Processes Geophys., 30, 117–128, https://doi.org/10.5194/npg-30-117-2023, 2023. a
Vallis, G. K.: Atmospheric and Oceanic Fluid Dynamics: Fundamentals and Large-Scale Circulation, 2nd edn., Cambridge University Press, Cambridge, https://doi.org/10.1017/9781107588417, 2017. a
Williams, G., Drews, P., Goldfain, B., Rehg, J. M., and Theodorou, E. A.: Information-Theoretic Model Predictive Control: Theory and Applications to Autonomous Driving, IEEE T. Robot., 34, 1603–1622, https://doi.org/10.1109/TRO.2018.2865891, 2018. a, b
Willoughby, H. E., Jorgensen, D. P., Black, R. A., and Rosenthal, S. L.: Project STORMFURY: A Scientific Chronicle 1962–1983, B. Am. Meteorol. Soc., 66, 505–514, https://doi.org/10.1175/1520-0477(1985)066<0505:PSASC>2.0.CO;2, 1985. a
Zhang, H., McFarquhar, G. M., Saleeby, S. M., and Cotton, W. R.: Impacts of Saharan dust as CCN on the evolution of an idealized tropical cyclone, Geophys. Res. Lett., 34, L14812, https://doi.org/10.1029/2007GL029876, 2007. a
- Abstract
- Introduction
- Preliminary Knowledge
- EKG-MPPI: Proposed hybrid control method
- Numerical Experiments
- Conclusions
- Appendix A: Standalone BO vs. vanilla MPPI
- Appendix B: Rescaling used for visualization
- Code availability
- Data availability
- Author contributions
- Competing interests
- Disclaimer
- Financial support
- Review statement
- References
- Abstract
- Introduction
- Preliminary Knowledge
- EKG-MPPI: Proposed hybrid control method
- Numerical Experiments
- Conclusions
- Appendix A: Standalone BO vs. vanilla MPPI
- Appendix B: Rescaling used for visualization
- Code availability
- Data availability
- Author contributions
- Competing interests
- Disclaimer
- Financial support
- Review statement
- References