<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing with OASIS Tables v3.0 20080202//EN" "journalpub-oasis3.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:oasis="http://docs.oasis-open.org/ns/oasis-exchange/table" xml:lang="en" dtd-version="3.0" article-type="research-article">
  <front>
    <journal-meta><journal-id journal-id-type="publisher">NPG</journal-id><journal-title-group>
    <journal-title>Nonlinear Processes in Geophysics</journal-title>
    <abbrev-journal-title abbrev-type="publisher">NPG</abbrev-journal-title><abbrev-journal-title abbrev-type="nlm-ta">Nonlin. Processes Geophys.</abbrev-journal-title>
  </journal-title-group><issn pub-type="epub">1607-7946</issn><publisher>
    <publisher-name>Copernicus Publications</publisher-name>
    <publisher-loc>Göttingen, Germany</publisher-loc>
  </publisher></journal-meta>
    <article-meta>
      <article-id pub-id-type="doi">10.5194/npg-29-133-2022</article-id><title-group><article-title>Control simulation experiment with Lorenz's butterfly attractor</article-title><alt-title>Control simulation experiment with Lorenz's butterfly attractor</alt-title>
      </title-group><?xmltex \runningtitle{Control simulation experiment with Lorenz's butterfly attractor}?><?xmltex \runningauthor{T. Miyoshi and Q. Sun}?>
      <contrib-group>
        <contrib contrib-type="author" corresp="yes" rid="aff1 aff2 aff3 aff4">
          <name><surname>Miyoshi</surname><given-names>Takemasa</given-names></name>
          <email>takemasa.miyoshi@riken.jp</email>
        <ext-link>https://orcid.org/0000-0003-3160-2525</ext-link></contrib>
        <contrib contrib-type="author" corresp="no" rid="aff1 aff5">
          <name><surname>Sun</surname><given-names>Qiwen</given-names></name>
          
        </contrib>
        <aff id="aff1"><label>1</label><institution>RIKEN Center for Computational Science, Kobe, 650-0047, Japan</institution>
        </aff>
        <aff id="aff2"><label>2</label><institution>RIKEN Cluster for Pioneering Research, Kobe, 650-0047, Japan</institution>
        </aff>
        <aff id="aff3"><label>3</label><institution>RIKEN Interdisciplinary Theoretical and Mathematical Sciences Program (iTHEMS), Kobe, 650-0047, Japan</institution>
        </aff>
        <aff id="aff4"><label>4</label><institution>Application Laboratory, Japan Agency for Marine-Earth Science and
Technology (JAMSTEC), Yokohama, 236-0001, Japan</institution>
        </aff>
        <aff id="aff5"><label>5</label><institution>Graduate School of Mathematics, Nagoya University, Nagoya, 464-8601,
Japan</institution>
        </aff>
      </contrib-group>
      <author-notes><corresp id="corr1">Takemasa Miyoshi (takemasa.miyoshi@riken.jp)</corresp></author-notes><pub-date><day>28</day><month>March</month><year>2022</year></pub-date>
      
      <volume>29</volume>
      <issue>1</issue>
      <fpage>133</fpage><lpage>139</lpage>
      <history>
        <date date-type="received"><day>27</day><month>June</month><year>2021</year></date>
           <date date-type="rev-request"><day>6</day><month>July</month><year>2021</year></date>
           <date date-type="rev-recd"><day>18</day><month>October</month><year>2021</year></date>
           <date date-type="accepted"><day>13</day><month>December</month><year>2021</year></date>
      </history>
      <permissions>
        <copyright-statement>Copyright: © 2022 Takemasa Miyoshi</copyright-statement>
        <copyright-year>2022</copyright-year>
      <license license-type="open-access"><license-p>This work is licensed under the Creative Commons Attribution 4.0 International License. To view a copy of this licence, visit <ext-link ext-link-type="uri" xlink:href="https://creativecommons.org/licenses/by/4.0/">https://creativecommons.org/licenses/by/4.0/</ext-link></license-p></license></permissions><self-uri xlink:href="https://npg.copernicus.org/articles/29/133/2022/npg-29-133-2022.html">This article is available from https://npg.copernicus.org/articles/29/133/2022/npg-29-133-2022.html</self-uri><self-uri xlink:href="https://npg.copernicus.org/articles/29/133/2022/npg-29-133-2022.pdf">The full text article is available as a PDF file from https://npg.copernicus.org/articles/29/133/2022/npg-29-133-2022.pdf</self-uri>
      <abstract><title>Abstract</title>

      <p id="d1e117">In numerical weather prediction (NWP), sensitivity to initial conditions brings chaotic behaviors and an intrinsic limit to
predictability, but it also implies an effective control in which a small
control signal grows rapidly to make a substantial difference. The Observing
Systems Simulation Experiment (OSSE) is a well-known approach to study
predictability, where “nature” is synthesized by an independent NWP model run. In this study, we extend the OSSE and design the control
simulation experiment (CSE), where we apply a small signal to control “nature”. Idealized experiments with the Lorenz-63 three-variable system show that we can control “nature” to stay in a chosen regime without
shifting to the other, i.e., in a chosen wing of Lorenz's butterfly attractor, by adding small perturbations to “nature”. Using longer-lead-time forecasts, we achieve more effective control with a
perturbation size of less than only 3 % of the observation error. We anticipate our idealized CSE to be a starting point for a realistic CSE using the real-world NWP systems, toward possible future applications to reduce
weather disaster risks. The CSE may be applied to other chaotic systems
beyond NWP.</p>
  </abstract>
    </article-meta>
  </front>
<body>
      

<sec id="Ch1.S1" sec-type="intro">
  <label>1</label><title>Introduction</title>
      <p id="d1e129">The “butterfly effect”, discovered by Lorenz in the 1960s (Lorenz, 1963, 1993), is a phenomenon that an infinitesimal perturbation like “a butterfly
flapping its wings in Brazil” causes a big consequence like “a tornado in
Texas”. This extreme sensitivity brings chaotic behaviors and an intrinsic
limit to predictability, but it also allows us to design an effective control which was explored as “the control of chaos” in the 1990s (e.g., a review by
Boccaletti et al., 2000). That is, we could take advantage of the “butterfly effect” and design an effective control with a series of infinitesimal interventions leading to a desired future. The control of weather is humans' long-time desire, and if we know when and where to put a “butterfly”, we
could lead a better life by, for example, reducing the risks of tornadoes.</p>
      <p id="d1e132">Predictability has been studied extensively, and we enjoy current
high-quality weather prediction that is  consistently being improved. However, studies on controllability are limited because we had to first improve the
prediction accuracy and because our engineering power may be insufficient to
enforce large enough perturbations to the atmosphere. Based on recent
high-quality numerical weather prediction (NWP), this study attempts to explore a computational simulation approach to weather controllability. The simulation studies reveal what perturbations are needed to modify and control the weather. Mutual
interactions between the simulation studies and the intervention techniques
would be essential for future developments toward real-world applications.</p>
      <p id="d1e135">Previous efforts in weather modification include rain enhancement studies (e.g., a review by Flossmann et al., 2019) by cloud seeding with ground-based
facilities and aircraft injecting smokes and dry ices into moist air, so
that the aerosols act as cloud condensation nuclei and enhance cloud
formation. These studies greatly helped advance our knowledge about physical
processes of clouds and precipitation, but in terms of controlling the
weather, we had only limited success with unclear implications for high-impact weather events, mainly because this method works only with
supersaturated air. On the climate scale, geoengineering is a widely discussed concept, such as launching mirror satellites to reflect the
sunlight and injecting dusts into the stratosphere to block the sunlight to cool the air. Li et al. (2018) performed computational simulations and
explored potential rain enhancements in the Sahel region by implementing
large-scale wind and solar farms over the Sahara and modulating the global atmospheric circulation. However, actual geoengineering operations
are controversial because they may cause irreversible unexpected
side-effects due to our limited knowledge of the Earth system. The accepted and currently ongoing operations to counteract the current climate change
may be limited in reducing the greenhouse gas emissions and enhancing renewables and recycles.</p>
      <p id="d1e138">Our focus here is different. We aim to apply “the control of chaos” to the
weather. We do not aim to cause a permanent irreversible change to nature, but we would like to control the weather within its natural
variability and to aid human activities, for example, by shifting the
location of an extreme rain region to avoid disasters without causing a side-effect on the global climate. For extreme weather that occurs in a chaotic
manner under natural variations, the control of chaos suggests that proper
infinitesimal perturbations to the natural atmosphere alter the orbit of the atmospheric dynamics to a desired direction. If the proper infinitesimal
perturbations are within our engineering capability, we could apply the
control in the real world. However, we cannot be too cautious about
potential side-effects and must consider and address every possible consequence. We will come back to this issue later in conclusion.</p>
      <p id="d1e142">Here we develop a method of the control simulation experiment (CSE). It
would be straightforward to extend the method to broader fields with chaotic
dynamics beyond NWP. Weather prediction has been improved consistently by
studying predictability and better initial conditions for NWP. Data
assimilation (DA) combines the NWP model and observation data for optimal
prediction. The method of DA shares that of optimal control, such as the
Kalman filter (Kalman, 1960), where prediction and control are the two sides
of a coin. DA has been studied extensively to improve the prediction, and this study illuminates the control.</p>
      <p id="d1e145">The Observing Systems Simulation Experiment (OSSE) is a powerful method to simulate an NWP system (e.g., Atlas, 1985;
Hoffmann and Atlas, 2016). The OSSE can be designed to assess the impact of
certain observing systems and is useful, for example, for evaluating the potential value of a new satellite sensor before launch. The OSSE can also
be designed to evaluate DA methods. In the OSSE, an independent model run
acts as a synthetic “nature run” (NR), and we simulate observations by
sampling the NR. The NWP system is blind to the NR, takes the simulated
observations, and estimates the NR. We compare the estimation accuracy among
different OSSEs with different observations and different DA methods.</p>
      <p id="d1e148">Here we extend the OSSE and apply small perturbations to the NR to alter the
orbit to a desired direction. Investigating effective perturbations would
address the controllability. As a proof of concept, we focus on the essence
of the problem and use Lorenz's three-variable model (L63, Lorenz, 1963) instead of using a complex large-scale NWP model. In predictability studies,
OSSEs are often performed with such simple idealized models like L63 to
explore new DA methods before application to real NWP models (e.g., Kalnay et al., 2007; Yang et al., 2012). L63 is often used to focus on the essence
of the problem since L63 shows typical chaotic behaviors, with the solution manifold being a well-known “butterfly attractor” (Fig. 1a), which has two
regimes or wings corresponding to the positive and negative values for
variable <inline-formula><mml:math id="M1" display="inline"><mml:mi>x</mml:mi></mml:math></inline-formula>. The regime shifts randomly, and the predictability is limited
due to chaos. Evans et al. (2004) revealed predictability of the regime
shift from rapidly growing uncertainties given by the growth rate of
specific growing perturbations known as the bred vectors (Toth and Kalnay,
1993).</p>

      <?xmltex \floatpos{t}?><fig id="Ch1.F1" specific-use="star"><?xmltex \currentcnt{1}?><?xmltex \def\figurename{Figure}?><label>Figure 1</label><caption><p id="d1e160">Phase space of the three-variable Lorenz model. <bold>(a)</bold> Lorenz's butterfly attractor from the NR without control; <bold>(b)</bold> the NR under control (<inline-formula><mml:math id="M2" display="inline"><mml:mrow><mml:mi>D</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">0.05</mml:mn></mml:mrow></mml:math></inline-formula>,
<inline-formula><mml:math id="M3" display="inline"><mml:mrow><mml:mi>T</mml:mi><mml:mo>=</mml:mo><mml:mfenced close="⌉" open="⌈"><mml:mrow><mml:mn mathvariant="normal">4</mml:mn><mml:msub><mml:mi>T</mml:mi><mml:mn mathvariant="normal">0</mml:mn></mml:msub></mml:mrow></mml:mfenced></mml:mrow></mml:math></inline-formula>). Each dot shows every time step for 8000 steps. See also a movie at <uri>https://doi.org/10.5446/54893</uri>.</p></caption>
        <?xmltex \igopts{width=369.885827pt}?><graphic xlink:href="https://npg.copernicus.org/articles/29/133/2022/npg-29-133-2022-f01.png"/>

      </fig>

</sec>
<sec id="Ch1.S2">
  <label>2</label><title>Experiments</title>
      <p id="d1e217">We first perform a regular OSSE following the previous studies (Kalnay et
al., 2007; Yang et al., 2012). The L63 system with the standard choice of
the parameters (Lorenz, 1963) is discretized in time by the Runge–Kutta fourth-order scheme with a time step of 0.01 units. We define one step as 0.01 units throughout the paper. We assimilate observations every
<inline-formula><mml:math id="M4" display="inline"><mml:mrow><mml:msub><mml:mi>T</mml:mi><mml:mi mathvariant="normal">a</mml:mi></mml:msub><mml:mo>=</mml:mo><mml:mn mathvariant="normal">8</mml:mn></mml:mrow></mml:math></inline-formula> steps. A round of the orbit, i.e., from a maximum to the next
maximum for variable <inline-formula><mml:math id="M5" display="inline"><mml:mi>x</mml:mi></mml:math></inline-formula>, corresponds to <inline-formula><mml:math id="M6" display="inline"><mml:mrow><mml:msub><mml:mi>T</mml:mi><mml:mn mathvariant="normal">0</mml:mn></mml:msub><mml:mo>=</mml:mo><mml:mn mathvariant="normal">75.1</mml:mn></mml:mrow></mml:math></inline-formula> steps on average. We
use the ensemble Kalman filter (EnKF, e.g., Evensen, 1994; Houtekamer and
Zhang, 2016) with three ensemble members, which represent equally probable
state estimates. For simplicity, we observe all three variables in this
study but any subset of observations except for observing only <inline-formula><mml:math id="M7" display="inline"><mml:mi>z</mml:mi></mml:math></inline-formula> variable results in the same conclusion, as suggested by the previous study on
chaos synchronization (Yang et al., 2006). The observation noise is
generated from the normal distribution for each variable independently with
the variance of 2.0. The EnKF results in an accurate state estimation of the root mean square error (RMSE) of 0.32, consistent with the previous studies.</p>

      <?xmltex \floatpos{t}?><fig id="Ch1.F2" specific-use="star"><?xmltex \currentcnt{2}?><?xmltex \def\figurename{Figure}?><label>Figure 2</label><caption><p id="d1e266">Control cases with <inline-formula><mml:math id="M8" display="inline"><mml:mrow><mml:mi>T</mml:mi><mml:mo>=</mml:mo><mml:mfenced open="⌈" close="⌉"><mml:mrow><mml:mn mathvariant="normal">4</mml:mn><mml:msub><mml:mi>T</mml:mi><mml:mn mathvariant="normal">0</mml:mn></mml:msub></mml:mrow></mml:mfenced></mml:mrow></mml:math></inline-formula>
and <inline-formula><mml:math id="M9" display="inline"><mml:mrow><mml:mi>D</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">0.05</mml:mn></mml:mrow></mml:math></inline-formula> for <bold>(a)</bold> NR changed (C), <bold>(b)</bold> false alarm (FA), and <bold>(c)</bold> NR unchanged (NC). Red ticks at the beginning (<inline-formula><mml:math id="M10" display="inline"><mml:mrow><mml:mi>t</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">1</mml:mn></mml:mrow></mml:math></inline-formula>,…,7) show addition of
perturbations to the NR.</p></caption>
        <?xmltex \igopts{width=455.244094pt}?><graphic xlink:href="https://npg.copernicus.org/articles/29/133/2022/npg-29-133-2022-f02.png"/>

      </fig>

      <p id="d1e328">Next, we extend the OSSE and design a CSE. The goal of the control is to
stay in a wing of the butterfly attractor without shifting to the other. It
is essential that our prediction and control system is blind to the NR and
takes only the imperfect observations. The control system finds when and
what perturbations to add to the NR as follows (cf. Fig. 2).
<list list-type="order"><list-item>
      <p id="d1e333">Perform a DA update using the observations at time <inline-formula><mml:math id="M11" display="inline"><mml:mi>t</mml:mi></mml:math></inline-formula> (<inline-formula><mml:math id="M12" display="inline"><mml:mrow><mml:mi>t</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">0</mml:mn></mml:mrow></mml:math></inline-formula> in Fig. 2).
<?xmltex \hack{\newpage}?></p></list-item><list-item>
      <p id="d1e357">Run an ensemble forecast for <inline-formula><mml:math id="M13" display="inline"><mml:mi>T</mml:mi></mml:math></inline-formula> steps from time <inline-formula><mml:math id="M14" display="inline"><mml:mi>t</mml:mi></mml:math></inline-formula> to <inline-formula><mml:math id="M15" display="inline"><mml:mrow><mml:mi>t</mml:mi><mml:mo>+</mml:mo><mml:mi>T</mml:mi></mml:mrow></mml:math></inline-formula> (<inline-formula><mml:math id="M16" display="inline"><mml:mrow><mml:mi>T</mml:mi><mml:mo>=</mml:mo><mml:mo>⌈</mml:mo><mml:mn mathvariant="normal">4</mml:mn><mml:msub><mml:mi>T</mml:mi><mml:mn mathvariant="normal">0</mml:mn></mml:msub><mml:mo>⌉</mml:mo></mml:mrow></mml:math></inline-formula> in Fig. 2, where <inline-formula><mml:math id="M17" display="inline"><mml:mrow><mml:mo>⌈</mml:mo><mml:mspace linebreak="nobreak" width="0.25em"/><mml:mo>⌉</mml:mo></mml:mrow></mml:math></inline-formula> indicates rounding
up to the closest integer since the model integration is discretized).</p></list-item><list-item>
      <p id="d1e419">If at least one ensemble member shows the regime shift, activate the control
(step 4); otherwise, go to step 1 for the next DA at time <inline-formula><mml:math id="M18" display="inline"><mml:mrow><mml:mi>t</mml:mi><mml:mo>+</mml:mo><mml:msub><mml:mi>T</mml:mi><mml:mi mathvariant="normal">a</mml:mi></mml:msub></mml:mrow></mml:math></inline-formula>.</p></list-item><list-item>
      <p id="d1e438">Add perturbations with Euclidean norm <inline-formula><mml:math id="M19" display="inline"><mml:mi>D</mml:mi></mml:math></inline-formula> to the NR at every step from <inline-formula><mml:math id="M20" display="inline"><mml:mrow><mml:mi>t</mml:mi><mml:mo>+</mml:mo><mml:mn mathvariant="normal">1</mml:mn></mml:mrow></mml:math></inline-formula>
to <inline-formula><mml:math id="M21" display="inline"><mml:mrow><mml:mi>t</mml:mi><mml:mo>+</mml:mo><mml:msub><mml:mi>T</mml:mi><mml:mi mathvariant="normal">a</mml:mi></mml:msub><mml:mo>-</mml:mo><mml:mn mathvariant="normal">1</mml:mn></mml:mrow></mml:math></inline-formula>. More precisely, at time <inline-formula><mml:math id="M22" display="inline"><mml:mrow><mml:mi>t</mml:mi><mml:mo>+</mml:mo><mml:mi>i</mml:mi></mml:mrow></mml:math></inline-formula> (<inline-formula><mml:math id="M23" display="inline"><mml:mrow><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">1</mml:mn></mml:mrow></mml:math></inline-formula>,…,<inline-formula><mml:math id="M24" display="inline"><mml:mrow><mml:msub><mml:mi>T</mml:mi><mml:mi mathvariant="normal">a</mml:mi></mml:msub><mml:mo>-</mml:mo><mml:mn mathvariant="normal">1</mml:mn></mml:mrow></mml:math></inline-formula>), the NR
state is evolved from the previous NR state at time <inline-formula><mml:math id="M25" display="inline"><mml:mrow><mml:mi>t</mml:mi><mml:mo>+</mml:mo><mml:mi>i</mml:mi><mml:mo>-</mml:mo><mml:mn mathvariant="normal">1</mml:mn></mml:mrow></mml:math></inline-formula> and is perturbed
by adding (d<inline-formula><mml:math id="M26" display="inline"><mml:mi>x</mml:mi></mml:math></inline-formula>, d<inline-formula><mml:math id="M27" display="inline"><mml:mi>y</mml:mi></mml:math></inline-formula>, d<inline-formula><mml:math id="M28" display="inline"><mml:mi>z</mml:mi></mml:math></inline-formula>), where <inline-formula><mml:math id="M29" display="inline"><mml:mrow><mml:msqrt><mml:mrow><mml:mi mathvariant="normal">d</mml:mi><mml:msup><mml:mi>x</mml:mi><mml:mn mathvariant="normal">2</mml:mn></mml:msup><mml:mo>+</mml:mo><mml:mi mathvariant="normal">d</mml:mi><mml:msup><mml:mi>y</mml:mi><mml:mn mathvariant="normal">2</mml:mn></mml:msup><mml:mo>+</mml:mo><mml:mi mathvariant="normal">d</mml:mi><mml:msup><mml:mi>z</mml:mi><mml:mn mathvariant="normal">2</mml:mn></mml:msup></mml:mrow></mml:msqrt><mml:mo>=</mml:mo><mml:mi>D</mml:mi></mml:mrow></mml:math></inline-formula> (Fig. 2 red ticks, indicating perturbations added to the NR with <inline-formula><mml:math id="M30" display="inline"><mml:mrow><mml:mi>D</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">0.05</mml:mn></mml:mrow></mml:math></inline-formula>).</p></list-item><list-item>
      <p id="d1e607">At time <inline-formula><mml:math id="M31" display="inline"><mml:mrow><mml:mi>t</mml:mi><mml:mo>+</mml:mo><mml:msub><mml:mi>T</mml:mi><mml:mi mathvariant="normal">a</mml:mi></mml:msub></mml:mrow></mml:math></inline-formula>, the new NR is used to simulate the observations; go to
step 1 for the next DA at time <inline-formula><mml:math id="M32" display="inline"><mml:mrow><mml:mi>t</mml:mi><mml:mo>+</mml:mo><mml:msub><mml:mi>T</mml:mi><mml:mi mathvariant="normal">a</mml:mi></mml:msub></mml:mrow></mml:math></inline-formula>.</p></list-item></list>
Step 4 requires perturbations added to the NR. Investigating different
strategies to generate the perturbations addresses controllability. Randomly
chosen perturbations are found to be ineffective, but instead we find the following strategy effective. We choose an ensemble member “S” showing the
regime shift and another ensemble member “N” not showing the regime shift.
If all three ensemble members show the regime shift, we use the ensemble
members from the former initial times for an extended forecasting period and
identify an ensemble member “N” not showing the regime shift during the
period from <inline-formula><mml:math id="M33" display="inline"><mml:mi>t</mml:mi></mml:math></inline-formula> to <inline-formula><mml:math id="M34" display="inline"><mml:mrow><mml:mi>t</mml:mi><mml:mo>+</mml:mo><mml:mi>T</mml:mi></mml:mrow></mml:math></inline-formula>. Take the differences of the two ensemble members S <inline-formula><mml:math id="M35" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula> N
for every step from <inline-formula><mml:math id="M36" display="inline"><mml:mrow><mml:mi>t</mml:mi><mml:mo>+</mml:mo><mml:mn mathvariant="normal">1</mml:mn></mml:mrow></mml:math></inline-formula> to <inline-formula><mml:math id="M37" display="inline"><mml:mrow><mml:mi>t</mml:mi><mml:mo>+</mml:mo><mml:msub><mml:mi>T</mml:mi><mml:mi mathvariant="normal">a</mml:mi></mml:msub><mml:mo>-</mml:mo><mml:mn mathvariant="normal">1</mml:mn></mml:mrow></mml:math></inline-formula> (1 to 7 in Fig. 2) before the
next observations are available at <inline-formula><mml:math id="M38" display="inline"><mml:mrow><mml:mi>t</mml:mi><mml:mo>+</mml:mo><mml:msub><mml:mi>T</mml:mi><mml:mi mathvariant="normal">a</mml:mi></mml:msub></mml:mrow></mml:math></inline-formula> (8 in Fig. 2). The
differences are used as perturbations added to the NR at appropriate time
steps. Here, we consider the limitation of our intervention and include only
a subset of the three variables (<inline-formula><mml:math id="M39" display="inline"><mml:mi>x</mml:mi></mml:math></inline-formula>, <inline-formula><mml:math id="M40" display="inline"><mml:mi>y</mml:mi></mml:math></inline-formula>, <inline-formula><mml:math id="M41" display="inline"><mml:mi>z</mml:mi></mml:math></inline-formula>) with a limited perturbation size.
The choice of the variables and norm <inline-formula><mml:math id="M42" display="inline"><mml:mi>D</mml:mi></mml:math></inline-formula> are the parameters for intervention.</p>
      <p id="d1e743">Figure 2 illustrates three different cases with perturbations added to all
three variables (<inline-formula><mml:math id="M43" display="inline"><mml:mi>x</mml:mi></mml:math></inline-formula>, <inline-formula><mml:math id="M44" display="inline"><mml:mi>y</mml:mi></mml:math></inline-formula>, <inline-formula><mml:math id="M45" display="inline"><mml:mi>z</mml:mi></mml:math></inline-formula>) with <inline-formula><mml:math id="M46" display="inline"><mml:mrow><mml:mi>D</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">0.05</mml:mn></mml:mrow></mml:math></inline-formula> and <inline-formula><mml:math id="M47" display="inline"><mml:mrow><mml:mi>T</mml:mi><mml:mo>=</mml:mo><mml:mo>⌈</mml:mo><mml:mn mathvariant="normal">4</mml:mn><mml:msub><mml:mi>T</mml:mi><mml:mn mathvariant="normal">0</mml:mn></mml:msub><mml:mo>⌉</mml:mo></mml:mrow></mml:math></inline-formula>.
With these settings the control is successful, as shown in Fig. 1b for 8000 steps. Figure 2a shows the case in which the NR is changed by the control and stays in the positive-<inline-formula><mml:math id="M48" display="inline"><mml:mi>x</mml:mi></mml:math></inline-formula> regime successfully (simply “C”​​​​​​​ for
change). Figure 2b shows the case of a false alarm (FA), in which the NR
does not show the regime shift but the ensemble prediction does. Therefore, the perturbations are added unnecessarily but do not hurt. Figure 2c
shows the case in which the NR is not changed by control and still shows the
regime shift (simply “NC” for no change).</p>

      <?xmltex \floatpos{t}?><fig id="Ch1.F3" specific-use="star"><?xmltex \currentcnt{3}?><?xmltex \def\figurename{Figure}?><label>Figure 3</label><caption><p id="d1e810">Rates of successful control out of 40 CSEs for perturbations added
to variables <bold>(a)</bold> <inline-formula><mml:math id="M49" display="inline"><mml:mi>x</mml:mi></mml:math></inline-formula>, <inline-formula><mml:math id="M50" display="inline"><mml:mi>y</mml:mi></mml:math></inline-formula>, <inline-formula><mml:math id="M51" display="inline"><mml:mi>z</mml:mi></mml:math></inline-formula>, <bold>(b)</bold> <inline-formula><mml:math id="M52" display="inline"><mml:mi>x</mml:mi></mml:math></inline-formula>, <inline-formula><mml:math id="M53" display="inline"><mml:mi>y</mml:mi></mml:math></inline-formula>, <bold>(c)</bold> <inline-formula><mml:math id="M54" display="inline"><mml:mi>x</mml:mi></mml:math></inline-formula>, <inline-formula><mml:math id="M55" display="inline"><mml:mi>z</mml:mi></mml:math></inline-formula>, <bold>(d)</bold> <inline-formula><mml:math id="M56" display="inline"><mml:mi>y</mml:mi></mml:math></inline-formula>, <inline-formula><mml:math id="M57" display="inline"><mml:mi>z</mml:mi></mml:math></inline-formula>, <bold>(e)</bold> <inline-formula><mml:math id="M58" display="inline"><mml:mi>x</mml:mi></mml:math></inline-formula>, <bold>(f)</bold> <inline-formula><mml:math id="M59" display="inline"><mml:mi>y</mml:mi></mml:math></inline-formula>, and <bold>(g)</bold> <inline-formula><mml:math id="M60" display="inline"><mml:mi>z</mml:mi></mml:math></inline-formula>.</p></caption>
        <?xmltex \igopts{width=497.923228pt}?><graphic xlink:href="https://npg.copernicus.org/articles/29/133/2022/npg-29-133-2022-f03.png"/>

      </fig>

      <p id="d1e927">To investigate the sensitivity to the parameters <inline-formula><mml:math id="M61" display="inline"><mml:mi>T</mml:mi></mml:math></inline-formula> and <inline-formula><mml:math id="M62" display="inline"><mml:mi>D</mml:mi></mml:math></inline-formula> and the choice of the perturbed variables, we perform 40 independent experiments for each
setting for 8000 steps (1000 DA cycles; cf. Appendix A for the exact choices of the initial conditions) and count the number of successful experiments in
which the NR stays in a single regime under control. Higher success rates
correspond to better controllability. With longer forecasts (larger <inline-formula><mml:math id="M63" display="inline"><mml:mi>T</mml:mi></mml:math></inline-formula>),
control is generally more effective (Fig. 3). With small <inline-formula><mml:math id="M64" display="inline"><mml:mrow><mml:mi>T</mml:mi><mml:mi mathvariant="italic">&lt;</mml:mi><mml:mo>⌈</mml:mo><mml:mn mathvariant="normal">2.5</mml:mn><mml:msub><mml:mi>T</mml:mi><mml:mn mathvariant="normal">0</mml:mn></mml:msub><mml:mo>⌉</mml:mo></mml:mrow></mml:math></inline-formula>, the success rates are very low. The mean transition
time for the regime shift is approximately <inline-formula><mml:math id="M65" display="inline"><mml:mrow><mml:mn mathvariant="normal">2.3</mml:mn><mml:msub><mml:mi>T</mml:mi><mml:mn mathvariant="normal">0</mml:mn></mml:msub></mml:mrow></mml:math></inline-formula>, which may be the
minimum forecast length for effective control. With very small perturbations
(<inline-formula><mml:math id="M66" display="inline"><mml:mrow><mml:mi>D</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">0.02</mml:mn></mml:mrow></mml:math></inline-formula>), the control is difficult, but a larger <inline-formula><mml:math id="M67" display="inline"><mml:mi>D</mml:mi></mml:math></inline-formula> does not necessarily improve the success rate. The perturbations are added every step, and the
state evolves by approximately 0.5 (Euclidean norm) in one step on average
(Table 1). This is about half of the evolution without control, suggesting that the perturbations effectively drag the NR states toward more stable
regions of the attractor (cf. Fig. 1 and a movie at
<uri>https://doi.org/10.5446/54893</uri>). Adding larger perturbations with a similar
size to the one-step model evolution tends to reduce the effect of control.
Although observing only <inline-formula><mml:math id="M68" display="inline"><mml:mi>z</mml:mi></mml:math></inline-formula> is not sufficient for DA, it is good for control.
Perturbing only one variable <inline-formula><mml:math id="M69" display="inline"><mml:mi>y</mml:mi></mml:math></inline-formula> or <inline-formula><mml:math id="M70" display="inline"><mml:mi>z</mml:mi></mml:math></inline-formula> is effective with <inline-formula><mml:math id="M71" display="inline"><mml:mrow><mml:mi>T</mml:mi><mml:mo>=</mml:mo><mml:mo>⌈</mml:mo><mml:mn mathvariant="normal">4</mml:mn><mml:msub><mml:mi>T</mml:mi><mml:mn mathvariant="normal">0</mml:mn></mml:msub><mml:mo>⌉</mml:mo></mml:mrow></mml:math></inline-formula> and <inline-formula><mml:math id="M72" display="inline"><mml:mrow><mml:mi>D</mml:mi><mml:mi mathvariant="italic">&gt;</mml:mi><mml:mn mathvariant="normal">0.04</mml:mn></mml:mrow></mml:math></inline-formula>, only an eighth of the analysis
error of 0.32 or only 3 % of the observation error standard deviation of
<inline-formula><mml:math id="M73" display="inline"><mml:msqrt><mml:mn mathvariant="normal">2</mml:mn></mml:msqrt></mml:math></inline-formula>. In short, the L63 regime change is considerably controllable.</p>

<?xmltex \floatpos{t}?><table-wrap id="Ch1.T1" specific-use="star"><?xmltex \currentcnt{1}?><label>Table 1</label><caption><p id="d1e1074">Averaged one-step model evolution in the Euclidean norm (OME) and
the relative size of perturbations (<inline-formula><mml:math id="M74" display="inline"><mml:mrow><mml:mi>D</mml:mi><mml:mo>/</mml:mo></mml:mrow></mml:math></inline-formula>OME). Only successful control cases
are considered for CSEs with <inline-formula><mml:math id="M75" display="inline"><mml:mrow><mml:mi>T</mml:mi><mml:mo>=</mml:mo><mml:mfenced open="⌈" close="⌉"><mml:mrow><mml:mn mathvariant="normal">4</mml:mn><mml:msub><mml:mi>T</mml:mi><mml:mn mathvariant="normal">0</mml:mn></mml:msub></mml:mrow></mml:mfenced></mml:mrow></mml:math></inline-formula>
and perturbations added to variables <inline-formula><mml:math id="M76" display="inline"><mml:mi>x</mml:mi></mml:math></inline-formula>, <inline-formula><mml:math id="M77" display="inline"><mml:mi>y</mml:mi></mml:math></inline-formula>, and <inline-formula><mml:math id="M78" display="inline"><mml:mi>z</mml:mi></mml:math></inline-formula>. “NA” indicates not available.</p></caption><oasis:table frame="topbot"><oasis:tgroup cols="11">
     <oasis:colspec colnum="1" colname="col1" align="left"/>
     <oasis:colspec colnum="2" colname="col2" align="right"/>
     <oasis:colspec colnum="3" colname="col3" align="right"/>
     <oasis:colspec colnum="4" colname="col4" align="right"/>
     <oasis:colspec colnum="5" colname="col5" align="right"/>
     <oasis:colspec colnum="6" colname="col6" align="right"/>
     <oasis:colspec colnum="7" colname="col7" align="right"/>
     <oasis:colspec colnum="8" colname="col8" align="right"/>
     <oasis:colspec colnum="9" colname="col9" align="right"/>
     <oasis:colspec colnum="10" colname="col10" align="right"/>
     <oasis:colspec colnum="11" colname="col11" align="left"/>
     <oasis:tbody>
       <oasis:row>
         <oasis:entry colname="col1"><inline-formula><mml:math id="M79" display="inline"><mml:mi>D</mml:mi></mml:math></inline-formula></oasis:entry>
         <oasis:entry colname="col2">0.02</oasis:entry>
         <oasis:entry colname="col3">0.03</oasis:entry>
         <oasis:entry colname="col4">0.04</oasis:entry>
         <oasis:entry colname="col5">0.05</oasis:entry>
         <oasis:entry colname="col6">0.1</oasis:entry>
         <oasis:entry colname="col7">0.2</oasis:entry>
         <oasis:entry colname="col8">0.3</oasis:entry>
         <oasis:entry colname="col9">0.4</oasis:entry>
         <oasis:entry colname="col10">0.5</oasis:entry>
         <oasis:entry colname="col11">No control</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">OME</oasis:entry>
         <oasis:entry colname="col2">0.694</oasis:entry>
         <oasis:entry colname="col3">0.608</oasis:entry>
         <oasis:entry colname="col4">0.594</oasis:entry>
         <oasis:entry colname="col5">0.577</oasis:entry>
         <oasis:entry colname="col6">0.536</oasis:entry>
         <oasis:entry colname="col7">0.488</oasis:entry>
         <oasis:entry colname="col8">0.461</oasis:entry>
         <oasis:entry colname="col9">0.422</oasis:entry>
         <oasis:entry colname="col10">0.403</oasis:entry>
         <oasis:entry colname="col11">0.956</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1"><inline-formula><mml:math id="M80" display="inline"><mml:mrow><mml:mi>D</mml:mi><mml:mo>/</mml:mo></mml:mrow></mml:math></inline-formula>OME</oasis:entry>
         <oasis:entry colname="col2">0.029</oasis:entry>
         <oasis:entry colname="col3">0.049</oasis:entry>
         <oasis:entry colname="col4">0.067</oasis:entry>
         <oasis:entry colname="col5">0.087</oasis:entry>
         <oasis:entry colname="col6">0.186</oasis:entry>
         <oasis:entry colname="col7">0.410</oasis:entry>
         <oasis:entry colname="col8">0.651</oasis:entry>
         <oasis:entry colname="col9">0.947</oasis:entry>
         <oasis:entry colname="col10">1.239</oasis:entry>
         <oasis:entry colname="col11">NA​​​​​​​</oasis:entry>
       </oasis:row>
     </oasis:tbody>
   </oasis:tgroup></oasis:table></table-wrap>

      <p id="d1e1284">We further investigate the rates of FAs and NR changed (C) and unchanged (NC) by perturbations (Fig. 4a). With larger <inline-formula><mml:math id="M81" display="inline"><mml:mi>D</mml:mi></mml:math></inline-formula>, we find generally
fewer interventions. With smaller <inline-formula><mml:math id="M82" display="inline"><mml:mi>D</mml:mi></mml:math></inline-formula>, we have more interventions mostly by
FA. With smaller <inline-formula><mml:math id="M83" display="inline"><mml:mi>D</mml:mi></mml:math></inline-formula>, higher rates of NC suggest that longer-term small
interventions are needed. Additional experiments by not applying FA and/or NC perturbations reveal the relative importance of these perturbations (Fig. 4b).
These experiments require knowing the NR <inline-formula><mml:math id="M84" display="inline"><mml:mi>T</mml:mi></mml:math></inline-formula> steps in advance and therefore
are not practical but are useful for understanding the roles of these perturbations. For <inline-formula><mml:math id="M85" display="inline"><mml:mrow><mml:mi>D</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">0.2</mml:mn></mml:mrow></mml:math></inline-formula> and smaller, not applying FA perturbations does
not significantly contribute to the control (Fig. 4b, yellow), whereas not
applying NC has a significant impact on reducing the effect of control (Fig. 4b, blue, green). That is, the accumulation of NC perturbations would be essential for effective control. With large <inline-formula><mml:math id="M86" display="inline"><mml:mrow><mml:mi>D</mml:mi><mml:mi mathvariant="italic">&gt;</mml:mi><mml:mn mathvariant="normal">0.2</mml:mn></mml:mrow></mml:math></inline-formula>, not applying
FA and NC perturbations significantly enhances the effect of control (Fig. 4b, green). With the perturbation size similar to or even larger than the
one-step model evolution (Table 1), a single instance of C perturbations is
quite significant. In these cases, FA and NC perturbations are found to be harmful.</p>

      <?xmltex \floatpos{t}?><fig id="Ch1.F4" specific-use="star"><?xmltex \currentcnt{4}?><?xmltex \def\figurename{Figure}?><label>Figure 4</label><caption><p id="d1e1343"><bold>(a)</bold> Rates of the cases of C (red), FA (yellow), and NC (blue) for the successful control experiments with <inline-formula><mml:math id="M87" display="inline"><mml:mrow><mml:mi>T</mml:mi><mml:mo>=</mml:mo><mml:mfenced close="⌉" open="⌈"><mml:mrow><mml:mn mathvariant="normal">4</mml:mn><mml:msub><mml:mi>T</mml:mi><mml:mn mathvariant="normal">0</mml:mn></mml:msub></mml:mrow></mml:mfenced></mml:mrow></mml:math></inline-formula> and perturbations added to variables <inline-formula><mml:math id="M88" display="inline"><mml:mi>x</mml:mi></mml:math></inline-formula>, <inline-formula><mml:math id="M89" display="inline"><mml:mi>y</mml:mi></mml:math></inline-formula>, and <inline-formula><mml:math id="M90" display="inline"><mml:mi>z</mml:mi></mml:math></inline-formula>. The rates indicate the number of cases out of a total of 1000 DA cycles. <bold>(b)</bold> Rates of successful control experiments with <inline-formula><mml:math id="M91" display="inline"><mml:mrow><mml:mi>T</mml:mi><mml:mo>=</mml:mo><mml:mfenced close="⌉" open="⌈"><mml:mrow><mml:mn mathvariant="normal">4</mml:mn><mml:msub><mml:mi>T</mml:mi><mml:mn mathvariant="normal">0</mml:mn></mml:msub></mml:mrow></mml:mfenced></mml:mrow></mml:math></inline-formula>
and perturbations added to variables <inline-formula><mml:math id="M92" display="inline"><mml:mi>x</mml:mi></mml:math></inline-formula>, <inline-formula><mml:math id="M93" display="inline"><mml:mi>y</mml:mi></mml:math></inline-formula>, and <inline-formula><mml:math id="M94" display="inline"><mml:mi>z</mml:mi></mml:math></inline-formula> for the original CSE (grey; cf. Fig. 3a), the CSE without applying FA perturbations (yellow), the CSE without applying NC perturbations (blue), and the CSE without applying FA and NC perturbations (green).</p></caption>
        <?xmltex \igopts{width=398.338583pt}?><graphic xlink:href="https://npg.copernicus.org/articles/29/133/2022/npg-29-133-2022-f04.png"/>

      </fig>

      <p id="d1e1438">Finally, we perform additional sensitivity experiments with a longer DA
interval of <inline-formula><mml:math id="M95" display="inline"><mml:mrow><mml:msub><mml:mi>T</mml:mi><mml:mi mathvariant="normal">a</mml:mi></mml:msub><mml:mo>=</mml:mo><mml:mn mathvariant="normal">25</mml:mn></mml:mrow></mml:math></inline-formula> steps and with partial observations; i.e., only one or two variables are observed. The results generally agree with what has
been shown so far (cf. Appendix B).</p>
</sec>
<sec id="Ch1.S3" sec-type="conclusions">
  <label>3</label><title>Conclusions</title>
      <p id="d1e1464">In this study, we proposed the CSE with numerical demonstration using the
L63 three-variable model. The OSSE is a well-known, powerful approach to study predictability and to evaluate DA methods and observing systems without
having real-world observation data. The CSE is an extension to the OSSE to
study controllability and can be applied to various dynamical systems
including full-scale NWP models. Our future studies apply the CSE to more
complex models and investigate different control scenarios such as
controlling the occurrences of extreme events. Such studies will address
critical issues like how manageable interventions in terms of cost and
energy can make differences to extreme events. This study is only a small
step toward broad investigations that may lead to effective control of
weather events.</p>
      <p id="d1e1467">As we described in the introduction, any real-world application requires extensive caution. For the case of the L63 model, one side of the attractor
may not be desirable for all aspects. We must consider and assess every
potential impact caused by the control and have proper protocols for social,
ethical, and legal agreement about real-world operations.</p>
</sec>

      
      </body>
    <back><app-group>

<app id="App1.Ch1.S1">
  <?xmltex \currentcnt{A}?><label>Appendix A</label><title>The initial conditions of 40 CSEs</title>
      <p id="d1e1481">The​​​​​​​ OSSE with the L63 model follows that of the previous studies (Kalnay et
al., 2007; Yang et al., 2012; Miller et al., 1994; Evensen, 1997). Here we
describe the additional details that were not provided in the previous
papers but that are necessary to repeat the experiment in this study. The initial condition for the NR was chosen to be (<inline-formula><mml:math id="M96" display="inline"><mml:mi>x</mml:mi></mml:math></inline-formula>, <inline-formula><mml:math id="M97" display="inline"><mml:mi>y</mml:mi></mml:math></inline-formula>, <inline-formula><mml:math id="M98" display="inline"><mml:mi>z</mml:mi></mml:math></inline-formula>) <inline-formula><mml:math id="M99" display="inline"><mml:mo>=</mml:mo></mml:math></inline-formula> (8.20747939, 10.0860429,
23.86324441) after running the L63 model for 1000 steps initialized by the
three state variables taken from independent random draws from a normal
distribution with mean 0 and variance 2.0. The NR was 8 million steps long,
and the OSSE was performed for the same period as the NR.</p>
      <p id="d1e1512">The CSEs were performed for a total of 378 combinations of <inline-formula><mml:math id="M100" display="inline"><mml:mi>T</mml:mi></mml:math></inline-formula>, <inline-formula><mml:math id="M101" display="inline"><mml:mi>D</mml:mi></mml:math></inline-formula>, and the choice of intervention. There were nine, five, and seven choices of <inline-formula><mml:math id="M102" display="inline"><mml:mi>T</mml:mi></mml:math></inline-formula>, <inline-formula><mml:math id="M103" display="inline"><mml:mi>D</mml:mi></mml:math></inline-formula>, and intervention, as shown in Fig. 3. For each combination, 40 independent CSEs were performed
for 8000 steps. The initial conditions for the 40 CSEs were chosen from the
analyzed states of the OSSE at different time points as shown in Table A1. Figure 1b shows CSE no. 1 and Fig. 1a the corresponding period of the NR.</p>

<?xmltex \floatpos{t}?><table-wrap id="App1.Ch1.S1.T2" specific-use="star"><?xmltex \currentcnt{A1}?><label>Table A1</label><caption><p id="d1e1546">Time points of the NR providing the initial conditions of the 40
independent CSEs. The initial time point coincides  with the time when observations are available, i.e., only every <inline-formula><mml:math id="M104" display="inline"><mml:mrow><mml:msub><mml:mi>T</mml:mi><mml:mi mathvariant="normal">a</mml:mi></mml:msub><mml:mo>=</mml:mo><mml:mn mathvariant="normal">8</mml:mn></mml:mrow></mml:math></inline-formula> steps, and the formula underneath the table provides the exact initial time point from the value in the table for
a given parameter of <inline-formula><mml:math id="M105" display="inline"><mml:mi>T</mml:mi></mml:math></inline-formula>.</p></caption><oasis:table frame="topbot"><?xmltex \begin{scaleboxenv}{.88}[.88]?><oasis:tgroup cols="8">
     <oasis:colspec colnum="1" colname="col1" align="left"/>
     <oasis:colspec colnum="2" colname="col2" align="center"/>
     <oasis:colspec colnum="3" colname="col3" align="center"/>
     <oasis:colspec colnum="4" colname="col4" align="center"/>
     <oasis:colspec colnum="5" colname="col5" align="center"/>
     <oasis:colspec colnum="6" colname="col6" align="center"/>
     <oasis:colspec colnum="7" colname="col7" align="center"/>
     <oasis:colspec colnum="8" colname="col8" align="center"/>
     <oasis:thead>
       <oasis:row rowsep="1">
         <oasis:entry colname="col1">CSE index</oasis:entry>
         <oasis:entry colname="col2">Time point of the NR</oasis:entry>
         <oasis:entry colname="col3">CSE index</oasis:entry>
         <oasis:entry colname="col4">Time point of the NR</oasis:entry>
         <oasis:entry colname="col5">CSE index</oasis:entry>
         <oasis:entry colname="col6">Time point of the NR</oasis:entry>
         <oasis:entry colname="col7">CSE index</oasis:entry>
         <oasis:entry colname="col8">Time point of the NR</oasis:entry>
       </oasis:row>
     </oasis:thead>
     <oasis:tbody>
       <oasis:row>
         <oasis:entry colname="col1">1</oasis:entry>
         <oasis:entry colname="col2">106 069</oasis:entry>
         <oasis:entry colname="col3">11</oasis:entry>
         <oasis:entry colname="col4">126 902</oasis:entry>
         <oasis:entry colname="col5">21</oasis:entry>
         <oasis:entry colname="col6">150 056</oasis:entry>
         <oasis:entry colname="col7">31</oasis:entry>
         <oasis:entry colname="col8">173 894</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">2</oasis:entry>
         <oasis:entry colname="col2">107 043</oasis:entry>
         <oasis:entry colname="col3">12</oasis:entry>
         <oasis:entry colname="col4">128 058</oasis:entry>
         <oasis:entry colname="col5">22</oasis:entry>
         <oasis:entry colname="col6">150 796</oasis:entry>
         <oasis:entry colname="col7">32</oasis:entry>
         <oasis:entry colname="col8">175 011</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">3</oasis:entry>
         <oasis:entry colname="col2">109 371</oasis:entry>
         <oasis:entry colname="col3">13</oasis:entry>
         <oasis:entry colname="col4">130 718</oasis:entry>
         <oasis:entry colname="col5">23</oasis:entry>
         <oasis:entry colname="col6">152 308</oasis:entry>
         <oasis:entry colname="col7">33</oasis:entry>
         <oasis:entry colname="col8">179 671</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">4</oasis:entry>
         <oasis:entry colname="col2">111 261</oasis:entry>
         <oasis:entry colname="col3">14</oasis:entry>
         <oasis:entry colname="col4">132 342</oasis:entry>
         <oasis:entry colname="col5">24</oasis:entry>
         <oasis:entry colname="col6">155 048</oasis:entry>
         <oasis:entry colname="col7">34</oasis:entry>
         <oasis:entry colname="col8">184 480</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">5</oasis:entry>
         <oasis:entry colname="col2">112 987</oasis:entry>
         <oasis:entry colname="col3">15</oasis:entry>
         <oasis:entry colname="col4">133 311</oasis:entry>
         <oasis:entry colname="col5">25</oasis:entry>
         <oasis:entry colname="col6">155 666</oasis:entry>
         <oasis:entry colname="col7">35</oasis:entry>
         <oasis:entry colname="col8">197 270</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">6</oasis:entry>
         <oasis:entry colname="col2">114 146</oasis:entry>
         <oasis:entry colname="col3">16</oasis:entry>
         <oasis:entry colname="col4">138 699</oasis:entry>
         <oasis:entry colname="col5">26</oasis:entry>
         <oasis:entry colname="col6">162 753</oasis:entry>
         <oasis:entry colname="col7">36</oasis:entry>
         <oasis:entry colname="col8">199 278</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">7</oasis:entry>
         <oasis:entry colname="col2">122 065</oasis:entry>
         <oasis:entry colname="col3">17</oasis:entry>
         <oasis:entry colname="col4">140 562</oasis:entry>
         <oasis:entry colname="col5">27</oasis:entry>
         <oasis:entry colname="col6">164 411</oasis:entry>
         <oasis:entry colname="col7">37</oasis:entry>
         <oasis:entry colname="col8">200 712</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">8</oasis:entry>
         <oasis:entry colname="col2">124 720</oasis:entry>
         <oasis:entry colname="col3">18</oasis:entry>
         <oasis:entry colname="col4">144 953</oasis:entry>
         <oasis:entry colname="col5">28</oasis:entry>
         <oasis:entry colname="col6">168 461</oasis:entry>
         <oasis:entry colname="col7">38</oasis:entry>
         <oasis:entry colname="col8">201 304</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">9</oasis:entry>
         <oasis:entry colname="col2">125 339</oasis:entry>
         <oasis:entry colname="col3">19</oasis:entry>
         <oasis:entry colname="col4">147 614</oasis:entry>
         <oasis:entry colname="col5">29</oasis:entry>
         <oasis:entry colname="col6">172 109</oasis:entry>
         <oasis:entry colname="col7">39</oasis:entry>
         <oasis:entry colname="col8">208 511</oasis:entry>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">10</oasis:entry>
         <oasis:entry colname="col2">125 854</oasis:entry>
         <oasis:entry colname="col3">20</oasis:entry>
         <oasis:entry colname="col4">149 418</oasis:entry>
         <oasis:entry colname="col5">30</oasis:entry>
         <oasis:entry colname="col6">173 399</oasis:entry>
         <oasis:entry colname="col7">40</oasis:entry>
         <oasis:entry colname="col8">209 397</oasis:entry>
       </oasis:row>
     </oasis:tbody>
   </oasis:tgroup><?xmltex \end{scaleboxenv}?></oasis:table><?xmltex \begin{scaleboxenv}{.88}[.88]?><table-wrap-foot><p id="d1e1571">Initial time point <inline-formula><mml:math id="M106" display="inline"><mml:mo>=</mml:mo></mml:math></inline-formula> time point of the NR <inline-formula><mml:math id="M107" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula> <inline-formula><mml:math id="M108" display="inline"><mml:mi>T</mml:mi></mml:math></inline-formula> <inline-formula><mml:math id="M109" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula> [(time point of the NR <inline-formula><mml:math id="M110" display="inline"><mml:mo>-</mml:mo></mml:math></inline-formula> <inline-formula><mml:math id="M111" display="inline"><mml:mi>T</mml:mi></mml:math></inline-formula>) mod <inline-formula><mml:math id="M112" display="inline"><mml:mrow><mml:msub><mml:mi>T</mml:mi><mml:mi mathvariant="normal">a</mml:mi></mml:msub></mml:mrow></mml:math></inline-formula>].</p></table-wrap-foot><?xmltex \end{scaleboxenv}?></table-wrap>

<?xmltex \hack{\newpage}?>
</app>

<app id="App1.Ch1.S2">
  <?xmltex \currentcnt{B}?><label>Appendix B</label><title>Additional sensitivity experiments</title>
      <p id="d1e1975">CSEs​​​​​​​ are performed with a longer DA interval of <inline-formula><mml:math id="M113" display="inline"><mml:mrow><mml:msub><mml:mi>T</mml:mi><mml:mi mathvariant="normal">a</mml:mi></mml:msub><mml:mo>=</mml:mo><mml:mn mathvariant="normal">25</mml:mn></mml:mrow></mml:math></inline-formula> steps, which results in an RMSE of 0.76, consistent with the previous studies. The
results are generally consistent (Fig. B1 compared with Fig. 3).</p>
      <p id="d1e1993">CSEs are performed with different observing coverages, and the results are
summarized in Table B1. Multiplicative inflation is manually tuned for each
observing coverage.</p>

      <?xmltex \floatpos{t}?><fig id="App1.Ch1.S2.F5" specific-use="star"><?xmltex \currentcnt{B1}?><?xmltex \def\figurename{Figure}?><label>Figure B1</label><caption><p id="d1e1998">Similar to Fig. 3 but for the case with a longer DA interval of <inline-formula><mml:math id="M114" display="inline"><mml:mrow><mml:msub><mml:mi>T</mml:mi><mml:mi mathvariant="normal">a</mml:mi></mml:msub><mml:mo>=</mml:mo><mml:mn mathvariant="normal">25</mml:mn></mml:mrow></mml:math></inline-formula>.</p></caption>
        <?xmltex \igopts{width=497.923228pt}?><graphic xlink:href="https://npg.copernicus.org/articles/29/133/2022/npg-29-133-2022-f05.png"/>

      </fig>

<?xmltex \floatpos{h!}?><table-wrap id="App1.Ch1.S2.T3"><?xmltex \hack{\hsize\textwidth}?><?xmltex \currentcnt{B1}?><label>Table B1</label><caption><p id="d1e2027">Rates of successful control out of 40 CSEs with different
observing coverage. <inline-formula><mml:math id="M115" display="inline"><mml:mrow><mml:mi>T</mml:mi><mml:mo>=</mml:mo><mml:mfenced open="⌈" close="⌉"><mml:mrow><mml:mn mathvariant="normal">4</mml:mn><mml:msub><mml:mi>T</mml:mi><mml:mn mathvariant="normal">0</mml:mn></mml:msub></mml:mrow></mml:mfenced></mml:mrow></mml:math></inline-formula>
and perturbations are added to variables <inline-formula><mml:math id="M116" display="inline"><mml:mi>x</mml:mi></mml:math></inline-formula>, <inline-formula><mml:math id="M117" display="inline"><mml:mi>y</mml:mi></mml:math></inline-formula>, and <inline-formula><mml:math id="M118" display="inline"><mml:mi>z</mml:mi></mml:math></inline-formula>.</p></caption><oasis:table frame="topbot"><oasis:tgroup cols="8">
     <oasis:colspec colnum="1" colname="col1" align="left"/>
     <oasis:colspec colnum="2" colname="col2" align="right"/>
     <oasis:colspec colnum="3" colname="col3" align="right"/>
     <oasis:colspec colnum="4" colname="col4" align="right"/>
     <oasis:colspec colnum="5" colname="col5" align="right"/>
     <oasis:colspec colnum="6" colname="col6" align="right"/>
     <oasis:colspec colnum="7" colname="col7" align="right"/>
     <oasis:colspec colnum="8" colname="col8" align="left"/>
     <oasis:thead>
       <oasis:row rowsep="1">
         <oasis:entry colname="col1"><inline-formula><mml:math id="M119" display="inline"><mml:mi>D</mml:mi></mml:math></inline-formula></oasis:entry>
         <oasis:entry colname="col2">Obs <inline-formula><mml:math id="M120" display="inline"><mml:mi>x</mml:mi></mml:math></inline-formula></oasis:entry>
         <oasis:entry colname="col3">Obs <inline-formula><mml:math id="M121" display="inline"><mml:mi>y</mml:mi></mml:math></inline-formula></oasis:entry>
         <oasis:entry colname="col4">Obs <inline-formula><mml:math id="M122" display="inline"><mml:mi>x</mml:mi></mml:math></inline-formula>, <inline-formula><mml:math id="M123" display="inline"><mml:mi>y</mml:mi></mml:math></inline-formula></oasis:entry>
         <oasis:entry colname="col5">Obs <inline-formula><mml:math id="M124" display="inline"><mml:mi>x</mml:mi></mml:math></inline-formula>, <inline-formula><mml:math id="M125" display="inline"><mml:mi>z</mml:mi></mml:math></inline-formula></oasis:entry>
         <oasis:entry colname="col6">Obs <inline-formula><mml:math id="M126" display="inline"><mml:mi>y</mml:mi></mml:math></inline-formula>, <inline-formula><mml:math id="M127" display="inline"><mml:mi>z</mml:mi></mml:math></inline-formula></oasis:entry>
         <oasis:entry colname="col7">Obs <inline-formula><mml:math id="M128" display="inline"><mml:mi>x</mml:mi></mml:math></inline-formula>, <inline-formula><mml:math id="M129" display="inline"><mml:mi>y</mml:mi></mml:math></inline-formula>, <inline-formula><mml:math id="M130" display="inline"><mml:mi>z</mml:mi></mml:math></inline-formula></oasis:entry>
         <oasis:entry colname="col8"/>
       </oasis:row>
     </oasis:thead>
     <oasis:tbody>
       <oasis:row>
         <oasis:entry colname="col1">0.02</oasis:entry>
         <oasis:entry colname="col2">0</oasis:entry>
         <oasis:entry colname="col3">0.025</oasis:entry>
         <oasis:entry colname="col4">0.05</oasis:entry>
         <oasis:entry colname="col5">0.125</oasis:entry>
         <oasis:entry colname="col6">0</oasis:entry>
         <oasis:entry colname="col7">0.05</oasis:entry>
         <oasis:entry colname="col8"/>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">0.03</oasis:entry>
         <oasis:entry colname="col2">1</oasis:entry>
         <oasis:entry colname="col3">0.95</oasis:entry>
         <oasis:entry colname="col4">0.95</oasis:entry>
         <oasis:entry colname="col5">0.975</oasis:entry>
         <oasis:entry colname="col6">0.975</oasis:entry>
         <oasis:entry colname="col7">0.975</oasis:entry>
         <oasis:entry colname="col8"/>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">0.04</oasis:entry>
         <oasis:entry colname="col2">1</oasis:entry>
         <oasis:entry colname="col3">0.975</oasis:entry>
         <oasis:entry colname="col4">0.95</oasis:entry>
         <oasis:entry colname="col5">1</oasis:entry>
         <oasis:entry colname="col6">1</oasis:entry>
         <oasis:entry colname="col7">0.925</oasis:entry>
         <oasis:entry colname="col8"/>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">0.05</oasis:entry>
         <oasis:entry colname="col2">1</oasis:entry>
         <oasis:entry colname="col3">1</oasis:entry>
         <oasis:entry colname="col4">0.975</oasis:entry>
         <oasis:entry colname="col5">1</oasis:entry>
         <oasis:entry colname="col6">1</oasis:entry>
         <oasis:entry colname="col7">0.975</oasis:entry>
         <oasis:entry colname="col8"/>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">0.1</oasis:entry>
         <oasis:entry colname="col2">1</oasis:entry>
         <oasis:entry colname="col3">1</oasis:entry>
         <oasis:entry colname="col4">1</oasis:entry>
         <oasis:entry colname="col5">1</oasis:entry>
         <oasis:entry colname="col6">1</oasis:entry>
         <oasis:entry colname="col7">0.825</oasis:entry>
         <oasis:entry colname="col8"/>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">0.2</oasis:entry>
         <oasis:entry colname="col2">0.975</oasis:entry>
         <oasis:entry colname="col3">0.925</oasis:entry>
         <oasis:entry colname="col4">0.85</oasis:entry>
         <oasis:entry colname="col5">0.975</oasis:entry>
         <oasis:entry colname="col6">0.975</oasis:entry>
         <oasis:entry colname="col7">0.825</oasis:entry>
         <oasis:entry colname="col8"/>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">0.3</oasis:entry>
         <oasis:entry colname="col2">0.95</oasis:entry>
         <oasis:entry colname="col3">0.925</oasis:entry>
         <oasis:entry colname="col4">0.675</oasis:entry>
         <oasis:entry colname="col5">0.975</oasis:entry>
         <oasis:entry colname="col6">0.95</oasis:entry>
         <oasis:entry colname="col7">0.725</oasis:entry>
         <oasis:entry colname="col8"/>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">0.4</oasis:entry>
         <oasis:entry colname="col2">0.95</oasis:entry>
         <oasis:entry colname="col3">0.8</oasis:entry>
         <oasis:entry colname="col4">0.78</oasis:entry>
         <oasis:entry colname="col5">0.975</oasis:entry>
         <oasis:entry colname="col6">0.875</oasis:entry>
         <oasis:entry colname="col7">0.5</oasis:entry>
         <oasis:entry colname="col8"/>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">0.5</oasis:entry>
         <oasis:entry colname="col2">0.9</oasis:entry>
         <oasis:entry colname="col3">0.75</oasis:entry>
         <oasis:entry colname="col4">0.65</oasis:entry>
         <oasis:entry colname="col5">0.95</oasis:entry>
         <oasis:entry colname="col6">0.85</oasis:entry>
         <oasis:entry colname="col7">0.525</oasis:entry>
         <oasis:entry colname="col8"/>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">Ensemble spread</oasis:entry>
         <oasis:entry colname="col2">0.807</oasis:entry>
         <oasis:entry colname="col3">0.469</oasis:entry>
         <oasis:entry colname="col4">0.376</oasis:entry>
         <oasis:entry colname="col5">0.477</oasis:entry>
         <oasis:entry colname="col6">0.323</oasis:entry>
         <oasis:entry colname="col7">0.27</oasis:entry>
         <oasis:entry colname="col8"/>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">RMSE</oasis:entry>
         <oasis:entry colname="col2">0.908</oasis:entry>
         <oasis:entry colname="col3">0.507</oasis:entry>
         <oasis:entry colname="col4">0.412</oasis:entry>
         <oasis:entry colname="col5">0.564</oasis:entry>
         <oasis:entry colname="col6">0.356</oasis:entry>
         <oasis:entry colname="col7">0.32</oasis:entry>
         <oasis:entry colname="col8"/>
       </oasis:row>
       <oasis:row>
         <oasis:entry colname="col1">Multiplicative inflation</oasis:entry>
         <oasis:entry colname="col2">1.065</oasis:entry>
         <oasis:entry colname="col3">1.05</oasis:entry>
         <oasis:entry colname="col4">1.045</oasis:entry>
         <oasis:entry colname="col5">1.09</oasis:entry>
         <oasis:entry colname="col6">1.06</oasis:entry>
         <oasis:entry colname="col7">1.04</oasis:entry>
         <oasis:entry colname="col8"/>
       </oasis:row>
     </oasis:tbody>
   </oasis:tgroup></oasis:table></table-wrap>

<?xmltex \hack{\clearpage}?>
</app>
  </app-group><notes notes-type="codeavailability"><title>Code availability</title>

      <p id="d1e2533">The code that supports the findings of this study is available from the corresponding author upon reasonable request.</p>
  </notes><notes notes-type="dataavailability"><title>Data availability</title>

      <p id="d1e2540">The authors declare that all data supporting the findings of this study are
available within the figures and tables of the paper.</p>
  </notes><notes notes-type="videosupplement"><title>Video supplement</title>

      <p id="d1e2546">The movie of Fig. 1 is available at <uri>https://doi.org/10.5446/54893</uri> (Miyoshi and Sun, 2021).​​​​​​​</p>
  </notes><notes notes-type="authorcontribution"><title>Author contributions</title>

      <p id="d1e2555">TM is the principal investigator, directed the research, and prepared the manuscript with contributions from QS. QS performed numerical experiments
and visualized the results.</p>
  </notes><notes notes-type="competinginterests"><title>Competing interests</title>

      <p id="d1e2561">One of the authors is a member of the editorial board of <italic>Nonlinear Processes in Geophysics</italic>. The peer-review process was guided by an independent editor, and the authors have no other competing interests to declare.</p>
  </notes><notes notes-type="disclaimer"><title>Disclaimer</title>

      <p id="d1e2570">Publisher’s note: Copernicus Publications remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.</p>
  </notes><ack><title>Acknowledgements</title><p id="d1e2576">This study was partly supported by the RIKEN Junior Research Associate (JRA) program.</p></ack><notes notes-type="financialsupport"><title>Financial support</title>

      <p id="d1e2581">This study was partly supported by the Japan Science and Technology Agency (JST) Moonshot R&amp;D Millennia program (grant no. JPMJMS20MK).​​​​​​​</p>
  </notes><notes notes-type="reviewstatement"><title>Review statement</title>

      <p id="d1e2587">This paper was edited by Alberto Carrassi and reviewed by two anonymous referees.</p>
  </notes><ref-list>
    <title>References</title>

      <ref id="bib1.bib1"><label>1</label><?label 1?><mixed-citation>
Atlas, R., Kalnay, E., Baker, W. E., Susskind, J., Reuter, D., and Halem,
M.: Simulation studies of the impact of future observing systems on weather
prediction, Preprints, Seventh Conf. on Numerical Weather Prediction,
Montreal, QC, Canada, Amer. Meteor. Soc., 145–151, 1985.</mixed-citation></ref>
      <ref id="bib1.bib2"><label>2</label><?label 1?><mixed-citation>Boccaletti, S., Grebogi, C., Lai, Y.-C., Mancini, H., and Maza, D.: The
control of chaos: theory and applications, Phys. Rep., 329, 103–197,
<ext-link xlink:href="https://doi.org/10.1016/S0370-1573(99)00096-4" ext-link-type="DOI">10.1016/S0370-1573(99)00096-4</ext-link>, 2000.
</mixed-citation></ref><?xmltex \hack{\newpage}?>
      <ref id="bib1.bib3"><label>3</label><?label 1?><mixed-citation>Evans, E., Bhatti, N., Kinney, J., Pann, L., Peňa, M., Yang, S. C.,
Kalnay, E., and Hansen, J.: RISE undergraduates find that regime changes in
Lorenz's model are predictable, B. Am. Meteorol. Soc., 85, 521–524,
2004.</mixed-citation></ref>
      <ref id="bib1.bib4"><label>4</label><?label 1?><mixed-citation>Evensen, G.: Sequential data assimilation with a nonlinear quasi-geostrophic
model using Monte Carlo methods to forecast error statistics, J. Geophys.
Res., 99, 10143–10162, <ext-link xlink:href="https://doi.org/10.1029/94JC00572" ext-link-type="DOI">10.1029/94JC00572</ext-link>, 1994.</mixed-citation></ref>
      <ref id="bib1.bib5"><label>5</label><?label 1?><mixed-citation>Evensen, G.: Advanced data assimilation for strongly nonlinear dynamics,
Mon. Weather Rev., 125, 1342–1354, 1997.</mixed-citation></ref>
      <ref id="bib1.bib6"><label>6</label><?label 1?><mixed-citation>Flossmann, A. I., Manton, M., Abshaev, A., Bruintjes, R., Murakami, M.,
Prabhakaran, T., and Yao, Z.: Review of advances in precipitation
enhancement research, Bull. Am. Meteorol. Soc., 100, 1465–1480,
<ext-link xlink:href="https://doi.org/10.1175/BAMS-D-18-0160.1" ext-link-type="DOI">10.1175/BAMS-D-18-0160.1</ext-link>, 2019.</mixed-citation></ref>
      <ref id="bib1.bib7"><label>7</label><?label 1?><mixed-citation>Hoffmann, R. S. and Atlas, R.,: Future observing system simulation
experiments, B. Am. Meteorol. Soc., 97, 1601–1616,
<ext-link xlink:href="https://doi.org/10.1175/BAMS-D-15-00200.1" ext-link-type="DOI">10.1175/BAMS-D-15-00200.1</ext-link>, 2016.</mixed-citation></ref>
      <ref id="bib1.bib8"><label>8</label><?label 1?><mixed-citation>Houtekamer, P. L. and Zhang, F.: Review of the ensemble Kalman filter for
atmospheric data assimilation, Mon. Weather Rev., 144, 4489–4532, 2016.</mixed-citation></ref>
      <ref id="bib1.bib9"><label>9</label><?label 1?><mixed-citation>Kalman, R. E.: A new approach to linear filtering and prediction problems,
Transactions of the ASME – Journal of Basic Engineering, 82, 35–45, 1960.</mixed-citation></ref>
      <ref id="bib1.bib10"><label>10</label><?label 1?><mixed-citation>Kalnay, E., Li, H., Miyoshi, T., Yang, S.-C., and Ballabrera-Poy, J.: 4D-Var
or Ensemble Kalman Filter?, Tellus, 59A, 758–773, 2007.</mixed-citation></ref>
      <ref id="bib1.bib11"><label>11</label><?label 1?><mixed-citation>Li Y., Kalnay, E., Matesharrei, S., Rivas, J., Kucharski, F., Kirk-Davidoff,
D., Bach, E., and Zeng, N.: Climate model shows large-scale wind and solar
farms in the Sahara increase rain and vegetation, Science, 361, 1019–1022,
2018.</mixed-citation></ref>
      <ref id="bib1.bib12"><label>12</label><?label 1?><mixed-citation>Lorenz, E. N.: Deterministic nonperiodic flow, J. Atmos. Sci., 20, 130–141,
1963.</mixed-citation></ref>
      <ref id="bib1.bib13"><label>13</label><?label 1?><mixed-citation>Lorenz, E. N.: The Essence of Chaos, University of Washington Press,
Seattle, Washington, United States, 227 pp., ISBN 9780295975146, 1993.</mixed-citation></ref>
      <ref id="bib1.bib14"><label>14</label><?label 1?><mixed-citation>Miller, R., Ghil, M., and Gauthiez, F.: Advanced data assimilation in
strongly nonlinear dynamical systems, J. Atmos. Sci., 51, 1037–1056, 1994.</mixed-citation></ref>
      <ref id="bib1.bib15"><label>15</label><?label 1?><mixed-citation>Miyoshi, T. and Sun, Q.: Control Simulation Experiment (CSE) with the Lorenz-63 model, TIB AV-Portal [video], <ext-link xlink:href="https://doi.org/10.5446/54893" ext-link-type="DOI">10.5446/54893</ext-link>, 2021.</mixed-citation></ref>
      <ref id="bib1.bib16"><label>16</label><?label 1?><mixed-citation>Toth, Z. and Kalnay, E.: Ensemble Forecasting at NMC: The Generation of
Perturbations, B. Am. Meteorol. Soc., 74, 2317–2330,
<ext-link xlink:href="https://doi.org/10.1175/1520-0477(1993)074&lt;2317:EFANTG&gt;2.0.CO;2" ext-link-type="DOI">10.1175/1520-0477(1993)074&lt;2317:EFANTG&gt;2.0.CO;2</ext-link>,
1993.</mixed-citation></ref>
      <ref id="bib1.bib17"><label>17</label><?label 1?><mixed-citation>Yang, S.-C., Baker, D., Li, H., Cordes, K., Huff, M., Nagpal, G., Okereke,
E., Villafañe, J., Kalnay, E., and Duane, G. S.: Data assimilation as
synchronization of truth and model: experiments with the three-variable
Lorenz system, J. Atmos. Sci., 63, 2340–2354, <ext-link xlink:href="https://doi.org/10.1175/JAS3739.1" ext-link-type="DOI">10.1175/JAS3739.1</ext-link>, 2006.</mixed-citation></ref>
      <ref id="bib1.bib18"><label>18</label><?label 1?><mixed-citation>Yang, S.-C., Kalnay, E., and Hunt, B.: Handling nonlinearity in an ensemble
Kalman filter: experiments with the three-variable Lorenz model, Mon. Weather
Rev., 140, 2628–2646, 2012.</mixed-citation></ref>

  </ref-list></back>
    <!--<article-title-html>Control simulation experiment with Lorenz's butterfly attractor</article-title-html>
<abstract-html/>
<ref-html id="bib1.bib1"><label>1</label><mixed-citation>
Atlas, R., Kalnay, E., Baker, W. E., Susskind, J., Reuter, D., and Halem,
M.: Simulation studies of the impact of future observing systems on weather
prediction, Preprints, Seventh Conf. on Numerical Weather Prediction,
Montreal, QC, Canada, Amer. Meteor. Soc., 145–151, 1985.
</mixed-citation></ref-html>
<ref-html id="bib1.bib2"><label>2</label><mixed-citation>Boccaletti, S., Grebogi, C., Lai, Y.-C., Mancini, H., and Maza, D.: The
control of chaos: theory and applications, Phys. Rep., 329, 103–197,
<a href="https://doi.org/10.1016/S0370-1573(99)00096-4" target="_blank">https://doi.org/10.1016/S0370-1573(99)00096-4</a>, 2000.

</mixed-citation></ref-html>
<ref-html id="bib1.bib3"><label>3</label><mixed-citation>Evans, E., Bhatti, N., Kinney, J., Pann, L., Peňa, M., Yang, S. C.,
Kalnay, E., and Hansen, J.: RISE undergraduates find that regime changes in
Lorenz's model are predictable, B. Am. Meteorol. Soc., 85, 521–524,
2004.
</mixed-citation></ref-html>
<ref-html id="bib1.bib4"><label>4</label><mixed-citation>Evensen, G.: Sequential data assimilation with a nonlinear quasi-geostrophic
model using Monte Carlo methods to forecast error statistics, J. Geophys.
Res., 99, 10143–10162, <a href="https://doi.org/10.1029/94JC00572" target="_blank">https://doi.org/10.1029/94JC00572</a>, 1994.
</mixed-citation></ref-html>
<ref-html id="bib1.bib5"><label>5</label><mixed-citation>Evensen, G.: Advanced data assimilation for strongly nonlinear dynamics,
Mon. Weather Rev., 125, 1342–1354, 1997.
</mixed-citation></ref-html>
<ref-html id="bib1.bib6"><label>6</label><mixed-citation>Flossmann, A. I., Manton, M., Abshaev, A., Bruintjes, R., Murakami, M.,
Prabhakaran, T., and Yao, Z.: Review of advances in precipitation
enhancement research, Bull. Am. Meteorol. Soc., 100, 1465–1480,
<a href="https://doi.org/10.1175/BAMS-D-18-0160.1" target="_blank">https://doi.org/10.1175/BAMS-D-18-0160.1</a>, 2019.
</mixed-citation></ref-html>
<ref-html id="bib1.bib7"><label>7</label><mixed-citation>Hoffmann, R. S. and Atlas, R.,: Future observing system simulation
experiments, B. Am. Meteorol. Soc., 97, 1601–1616,
<a href="https://doi.org/10.1175/BAMS-D-15-00200.1" target="_blank">https://doi.org/10.1175/BAMS-D-15-00200.1</a>, 2016.
</mixed-citation></ref-html>
<ref-html id="bib1.bib8"><label>8</label><mixed-citation>Houtekamer, P. L. and Zhang, F.: Review of the ensemble Kalman filter for
atmospheric data assimilation, Mon. Weather Rev., 144, 4489–4532, 2016.
</mixed-citation></ref-html>
<ref-html id="bib1.bib9"><label>9</label><mixed-citation>Kalman, R. E.: A new approach to linear filtering and prediction problems,
Transactions of the ASME – Journal of Basic Engineering, 82, 35–45, 1960.
</mixed-citation></ref-html>
<ref-html id="bib1.bib10"><label>10</label><mixed-citation>Kalnay, E., Li, H., Miyoshi, T., Yang, S.-C., and Ballabrera-Poy, J.: 4D-Var
or Ensemble Kalman Filter?, Tellus, 59A, 758–773, 2007.
</mixed-citation></ref-html>
<ref-html id="bib1.bib11"><label>11</label><mixed-citation>Li Y., Kalnay, E., Matesharrei, S., Rivas, J., Kucharski, F., Kirk-Davidoff,
D., Bach, E., and Zeng, N.: Climate model shows large-scale wind and solar
farms in the Sahara increase rain and vegetation, Science, 361, 1019–1022,
2018.
</mixed-citation></ref-html>
<ref-html id="bib1.bib12"><label>12</label><mixed-citation>Lorenz, E. N.: Deterministic nonperiodic flow, J. Atmos. Sci., 20, 130–141,
1963.
</mixed-citation></ref-html>
<ref-html id="bib1.bib13"><label>13</label><mixed-citation>Lorenz, E. N.: The Essence of Chaos, University of Washington Press,
Seattle, Washington, United States, 227 pp., ISBN 9780295975146, 1993.
</mixed-citation></ref-html>
<ref-html id="bib1.bib14"><label>14</label><mixed-citation>Miller, R., Ghil, M., and Gauthiez, F.: Advanced data assimilation in
strongly nonlinear dynamical systems, J. Atmos. Sci., 51, 1037–1056, 1994.
</mixed-citation></ref-html>
<ref-html id="bib1.bib15"><label>15</label><mixed-citation>
Miyoshi, T. and Sun, Q.: Control Simulation Experiment (CSE) with the Lorenz-63 model, TIB AV-Portal [video], <a href="https://doi.org/10.5446/54893" target="_blank">https://doi.org/10.5446/54893</a>, 2021.
</mixed-citation></ref-html>
<ref-html id="bib1.bib16"><label>16</label><mixed-citation>Toth, Z. and Kalnay, E.: Ensemble Forecasting at NMC: The Generation of
Perturbations, B. Am. Meteorol. Soc., 74, 2317–2330,
<a href="https://doi.org/10.1175/1520-0477(1993)074&lt;2317:EFANTG&gt;2.0.CO;2" target="_blank">https://doi.org/10.1175/1520-0477(1993)074&lt;2317:EFANTG&gt;2.0.CO;2</a>,
1993.
</mixed-citation></ref-html>
<ref-html id="bib1.bib17"><label>17</label><mixed-citation>Yang, S.-C., Baker, D., Li, H., Cordes, K., Huff, M., Nagpal, G., Okereke,
E., Villafañe, J., Kalnay, E., and Duane, G. S.: Data assimilation as
synchronization of truth and model: experiments with the three-variable
Lorenz system, J. Atmos. Sci., 63, 2340–2354, <a href="https://doi.org/10.1175/JAS3739.1" target="_blank">https://doi.org/10.1175/JAS3739.1</a>, 2006.
</mixed-citation></ref-html>
<ref-html id="bib1.bib18"><label>18</label><mixed-citation>Yang, S.-C., Kalnay, E., and Hunt, B.: Handling nonlinearity in an ensemble
Kalman filter: experiments with the three-variable Lorenz model, Mon. Weather
Rev., 140, 2628–2646, 2012.
</mixed-citation></ref-html>--></article>
