<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing with OASIS Tables v3.0 20080202//EN" "journalpub-oasis3.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:oasis="http://docs.oasis-open.org/ns/oasis-exchange/table" dtd-version="3.0">
  <front>
    <journal-meta>
<journal-id journal-id-type="publisher">NPG</journal-id>
<journal-title-group>
<journal-title>Nonlinear Processes in Geophysics</journal-title>
<abbrev-journal-title abbrev-type="publisher">NPG</abbrev-journal-title>
<abbrev-journal-title abbrev-type="nlm-ta">Nonlin. Processes Geophys.</abbrev-journal-title>
</journal-title-group>
<issn pub-type="epub">1607-7946</issn>
<publisher><publisher-name>Copernicus Publications</publisher-name>
<publisher-loc>Göttingen, Germany</publisher-loc>
</publisher>
</journal-meta>

    <article-meta>
      <article-id pub-id-type="doi">10.5194/npg-23-307-2016</article-id><title-group><article-title>A new estimator of heat periods for decadal climate predictions –<?xmltex \hack{\newline}?> a complex network approach</article-title>
      </title-group><?xmltex \runningtitle{A new estimator for heat periods in decadal climate
predictions}?><?xmltex \runningauthor{M.~Weimer et al.}?>
      <contrib-group>
        <contrib contrib-type="author" corresp="yes" rid="aff1">
          <name><surname>Weimer</surname><given-names>Michael</given-names></name>
          
        </contrib>
        <contrib contrib-type="author" corresp="no" rid="aff1 aff2">
          <name><surname>Mieruch</surname><given-names>Sebastian</given-names></name>
          
        </contrib>
        <contrib contrib-type="author" corresp="no" rid="aff1">
          <name><surname>Schädler</surname><given-names>Gerd</given-names></name>
          
        </contrib>
        <contrib contrib-type="author" corresp="no" rid="aff1">
          <name><surname>Kottmeier</surname><given-names>Christoph</given-names></name>
          
        </contrib>
        <aff id="aff1"><label>1</label><institution>Institute of Meteorology and Climate Research, Karlsruhe Institute of Technology, Karlsruhe, Germany</institution>
        </aff>
        <aff id="aff2"><label>2</label><institution>Alfred Wegener Institute, Helmholtz Centre for Polar and Marine Research (AWI), Bremerhaven, Germany</institution>
        </aff>
      </contrib-group>
      <author-notes><corresp id="corr1">M. Weimer (michael.weimer@kit.edu)</corresp></author-notes><pub-date><day>24</day><month>August</month><year>2016</year></pub-date>
      
      <volume>23</volume>
      <issue>4</issue>
      <fpage>307</fpage><lpage>317</lpage>
      <history>
        <date date-type="received"><day>14</day><month>July</month><year>2015</year></date>
           <date date-type="rev-request"><day>13</day><month>October</month><year>2015</year></date>
           <date date-type="rev-recd"><day>20</day><month>July</month><year>2016</year></date>
           <date date-type="accepted"><day>21</day><month>July</month><year>2016</year></date>
      </history>
      <permissions>
<license license-type="open-access">
<license-p>This work is licensed under a Creative Commons Attribution 3.0 Unported License. To view a copy of this license, visit <ext-link ext-link-type="uri" xlink:href="http://creativecommons.org/licenses/by/3.0/">http://creativecommons.org/licenses/by/3.0/</ext-link></license-p>
</license>
</permissions><self-uri xlink:href="https://npg.copernicus.org/articles/23/307/2016/npg-23-307-2016.html">This article is available from https://npg.copernicus.org/articles/23/307/2016/npg-23-307-2016.html</self-uri>
<self-uri xlink:href="https://npg.copernicus.org/articles/23/307/2016/npg-23-307-2016.pdf">The full text article is available as a PDF file from https://npg.copernicus.org/articles/23/307/2016/npg-23-307-2016.pdf</self-uri>


      <abstract>
    <p>Regional decadal predictions have emerged in the past few years as a research
field with high application potential, especially for extremes like heat and
drought periods. However, up to now the prediction skill of decadal
hindcasts, as evaluated with standard methods, is moderate and for extreme
values even rarely investigated. In this study, we use hindcast data from
a regional climate model (CCLM) for eight regions in Europe and quantify the
skill of the model alternatively by constructing time-evolving climate
networks and use the network correlation threshold (link strength) as
a predictor for heat periods. We show that the skill of the network measure
to estimate the low-frequency dynamics of heat periods is superior for
decadal predictions with respect to the typical approach of using a fixed
temperature threshold for estimating the number of heat periods in Europe.</p>
  </abstract>
    </article-meta>
  </front>
<body>
      

<sec id="Ch1.S1" sec-type="intro">
  <title>Introduction</title>
      <p>Decadal prediction is a relatively new field in climate research. Skillful
prediction of climate from years up to a decade would be beneficial for our
society, economy and for a better adaption to a changing climate. Within the
large international Coupled Model Intercomparison Project Phase 5
(<xref ref-type="bibr" rid="bib1.bibx32" id="altparen.1"><named-content content-type="pre">CMIP5</named-content></xref>) global decadal predictions of climate key
variables like temperature and precipitation have been performed with
state-of-the-art Earth system models. In order to validate the prediction
skill of the models so-called hindcast experiments are conducted. That means
the models are initialized with observations (e.g., in 1961) and then run freely
for 10 years and stop at the end of 1970. In 1971, the models are again
initialized and start to run for another 10 years and so on. More advanced
approaches of initializing every year have followed as well. These hindcasts
can be evaluated against observational data to quantify the prediction skill
of the models depending on the lead time, which is the time range between the
initialization and the forecast datum of interest. In recent years, several
studies on decadal predictions have shown the potential of these initialized
(global) model runs
(e.g., <xref ref-type="bibr" rid="bib1.bibx19 bib1.bibx26 bib1.bibx23 bib1.bibx35 bib1.bibx5 bib1.bibx6 bib1.bibx13 bib1.bibx30 bib1.bibx24 bib1.bibx4" id="altparen.2"/>).
However most studies concentrate on regions like the tropical Pacific or
North Atlantic and on slowly evolving variables like sea-surface temperature.
These regions receive their predictability from large-scale processes like
the Atlantic Meridional Overturning Circulation (AMOC) or Pacific Decadal
Oscillation (PDO) and thus allow the extraction of predictable signals out of the
noise. To be useful for society and climate change adaption, regional
climate predictions are required, which should provide skillful forecasts on
smaller regions and shorter periods, and they include climate extreme events on
populated land areas like the European continent. The European climate is
more connected to short-term processes like the North Atlantic Oscillation
(NAO), which is to a certain extent predictable on seasonal scales, whereas
the decadal predictable signal is weak <xref ref-type="bibr" rid="bib1.bibx29" id="paren.3"/>, which has been
shown also for temperature and precipitation in large projects like ENSEMBLES
<xref ref-type="bibr" rid="bib1.bibx22" id="paren.4"/>. Further, the complex orography with the Alps in the
center contributes to a manifold of general weather situations and hence to
a complex climate <xref ref-type="bibr" rid="bib1.bibx17 bib1.bibx14" id="paren.5"><named-content content-type="pre">e.g., World Climate Research Programme Coordinated
Regional Downscaling Experiment for Europe
(CORDEX-EU),</named-content></xref>. Nevertheless, the European continent
is influenced by the AMOC and thus this process may yield to a certain
predictability, although the signal-to-noise ratio is most probably small. Up
to now, the prediction skill for Europe is weaker than for regions such as
the South Pacific or North Atlantic. <xref ref-type="bibr" rid="bib1.bibx25" id="text.6"/> have used
a regional decadal hindcast ensemble for Europe and detected moderate
prediction skill for summer and winter temperature and summer precipitation
anomalies within the lead time of 5 years. <xref ref-type="bibr" rid="bib1.bibx11" id="text.7"/> analyzed the
predictability of temperature and precipitation extremes in a global model
and found a moderate but significant skill (correlation) for seasonal
extremes. They also found skill beyond the first year, but this skill arose
from external forcing. Thus, <xref ref-type="bibr" rid="bib1.bibx11" id="text.8"/> compared initialized climate
predictions with uninitialized projections to evaluate the skill gained by
initializing and excluding the external forcing. They found that the
“impact of initialization is disappointing”.</p>
      <p>Another relatively new field in climate research has been established, namely
the complex climate network approach. The general idea of climate networks is
to consider climate time series, for example, at the grid points of a climate model as
nodes of the network and the statistical connection between the time series
as links of the network. A link between two arbitrary time series
(geolocations) exists if the correlation measure between the time series
exceeds a certain threshold.</p>
      <p>The climate network community has been very active in recent years.
<xref ref-type="bibr" rid="bib1.bibx34" id="text.9"/> proposed “A new dynamical mechanism for major climate
shifts” and explained, e.g., decadal shifts in global mean temperature
<xref ref-type="bibr" rid="bib1.bibx33" id="paren.10"/>. <xref ref-type="bibr" rid="bib1.bibx28" id="text.11"/> discriminated different El Niño
types using the network approach, <xref ref-type="bibr" rid="bib1.bibx21" id="text.12"/> developed a network
method to improve El Niño forecasting, and <xref ref-type="bibr" rid="bib1.bibx9" id="text.13"/> revealed
a connection between (paleo-)climate variability and human evolution using
recurrence networks, which are similar to the complex climate networks.
Generally, it has been shown that climate networks contain useful information
for climate applications, e.g., the relation between climate and topography
found by <xref ref-type="bibr" rid="bib1.bibx27" id="text.14"/>, dynamics of the sun activity using visibility
graphs <xref ref-type="bibr" rid="bib1.bibx37" id="paren.15"/>, and the prediction of extreme floods
<xref ref-type="bibr" rid="bib1.bibx3" id="paren.16"/>.</p>
      <p>In this paper, we exploit the idea to use an alternative heat period
estimator, based on complex climate networks, and show that its skill is
superior to the typical approach of using a fixed temperature threshold for
prediction of heat periods on timescales up to a decade.</p>
      <p>In Sect. <xref ref-type="sec" rid="Ch1.S2"/> we introduce the daily maximum temperature data used in
this study and the motivation for our approach in Sect. <xref ref-type="sec" rid="Ch1.S3"/>.
Section <xref ref-type="sec" rid="Ch1.S4"/> describes our approach, which includes the preparation
of the data, the definition of heat periods, and the construction of time-evolving climate networks. The results for applying the new approach to
hindcasts are shown in Sect. <xref ref-type="sec" rid="Ch1.S5"/>. Finally, we give the conclusions
and an outlook in Sect. <xref ref-type="sec" rid="Ch1.S6"/>.</p>
</sec>
<sec id="Ch1.S2">
  <title>Data</title>
      <p>We apply the climate network approach to a decadal prediction ensemble
generated within the German research project MiKlip (Mittelfristige
Klimaprognosen, Decadal Climate Prediction; e.g., <xref ref-type="bibr" rid="bib1.bibx18" id="altparen.17"/>) by the
regional COSMO model in CLimate Mode (COSMO-CLM or CCLM) <xref ref-type="bibr" rid="bib1.bibx7" id="paren.18"/>.
CCLM has been used in numerous studies recently (e.g., in
<xref ref-type="bibr" rid="bib1.bibx20 bib1.bibx10" id="altparen.19"/>). A comprehensive overview can be found here:
<uri>http://www.clm-community.eu</uri>. CCLM has been used to downscale global
decadal predictions from the Earth System Model of the Max Planck Institute
for Meteorology <xref ref-type="bibr" rid="bib1.bibx31" id="paren.20"><named-content content-type="pre">MPI-ESM,</named-content></xref>. From a suite of different
decadal prediction experiments we have selected the so-called regional
baseline 0 ensemble. This ensemble consists of 10 members, each covering the
period 1961–2010 for the European region <xref ref-type="bibr" rid="bib1.bibx17 bib1.bibx14" id="paren.21"><named-content content-type="pre">according to
CORDEX-EU</named-content></xref> on a 0.22<inline-formula><mml:math display="inline"><mml:msup><mml:mi/><mml:mo>∘</mml:mo></mml:msup></mml:math></inline-formula> grid. This ensemble
has already been used by <xref ref-type="bibr" rid="bib1.bibx25" id="text.22"/>.</p>
      <p>The regional baseline 0 ensemble (based on the global MPI-ESM model) has been
initialized every 10 years (1961, 1971, 1981, 1991, 2001). Within a decade
the CCLM model runs freely, except for the prescription of the atmospheric
boundary conditions by the global MPI-ESM model.</p>
      <p>More details on the development of the ensemble and the initialization can be
found in <xref ref-type="bibr" rid="bib1.bibx23" id="text.23"/>, <xref ref-type="bibr" rid="bib1.bibx26" id="text.24"/>, and <xref ref-type="bibr" rid="bib1.bibx25" id="text.25"/>.</p>
      <p>In the study presented here we use daily maximum near-surface temperatures
from the CCLM model and from the E-OBS v8.0 gridded climatology
<xref ref-type="bibr" rid="bib1.bibx15" id="paren.26"/> for the European continent. The E-OBS data basically are
measurements interpolated to a regular latitude–longitude grid.</p>
      <p>For our comparison, we use the so-called Prudence regions
<uri>http://prudence.dmi.dk/</uri>, namely British Isles, Iberian Peninsula,
France, Central Europe, Scandinavia, Alps, the Mediterranean, and Eastern Europe
(shown in Fig. <xref ref-type="fig" rid="Ch1.F1"/>).</p>
</sec>
<sec id="Ch1.S3">
  <title>Motivation</title>
      <p>Generally, heat periods are maximum temperature values persisting for several
days and occurring on spatially expanded regions. This means that many
temperature time series (grid points) behave in a “cooperative mode” (see,
e.g., <xref ref-type="bibr" rid="bib1.bibx21" id="altparen.27"/>). This cooperative state can be described by
the link strength, i.e., essentially the correlation between time series, of a
climate network. Thus, the link strength of a climate network could turn out
to be the better heat period estimator for model data, because it is
independent of the typically critical thresholds used in classical extreme
value detection.</p>
      <p>The standard estimator for heat periods according to the World Meteorological
Organization (WMO) is that the daily maximum temperature is <inline-formula><mml:math display="inline"><mml:mrow><mml:mn mathvariant="normal">5</mml:mn><mml:mspace width="0.125em" linebreak="nobreak"/><mml:mi mathvariant="normal">K</mml:mi></mml:mrow></mml:math></inline-formula>
above the 1961–1990 mean maximum temperature at five consecutive days at
least <xref ref-type="bibr" rid="bib1.bibx12" id="paren.28"/>. Thus, the standard method to compare the prediction
skill of heat periods between observations and model would be to count the
heat periods, e.g., for each year in an observational reference data set and
similarly in the model data, both according to the WMO definition (cf.
Fig. <xref ref-type="fig" rid="Ch1.F2"/>).</p>
      <p>A crucial problem of the standard estimator for model predictions is the
inherent static threshold used to detect heat periods. Although this
threshold can be adapted to the model climatology (as we do it in
Sect. <xref ref-type="sec" rid="Ch1.S4.SS2"/>) the problem is that it is still likely
that the model slightly undershoots or otherwise slightly misses the
threshold if a heat period according to the definition at the very beginning
of this section occurs, assuming the model exhibits at least some predictive
skill.</p>
      <p>To account for this situation in decadal predictions we propose a new method,
based on complex climate networks, to detect heat periods, which is
independent of a fixed temperature threshold (see Sect. <xref ref-type="sec" rid="Ch1.S4.SS3"/>).
Again we want to emphasize that no new method for the detection of heat
periods is needed, if past observational data or short-term forecasts are
used. The WMO-based definition works well. However, the increased uncertainty
in decadal predictions requires new methods to handle climate extremes like
heat periods.</p>

      <?xmltex \floatpos{t}?><fig id="Ch1.F1"><caption><p>The eight Prudence regions (topography: ETOPO1;
<xref ref-type="bibr" rid="bib1.bibx1" id="altparen.29"/>).</p></caption>
        <?xmltex \igopts{width=241.848425pt}?><graphic xlink:href="https://npg.copernicus.org/articles/23/307/2016/npg-23-307-2016-f01.jpg"/>

      </fig>

      <?xmltex \floatpos{t}?><fig id="Ch1.F2"><caption><p>Schematical illustration of our approach
(temperature anomaly on the <inline-formula><mml:math display="inline"><mml:mi>y</mml:mi></mml:math></inline-formula> axis): <bold>(a)</bold> model detects correctly
one heat period above the threshold, <bold>(b)</bold> model underestimates the
number of heat periods, and <bold>(c)</bold> model overestimates the number of heat
periods (for details see text).</p></caption>
        <?xmltex \igopts{width=241.848425pt}?><graphic xlink:href="https://npg.copernicus.org/articles/23/307/2016/npg-23-307-2016-f02.pdf"/>

      </fig>

      <?xmltex \floatpos{t}?><fig id="Ch1.F3"><caption><p><bold>(a)</bold> Artificial time series including
three heat periods (dashed lines). <bold>(b)</bold> Relation between the network link
strength and the number of heat periods, based on 100 artificial time
series.</p></caption>
        <?xmltex \igopts{width=241.848425pt}?><graphic xlink:href="https://npg.copernicus.org/articles/23/307/2016/npg-23-307-2016-f03.pdf"/>

      </fig>

      <p>The following schematic examples in Figs. <xref ref-type="fig" rid="Ch1.F2"/>a–c and
<xref ref-type="fig" rid="Ch1.F3"/> illustrate why the complex network approach is able to
detect heat periods without using a temperature threshold. The black curves
represent (artificially generated) daily maximum temperature model data.
Further we assume that one heat period has actually occurred in
Fig. <xref ref-type="fig" rid="Ch1.F2"/>a–c persisting for <inline-formula><mml:math display="inline"><mml:mrow><mml:mn>15</mml:mn><mml:mspace width="0.125em" linebreak="nobreak"/><mml:mi mathvariant="normal">days</mml:mi></mml:mrow></mml:math></inline-formula> from day 11 to
day 25. Accordingly the black curves show different possible model results if
the model exhibits predictive skill to detect a signal out of the noise.</p>
      <p>Figure <xref ref-type="fig" rid="Ch1.F2"/>a depicts that using the standard approach the model
correctly detects one heat period above the threshold. In
Fig. <xref ref-type="fig" rid="Ch1.F2"/>b the model detects a signal, but this signal is too
weak to cross the threshold; thus no heat period would have been detected and
the model underestimates the number of heat periods. Overestimation of the
number of heat periods happens in Fig. <xref ref-type="fig" rid="Ch1.F2"/>c, where the model
detects two heat periods (5 days above the threshold at the edges and below
the threshold in between). Now, the key point for our motivation is that
a heat period constitutes an event in space and time; thus in a certain
region, many time series would look like the ones in Fig. <xref ref-type="fig" rid="Ch1.F2"/>.
The link strength of a network would be given by the correlation between
these coherent time series. Since the signals in Fig. <xref ref-type="fig" rid="Ch1.F2"/>a–c
look quite similar, the link strength of the network would thus be very
similar in all three cases. Whereas the standard approach would correctly
estimate the heat period in only one case (Fig. <xref ref-type="fig" rid="Ch1.F2"/>a), the
networks' link strength would correctly estimate it in all three cases, given
a proper relation between link strength and heat periods.</p>
      <p>To test the relation in principle, we created 100 artificial time series
(Gaussian noise) and included successively 0–9 heat periods.
Figure <xref ref-type="fig" rid="Ch1.F3"/>a shows such a time series with three artificial
heat periods indicated by the dashed lines. In a following step, we
calculated the mean correlation (link strength) between these 100 coherent
time series dependent on the number of included heat periods depicted in
Fig. <xref ref-type="fig" rid="Ch1.F3"/>b. As can be seen, more heat periods are connected
with a larger link strength. This simplified test shows that a proper
relation between link strength and heat periods could exist. Note that
Fig. <xref ref-type="fig" rid="Ch1.F3"/>b is not a calibration curve for real data, because we
simply used Gaussian noise to create the time series.</p>
      <p>It is clear that the argumentation above concerning the link strength as
a heat period estimator is quite simplistic, but it elucidates our approach
and the main idea.</p>
</sec>
<sec id="Ch1.S4">
  <title>Method</title>
      <p>Our hypothesis is that complex network measures may be better estimators for
climate extremes than standard measures like absolute threshold exceedances.</p>
<sec id="Ch1.S4.SS1">
  <title>Data pre-processing</title>
      <p>Before using the complex networks in general it is necessary to remove
stationary biases and long-term variabilities from the climate time series
<xref ref-type="bibr" rid="bib1.bibx8" id="paren.30"/>.</p>
      <p>We remove bias, trend, and the average annual cycle by subtracting a standard
linear regression including a Fourier series from the time series according
to

                <disp-formula id="Ch1.E1" content-type="numbered"><mml:math display="block"><mml:mrow><?xmltex \hack{\hbox\bgroup\fontsize{8.3}{8.3}\selectfont$\displaystyle}?><mml:msub><mml:mi>y</mml:mi><mml:mi>i</mml:mi></mml:msub><mml:mo>(</mml:mo><mml:mi>t</mml:mi><mml:mo>)</mml:mo><mml:mo>=</mml:mo><mml:msub><mml:mi mathvariant="italic">δ</mml:mi><mml:mi>i</mml:mi></mml:msub><mml:mo>+</mml:mo><mml:msub><mml:mi mathvariant="italic">ω</mml:mi><mml:mi>i</mml:mi></mml:msub><mml:mi>t</mml:mi><mml:mo>+</mml:mo><mml:munderover><mml:mo movablelimits="false">∑</mml:mo><mml:mrow><mml:mi>j</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">1</mml:mn></mml:mrow><mml:mn mathvariant="normal">2</mml:mn></mml:munderover><mml:msub><mml:mi mathvariant="italic">α</mml:mi><mml:mrow><mml:mi>i</mml:mi><mml:mo>,</mml:mo><mml:mi>j</mml:mi></mml:mrow></mml:msub><mml:mi>sin⁡</mml:mi><mml:mfenced close=")" open="("><mml:mstyle displaystyle="true"><mml:mfrac style="display"><mml:mrow><mml:mn mathvariant="normal">2</mml:mn><mml:mi mathvariant="italic">π</mml:mi><mml:mi>j</mml:mi><mml:mo>⋅</mml:mo><mml:mi>t</mml:mi></mml:mrow><mml:mn>365.25</mml:mn></mml:mfrac></mml:mstyle></mml:mfenced><mml:mo>+</mml:mo><mml:msub><mml:mi mathvariant="italic">β</mml:mi><mml:mrow><mml:mi>i</mml:mi><mml:mo>,</mml:mo><mml:mi>j</mml:mi></mml:mrow></mml:msub><mml:mi>cos⁡</mml:mi><mml:mfenced open="(" close=")"><mml:mstyle displaystyle="true"><mml:mfrac style="display"><mml:mrow><mml:mn mathvariant="normal">2</mml:mn><mml:mi mathvariant="italic">π</mml:mi><mml:mi>j</mml:mi><mml:mo>⋅</mml:mo><mml:mi>t</mml:mi></mml:mrow><mml:mn>365.25</mml:mn></mml:mfrac></mml:mstyle></mml:mfenced><mml:mo>,</mml:mo><?xmltex \hack{$\egroup}?></mml:mrow></mml:math></disp-formula>

          where <inline-formula><mml:math display="inline"><mml:mrow><mml:msub><mml:mi>y</mml:mi><mml:mi>i</mml:mi></mml:msub><mml:mo>(</mml:mo><mml:mi>t</mml:mi><mml:mo>)</mml:mo></mml:mrow></mml:math></inline-formula> represents daily maximum temperature from 1961 to 2010,
<inline-formula><mml:math display="inline"><mml:mrow><mml:msub><mml:mi mathvariant="italic">δ</mml:mi><mml:mi>i</mml:mi></mml:msub></mml:mrow></mml:math></inline-formula> is the intercept, <inline-formula><mml:math display="inline"><mml:mrow><mml:msub><mml:mi mathvariant="italic">ω</mml:mi><mml:mi>i</mml:mi></mml:msub></mml:mrow></mml:math></inline-formula> is the linear trend, and <inline-formula><mml:math display="inline"><mml:mrow><mml:msub><mml:mi mathvariant="italic">α</mml:mi><mml:mrow><mml:mi>i</mml:mi><mml:mo>,</mml:mo><mml:mi>j</mml:mi></mml:mrow></mml:msub></mml:mrow></mml:math></inline-formula> and <inline-formula><mml:math display="inline"><mml:mrow><mml:msub><mml:mi mathvariant="italic">β</mml:mi><mml:mrow><mml:mi>i</mml:mi><mml:mo>,</mml:mo><mml:mi>j</mml:mi></mml:mrow></mml:msub></mml:mrow></mml:math></inline-formula> represent the Fourier coefficients.
Equation (<xref ref-type="disp-formula" rid="Ch1.E1"/>) is evaluated individually at each grid point
<inline-formula><mml:math display="inline"><mml:mrow><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">1</mml:mn><mml:mo>,</mml:mo><mml:mi mathvariant="normal">…</mml:mi><mml:mo>,</mml:mo><mml:mi>N</mml:mi></mml:mrow></mml:math></inline-formula>.</p>
      <p>In order to minimize the influence of cold periods on the network approach
(details below in Sect. <xref ref-type="sec" rid="Ch1.S4.SS3"/>), we remove the data lower than
the 10 % quantile. This filtering has no influence on the standard
estimator of heat periods. Then, the months from June to September are
selected because we are interested in summer heat periods.</p>

<table-wrap id="Ch1.T1" specific-use="star"><caption><p>Ensemble mean variation of the temperature threshold
calculated for heat periods with the standard approach in CCLM data (see
Sect. <xref ref-type="sec" rid="Ch1.S4.SS2"/>).</p></caption><oasis:table frame="topbot"><oasis:tgroup cols="9">
     <oasis:colspec colnum="1" colname="col1" align="left"/>
     <oasis:colspec colnum="2" colname="col2" align="center"/>
     <oasis:colspec colnum="3" colname="col3" align="center"/>
     <oasis:colspec colnum="4" colname="col4" align="center"/>
     <oasis:colspec colnum="5" colname="col5" align="center"/>
     <oasis:colspec colnum="6" colname="col6" align="center"/>
     <oasis:colspec colnum="7" colname="col7" align="center"/>
     <oasis:colspec colnum="8" colname="col8" align="center"/>
     <oasis:colspec colnum="9" colname="col9" align="center"/>
     <oasis:thead>
       <oasis:row rowsep="1">  
         <oasis:entry colname="col1">Prudence region</oasis:entry>  
         <oasis:entry colname="col2">1</oasis:entry>  
         <oasis:entry colname="col3">2</oasis:entry>  
         <oasis:entry colname="col4">3</oasis:entry>  
         <oasis:entry colname="col5">4</oasis:entry>  
         <oasis:entry colname="col6">5</oasis:entry>  
         <oasis:entry colname="col7">6</oasis:entry>  
         <oasis:entry colname="col8">7</oasis:entry>  
         <oasis:entry colname="col9">8</oasis:entry>
       </oasis:row>
     </oasis:thead>
     <oasis:tbody>
       <oasis:row>  
         <oasis:entry colname="col1">Temperature threshold (in K)</oasis:entry>  
         <oasis:entry colname="col2">3.16</oasis:entry>  
         <oasis:entry colname="col3">3.38</oasis:entry>  
         <oasis:entry colname="col4">2.81</oasis:entry>  
         <oasis:entry colname="col5">2.52</oasis:entry>  
         <oasis:entry colname="col6">2.66</oasis:entry>  
         <oasis:entry colname="col7">2.85</oasis:entry>  
         <oasis:entry colname="col8">3.46</oasis:entry>  
         <oasis:entry colname="col9">2.79</oasis:entry>
       </oasis:row>
     </oasis:tbody>
   </oasis:tgroup></oasis:table></table-wrap>

      <p>These summer anomalies are used for both the standard approach, defined in
Sect. <xref ref-type="sec" rid="Ch1.S4.SS2"/>, and the new approach illustrated in
Sect. <xref ref-type="sec" rid="Ch1.S4.SS3"/>. We introduce a skill measure to compare the number
of heat periods with values of the link strength
(Sect. <xref ref-type="sec" rid="Ch1.S4.SS4"/>). Finally we present a simple approach to apply
the new estimator to real forecasts in Sect. <xref ref-type="sec" rid="Ch1.S4.SS5"/>.</p>
</sec>
<sec id="Ch1.S4.SS2">
  <title>The standard approach for determining the number of heat periods</title>
      <p>In this study, we define a heat period for E-OBS observational data as a time
range when the anomaly maximum temperature (according to
Eq. <xref ref-type="disp-formula" rid="Ch1.E1"/>) exceeds a fixed threshold of <inline-formula><mml:math display="inline"><mml:mrow><mml:mn mathvariant="normal">3</mml:mn><mml:mspace width="0.125em" linebreak="nobreak"/><mml:mi mathvariant="normal">K</mml:mi></mml:mrow></mml:math></inline-formula> at 5
consecutive days at least and additionally includes no less than <inline-formula><mml:math display="inline"><mml:mn>20</mml:mn></mml:math></inline-formula> %
of the grid points in the area of interest. This choice has been made to
observe events frequently enough for reliable statistics while simultaneously
ensuring important impacts.</p>
      <p>To account for the inherent model bias it is essential to adjust the
temperature threshold to the model climate. Thus, we estimate the percentile
<inline-formula><mml:math display="inline"><mml:mrow><mml:msup><mml:mi mathvariant="script">P</mml:mi><mml:mrow><mml:mn mathvariant="normal">3</mml:mn><mml:mspace linebreak="nobreak" width="0.125em"/><mml:mi mathvariant="normal">K</mml:mi></mml:mrow></mml:msup></mml:mrow></mml:math></inline-formula> corresponding to the <inline-formula><mml:math display="inline"><mml:mrow><mml:mn mathvariant="normal">3</mml:mn><mml:mspace width="0.125em" linebreak="nobreak"/><mml:mi mathvariant="normal">K</mml:mi></mml:mrow></mml:math></inline-formula> E-OBS
threshold for the complete time from 1961 to 2010 and the area of interest.
Accordingly, we use this percentile as the threshold for heat periods for the
model data, which is nevertheless fixed for the whole area and time range;
the argumentation of Sect. <xref ref-type="sec" rid="Ch1.S3"/> still holds for the model
data. Table <xref ref-type="table" rid="Ch1.T1"/> shows this threshold in K for the eight Prudence
regions, estimated from the CCLM ensemble means. In the following, we will
refer to this definition as the <italic>standard approach</italic>.</p>
</sec>
<sec id="Ch1.S4.SS3">
  <title>The new approach</title>
      <p>As an alternative heat period estimator, we propose to use the time-varying
link strength <inline-formula><mml:math display="inline"><mml:mrow><mml:msub><mml:mi>W</mml:mi><mml:mi mathvariant="italic">τ</mml:mi></mml:msub></mml:mrow></mml:math></inline-formula> (<inline-formula><mml:math display="inline"><mml:mi mathvariant="italic">τ</mml:mi></mml:math></inline-formula> represents the years) of a network, based on
modeled daily maximum temperature time series. The link strength <inline-formula><mml:math display="inline"><mml:mrow><mml:msub><mml:mi>W</mml:mi><mml:mi mathvariant="italic">τ</mml:mi></mml:msub></mml:mrow></mml:math></inline-formula>
is the correlation threshold between time series, which is needed to
construct a network of a given edge density. Accordingly we want to show that
<inline-formula><mml:math display="inline"><mml:mrow><mml:msub><mml:mi>W</mml:mi><mml:mi mathvariant="italic">τ</mml:mi></mml:msub></mml:mrow></mml:math></inline-formula> has the potential to be a better estimator for observational heat
periods than the standard estimator. This approach is similar to that used by
<xref ref-type="bibr" rid="bib1.bibx21" id="text.31"/>, who forecasted El Niño events using the link
strength of a network and showed the superiority to standard sea surface
temperature predictions by state-of-the-art climate models. By contrast to
<xref ref-type="bibr" rid="bib1.bibx21" id="text.32"/>, however, we use the predicted <inline-formula><mml:math display="inline"><mml:mrow><mml:mn mathvariant="normal">2</mml:mn><mml:mspace linebreak="nobreak" width="0.125em"/><mml:mi mathvariant="normal">m</mml:mi></mml:mrow></mml:math></inline-formula> maximum
temperature of CCLM to create the networks and to forecast the number of heat
periods.</p>
      <p>To apply the method we proceed as follows. Suppose we have initialized our
climate model in the year 2001 with the ocean, soil, ice, and atmospheric
state at that time. Accordingly the climate model runs freely for 10 years,
i.e., a retrospective decadal climate prediction. Now we are interested in the
capability of the model to represent heat periods in summer. Based on the
standard approach of counting heat periods (see
Sect. <xref ref-type="sec" rid="Ch1.S4.SS2"/>) we could determine the prediction skill of
the model in forecasting (hindcasting) the number of heat periods. Our
approach, in contrast, is to create a time-evolving complex network with
fixed edge density
<xref ref-type="bibr" rid="bib1.bibx2 bib1.bibx28 bib1.bibx21 bib1.bibx16" id="paren.33"/> from the
modeled daily maximum temperature time series and to use, as mentioned, the
dynamics of the link strength <inline-formula><mml:math display="inline"><mml:mrow><mml:msub><mml:mi>W</mml:mi><mml:mi mathvariant="italic">τ</mml:mi></mml:msub></mml:mrow></mml:math></inline-formula> as a heat period estimator.</p>
      <p>Following our aim to use a network measure as a heat period estimator we
construct a complex network from the daily maximum temperature model data.
Here we use an undirected and unweighted simple graph. Thus, the network
consists of vertices <inline-formula><mml:math display="inline"><mml:mi>V</mml:mi></mml:math></inline-formula>, which are the spatial grid points of our
temperature data, and edges (connections) <inline-formula><mml:math display="inline"><mml:mi>E</mml:mi></mml:math></inline-formula>, which are added between
vertices and represent the statistical interdependence between the anomaly
daily maximum temperature time series. This complex climate network can be
represented by the symmetric adjacency matrix <inline-formula><mml:math display="inline"><mml:mi mathvariant="bold">A</mml:mi></mml:math></inline-formula> with

                <disp-formula id="Ch1.E2" content-type="numbered"><mml:math display="block"><mml:mrow><mml:msub><mml:mi>A</mml:mi><mml:mrow><mml:mi>i</mml:mi><mml:mi>j</mml:mi></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:mfenced close="" open="{"><mml:mtable class="array" columnalign="center center center left"><mml:mtr><mml:mtd><mml:mn mathvariant="normal">0</mml:mn></mml:mtd><mml:mtd><mml:mtext>if</mml:mtext></mml:mtd><mml:mtd><mml:mrow><mml:mi>i</mml:mi><mml:mi>j</mml:mi></mml:mrow></mml:mtd><mml:mtd><mml:mtext>not connected</mml:mtext></mml:mtd></mml:mtr><mml:mtr><mml:mtd><mml:mn mathvariant="normal">1</mml:mn></mml:mtd><mml:mtd><mml:mtext>if</mml:mtext></mml:mtd><mml:mtd><mml:mrow><mml:mi>i</mml:mi><mml:mi>j</mml:mi></mml:mrow></mml:mtd><mml:mtd><mml:mtext>connected</mml:mtext></mml:mtd></mml:mtr></mml:mtable></mml:mfenced><mml:mo>,</mml:mo></mml:mrow></mml:math></disp-formula>

          where <inline-formula><mml:math display="inline"><mml:mi>i</mml:mi></mml:math></inline-formula> and <inline-formula><mml:math display="inline"><mml:mi>j</mml:mi></mml:math></inline-formula> represent the vertices, i.e., time series at grid points <inline-formula><mml:math display="inline"><mml:mrow><mml:mi>i</mml:mi><mml:mo>,</mml:mo><mml:mi>j</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">1</mml:mn><mml:mo>,</mml:mo><mml:mi mathvariant="normal">…</mml:mi><mml:mo>,</mml:mo><mml:mi>N</mml:mi></mml:mrow></mml:math></inline-formula>. Two grid points are connected if the correlation between their
time series exceeds a predefined threshold. The statistical interdependence
between pairs <inline-formula><mml:math display="inline"><mml:mrow><mml:mo mathvariant="italic">{</mml:mo><mml:mi>i</mml:mi><mml:mi>j</mml:mi><mml:mo mathvariant="italic">}</mml:mo></mml:mrow></mml:math></inline-formula> (self-loops <inline-formula><mml:math display="inline"><mml:mrow><mml:mo mathvariant="italic">{</mml:mo><mml:mi>i</mml:mi><mml:mi>i</mml:mi><mml:mo mathvariant="italic">}</mml:mo></mml:mrow></mml:math></inline-formula> are not allowed) of time series
is measured using the Pearson (standard) correlation coefficient
<xref ref-type="bibr" rid="bib1.bibx8" id="paren.34"/>. From sensitivity studies we found that correlations
between time series on the order of 0.7–0.9 yield patterns with not too few
and not too many connections. This is important in order to resolve temporal
dynamics of the network. Correlations on this order of magnitude are
significant on the <inline-formula><mml:math display="inline"><mml:mn mathvariant="normal">5</mml:mn></mml:math></inline-formula> % level for the here used summer time series with
length of about 120 days. However, since we want to analyze different regions
in Europe and to generate comparable results we decided to alternatively
create our networks with a constant edge density (ratio of number of actual
connections to maximum number of connections) of

                <disp-formula id="Ch1.E3" content-type="numbered"><mml:math display="block"><mml:mrow><mml:mi mathvariant="italic">ρ</mml:mi><mml:mo>=</mml:mo><mml:mi>E</mml:mi><mml:mfenced close="" open="/"><mml:mfenced close=")" open="("><mml:mtable class="array" columnalign="center"><mml:mtr><mml:mtd><mml:mi>N</mml:mi></mml:mtd></mml:mtr><mml:mtr><mml:mtd><mml:mn mathvariant="normal">2</mml:mn></mml:mtd></mml:mtr></mml:mtable></mml:mfenced></mml:mfenced><mml:mo>=</mml:mo><mml:mo>〈</mml:mo><mml:msub><mml:mi>k</mml:mi><mml:mi>i</mml:mi></mml:msub><mml:mo>〉</mml:mo><mml:mspace linebreak="nobreak" width="0.125em"/><mml:mfenced open="/" close=""><mml:mspace width="0.125em" linebreak="nobreak"/><mml:mo>(</mml:mo><mml:mi>N</mml:mi><mml:mo>-</mml:mo><mml:mn mathvariant="normal">1</mml:mn><mml:mo>)</mml:mo><mml:mo>=</mml:mo><mml:mn>0.3</mml:mn></mml:mfenced><mml:mo>,</mml:mo></mml:mrow></mml:math></disp-formula>

          where <inline-formula><mml:math display="inline"><mml:mi>E</mml:mi></mml:math></inline-formula> is the number of edges and <inline-formula><mml:math display="inline"><mml:mrow><mml:mo>〈</mml:mo><mml:msub><mml:mi>k</mml:mi><mml:mi>i</mml:mi></mml:msub><mml:mo>〉</mml:mo></mml:mrow></mml:math></inline-formula> is the mean
<italic>node degree</italic> with

                <disp-formula id="Ch1.E4" content-type="numbered"><mml:math display="block"><mml:mrow><mml:msub><mml:mi>k</mml:mi><mml:mi>i</mml:mi></mml:msub><mml:mo>=</mml:mo><mml:munderover><mml:mo movablelimits="false">∑</mml:mo><mml:mrow><mml:mi>j</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">1</mml:mn></mml:mrow><mml:mi>N</mml:mi></mml:munderover><mml:msub><mml:mi>A</mml:mi><mml:mrow><mml:mi>i</mml:mi><mml:mi>j</mml:mi></mml:mrow></mml:msub><mml:mo>,</mml:mo></mml:mrow></mml:math></disp-formula>

          which gives the number of connections of a vertex <inline-formula><mml:math display="inline"><mml:mi>i</mml:mi></mml:math></inline-formula>.</p>
      <p>As mentioned above we removed the data lower than the <inline-formula><mml:math display="inline"><mml:mn>10</mml:mn></mml:math></inline-formula> % quantile, to
avoid that the link strength <inline-formula><mml:math display="inline"><mml:mrow><mml:msub><mml:mi>W</mml:mi><mml:mi mathvariant="italic">τ</mml:mi></mml:msub></mml:mrow></mml:math></inline-formula> is influenced by possible cold
periods in the data. We tested smaller quantiles (<inline-formula><mml:math display="inline"><mml:mn mathvariant="normal">5</mml:mn></mml:math></inline-formula> %) and larger
quantiles (<inline-formula><mml:math display="inline"><mml:mn>20</mml:mn></mml:math></inline-formula> %) and found that the results are robust: they
changed only slightly. The above used parameters (like the density of 0.3)
and the <inline-formula><mml:math display="inline"><mml:mn>10</mml:mn></mml:math></inline-formula> % filtering turned out to be optimal for our data. For other
data, these parameters most probably have to be adjusted. Additionally, by
removing the data lower than the <inline-formula><mml:math display="inline"><mml:mn>10</mml:mn></mml:math></inline-formula> % quantile, gaps in the time series
are generated. To ensure significance, we take into account only correlation
coefficients where the two underlying time series exhibit <inline-formula><mml:math display="inline"><mml:mn>60</mml:mn></mml:math></inline-formula> common data
points (days). An effective way to estimate the link strength of a network
with an edge density of 0.3 is to calculate the <inline-formula><mml:math display="inline"><mml:mn>70</mml:mn></mml:math></inline-formula> % quantile of all
correlation coefficients involved in the network.</p>
      <p>In a similar way as <xref ref-type="bibr" rid="bib1.bibx2" id="text.35"/> we analyze the temporal variation of
the link strength <inline-formula><mml:math display="inline"><mml:mrow><mml:msub><mml:mi>W</mml:mi><mml:mi mathvariant="italic">τ</mml:mi></mml:msub></mml:mrow></mml:math></inline-formula>, i.e the correlation threshold between time
series (grid points) for a single year <inline-formula><mml:math display="inline"><mml:mi mathvariant="italic">τ</mml:mi></mml:math></inline-formula> (summer) from 1961 to 2010.
Thus, instead of using the node degree as an estimator of heat
periods we use the link strength <inline-formula><mml:math display="inline"><mml:mrow><mml:msub><mml:mi>W</mml:mi><mml:mi mathvariant="italic">τ</mml:mi></mml:msub></mml:mrow></mml:math></inline-formula>.</p>
      <p>Using the definitions above, we finally construct a network for the summer
months of each year based on anomaly maximum temperature model data. The
quantity whose year-to-year variation we are interested in is the link
strength <inline-formula><mml:math display="inline"><mml:mrow><mml:msub><mml:mi>W</mml:mi><mml:mi mathvariant="italic">τ</mml:mi></mml:msub></mml:mrow></mml:math></inline-formula>; however, since we are interested in <italic>decadal</italic>
variability, and since we do not expect the model to represent the year-to-year fluctuations, we applied a 10-year moving average filter to both
link strength and number of heat periods, subsequently. Since the CCLM model
has been initialized every decade (1961, 1971,…, 2001) we apply the filter
only within a decade in order to avoid transferring information between
decades. At the boundaries of the decades, the time range for the running
average is shortened: for instance at the beginning of the decade, we use
only the 6-year mean (e.g., from 2001 to 2005), in the second year a 7-year mean,
and so on.</p>
</sec>
<sec id="Ch1.S4.SS4">
  <title>Comparison of the different quantities</title>
      <p>To quantify the prediction skill of the model, we calculate the absolute mean
difference (see Eqs. <xref ref-type="disp-formula" rid="Ch1.E6"/> and <xref ref-type="disp-formula" rid="Ch1.E7"/>) between the number of heat
periods in E-OBS (<inline-formula><mml:math display="inline"><mml:mi>o</mml:mi></mml:math></inline-formula>) and CCLM (<inline-formula><mml:math display="inline"><mml:mi>m</mml:mi></mml:math></inline-formula>) and the CCLM link strength
(<inline-formula><mml:math display="inline"><mml:mrow><mml:msub><mml:mi>W</mml:mi><mml:mi mathvariant="italic">τ</mml:mi></mml:msub></mml:mrow></mml:math></inline-formula>). To be comparable we normalized the time series to the range
<inline-formula><mml:math display="inline"><mml:mrow><mml:mo mathvariant="italic">{</mml:mo><mml:mn mathvariant="normal">0</mml:mn><mml:mo>,</mml:mo><mml:mn mathvariant="normal">1</mml:mn><mml:mo mathvariant="italic">}</mml:mo></mml:mrow></mml:math></inline-formula> by a subtraction of the minimum of the time series and accordingly
a division by the maximum for the whole time span, e.g., for the number of
heat periods in CCLM:

                <disp-formula id="Ch1.E5" content-type="numbered"><mml:math display="block"><mml:mrow><?xmltex \hack{\hbox\bgroup\fontsize{8.0}{8.0}\selectfont$\displaystyle}?><mml:msubsup><mml:mi mathvariant="italic">μ</mml:mi><mml:mrow><mml:mi>d</mml:mi><mml:mo>,</mml:mo><mml:mi mathvariant="italic">τ</mml:mi></mml:mrow><mml:mi>r</mml:mi></mml:msubsup><mml:mo>=</mml:mo><mml:mfenced close=")" open="("><mml:msubsup><mml:mi>m</mml:mi><mml:mrow><mml:mi>d</mml:mi><mml:mo>,</mml:mo><mml:mi mathvariant="italic">τ</mml:mi></mml:mrow><mml:mi>r</mml:mi></mml:msubsup><mml:mo>-</mml:mo><mml:munderover><mml:mo movablelimits="false">min⁡</mml:mo><mml:mrow><mml:mi mathvariant="italic">τ</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">1</mml:mn></mml:mrow><mml:mn>50</mml:mn></mml:munderover><mml:mfenced close=")" open="("><mml:msubsup><mml:mi>m</mml:mi><mml:mrow><mml:mi>d</mml:mi><mml:mo>,</mml:mo><mml:mi mathvariant="italic">τ</mml:mi></mml:mrow><mml:mi>r</mml:mi></mml:msubsup></mml:mfenced></mml:mfenced><mml:mfenced close="" open="/"><mml:munderover><mml:mo movablelimits="false">max⁡</mml:mo><mml:mrow><mml:mi mathvariant="italic">τ</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">1</mml:mn></mml:mrow><mml:mn>50</mml:mn></mml:munderover><mml:mfenced close=")" open="("><mml:msubsup><mml:mi>m</mml:mi><mml:mrow><mml:mi>d</mml:mi><mml:mo>,</mml:mo><mml:mi mathvariant="italic">τ</mml:mi></mml:mrow><mml:mi>r</mml:mi></mml:msubsup><mml:mo>-</mml:mo><mml:munderover><mml:mo movablelimits="false">min⁡</mml:mo><mml:mrow><mml:mi mathvariant="italic">τ</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">1</mml:mn></mml:mrow><mml:mn>50</mml:mn></mml:munderover><mml:mfenced close=")" open="("><mml:msubsup><mml:mi>m</mml:mi><mml:mrow><mml:mi>d</mml:mi><mml:mo>,</mml:mo><mml:mi mathvariant="italic">τ</mml:mi></mml:mrow><mml:mi>r</mml:mi></mml:msubsup></mml:mfenced></mml:mfenced><mml:mo>,</mml:mo></mml:mfenced><?xmltex \hack{$\egroup}?></mml:mrow></mml:math></disp-formula>

          where <inline-formula><mml:math display="inline"><mml:mi>r</mml:mi></mml:math></inline-formula> denotes the European region, <inline-formula><mml:math display="inline"><mml:mi>d</mml:mi></mml:math></inline-formula> stands for the decade and <inline-formula><mml:math display="inline"><mml:mi mathvariant="italic">τ</mml:mi></mml:math></inline-formula>
represents the years. The similarly rescaled E-OBS number of heat periods
will be denoted as <inline-formula><mml:math display="inline"><mml:mi mathvariant="normal">Ω</mml:mi></mml:math></inline-formula> and the rescaled CCLM link strength as <inline-formula><mml:math display="inline"><mml:mi mathvariant="italic">ψ</mml:mi></mml:math></inline-formula>.</p>
      <p>Thus the absolute mean difference (based on normalized data) between
observation and model heat periods for a region <inline-formula><mml:math display="inline"><mml:mi>r</mml:mi></mml:math></inline-formula> and a decade <inline-formula><mml:math display="inline"><mml:mi>d</mml:mi></mml:math></inline-formula> is given
by

                <disp-formula id="Ch1.E6" content-type="numbered"><mml:math display="block"><mml:mrow><mml:msubsup><mml:mi>M</mml:mi><mml:mi>d</mml:mi><mml:mi>r</mml:mi></mml:msubsup><mml:mo>(</mml:mo><mml:mi mathvariant="italic">μ</mml:mi><mml:mo>)</mml:mo><mml:mo>=</mml:mo><mml:mfenced close="|" open="|"><mml:mstyle displaystyle="true"><mml:mfrac style="display"><mml:mn mathvariant="normal">1</mml:mn><mml:mn>10</mml:mn></mml:mfrac></mml:mstyle><mml:munderover><mml:mo movablelimits="false">∑</mml:mo><mml:mrow><mml:mi mathvariant="italic">τ</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">1</mml:mn></mml:mrow><mml:mn>10</mml:mn></mml:munderover><mml:mfenced close=")" open="("><mml:msubsup><mml:mi mathvariant="normal">Ω</mml:mi><mml:mrow><mml:mi>d</mml:mi><mml:mo>,</mml:mo><mml:mi mathvariant="italic">τ</mml:mi></mml:mrow><mml:mi>r</mml:mi></mml:msubsup><mml:mo>-</mml:mo><mml:msubsup><mml:mi mathvariant="italic">μ</mml:mi><mml:mrow><mml:mi>d</mml:mi><mml:mo>,</mml:mo><mml:mi mathvariant="italic">τ</mml:mi></mml:mrow><mml:mi>r</mml:mi></mml:msubsup></mml:mfenced></mml:mfenced><mml:mo>=</mml:mo><mml:mfenced open="|" close="|"><mml:msubsup><mml:mover accent="true"><mml:mi mathvariant="normal">Ω</mml:mi><mml:mo mathvariant="normal">‾</mml:mo></mml:mover><mml:mi>d</mml:mi><mml:mi>r</mml:mi></mml:msubsup><mml:mo>-</mml:mo><mml:msubsup><mml:mover accent="true"><mml:mi mathvariant="italic">μ</mml:mi><mml:mo mathvariant="normal">‾</mml:mo></mml:mover><mml:mi>d</mml:mi><mml:mi>r</mml:mi></mml:msubsup></mml:mfenced><mml:mo>,</mml:mo></mml:mrow></mml:math></disp-formula>

          and the mean difference between observation heat periods and model link
strength is

                <disp-formula id="Ch1.E7" content-type="numbered"><mml:math display="block"><mml:mrow><mml:msubsup><mml:mi>M</mml:mi><mml:mi>d</mml:mi><mml:mi>r</mml:mi></mml:msubsup><mml:mo>(</mml:mo><mml:mi mathvariant="italic">ψ</mml:mi><mml:mo>)</mml:mo><mml:mo>=</mml:mo><mml:mfenced open="|" close="|"><mml:mstyle displaystyle="true"><mml:mfrac style="display"><mml:mn mathvariant="normal">1</mml:mn><mml:mn>10</mml:mn></mml:mfrac></mml:mstyle><mml:munderover><mml:mo movablelimits="false">∑</mml:mo><mml:mrow><mml:mi mathvariant="italic">τ</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">1</mml:mn></mml:mrow><mml:mn>10</mml:mn></mml:munderover><mml:mfenced open="(" close=")"><mml:msubsup><mml:mi mathvariant="normal">Ω</mml:mi><mml:mrow><mml:mi>d</mml:mi><mml:mo>,</mml:mo><mml:mi mathvariant="italic">τ</mml:mi></mml:mrow><mml:mi>r</mml:mi></mml:msubsup><mml:mo>-</mml:mo><mml:msubsup><mml:mi mathvariant="italic">ψ</mml:mi><mml:mrow><mml:mi>d</mml:mi><mml:mo>,</mml:mo><mml:mi mathvariant="italic">τ</mml:mi></mml:mrow><mml:mi>r</mml:mi></mml:msubsup></mml:mfenced></mml:mfenced><mml:mo>=</mml:mo><mml:mfenced close="|" open="|"><mml:msubsup><mml:mover accent="true"><mml:mi mathvariant="normal">Ω</mml:mi><mml:mo mathvariant="normal">‾</mml:mo></mml:mover><mml:mi>d</mml:mi><mml:mi>r</mml:mi></mml:msubsup><mml:mo>-</mml:mo><mml:msubsup><mml:mover accent="true"><mml:mi mathvariant="italic">ψ</mml:mi><mml:mo mathvariant="normal">‾</mml:mo></mml:mover><mml:mi>d</mml:mi><mml:mi>r</mml:mi></mml:msubsup></mml:mfenced><mml:mo>,</mml:mo></mml:mrow></mml:math></disp-formula>

          where the bars in the above equations denote temporal averages. Therefore, if
the absolute mean difference is about <inline-formula><mml:math display="inline"><mml:mn mathvariant="normal">0</mml:mn></mml:math></inline-formula>, observations and model agree well,
whereas a difference of about <inline-formula><mml:math display="inline"><mml:mn mathvariant="normal">1</mml:mn></mml:math></inline-formula> denotes the maximum discrepancy.</p>
</sec>
<sec id="Ch1.S4.SS5">
  <title>Usage of the new estimator in predictions</title>
      <p>For a real application of our method to estimate the number of heat periods
in forecasts, a calibration step using observational data <inline-formula><mml:math display="inline"><mml:mi>o</mml:mi></mml:math></inline-formula> is needed to
convert the link strength of the model to the number of heat periods <inline-formula><mml:math display="inline"><mml:mrow><mml:msub><mml:mi>m</mml:mi><mml:mi>y</mml:mi></mml:msub></mml:mrow></mml:math></inline-formula>
(the index <inline-formula><mml:math display="inline"><mml:mi>y</mml:mi></mml:math></inline-formula> stands for year in the future). Therefore long hindcast data
are needed. Based on our analysis we suggest as a first attempt to apply a
linear conversion from link strength <inline-formula><mml:math display="inline"><mml:mrow><mml:msub><mml:mi>W</mml:mi><mml:mi>y</mml:mi></mml:msub></mml:mrow></mml:math></inline-formula> to the number of heat periods
<inline-formula><mml:math display="inline"><mml:mrow><mml:msub><mml:mi>m</mml:mi><mml:mi>y</mml:mi></mml:msub></mml:mrow></mml:math></inline-formula>, which is also supported by our tests shown in Fig. <xref ref-type="fig" rid="Ch1.F3"/>:

                <disp-formula specific-use="align" content-type="numbered"><mml:math display="block"><mml:mtable displaystyle="true"><mml:mtr><mml:mtd><mml:mrow><mml:msubsup><mml:mi>m</mml:mi><mml:mrow><mml:mi>y</mml:mi><mml:mo>,</mml:mo><mml:mi>W</mml:mi></mml:mrow><mml:mi>r</mml:mi></mml:msubsup></mml:mrow></mml:mtd><mml:mtd><mml:mrow><mml:mo>=</mml:mo><mml:mstyle displaystyle="true"><mml:mfrac style="display"><mml:mrow><mml:msubsup><mml:mi>W</mml:mi><mml:mi>y</mml:mi><mml:mi>r</mml:mi></mml:msubsup><mml:mo>-</mml:mo><mml:msubsup><mml:mo>min⁡</mml:mo><mml:mrow><mml:mi mathvariant="italic">τ</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">1</mml:mn></mml:mrow><mml:mn>50</mml:mn></mml:msubsup><mml:mo>(</mml:mo><mml:msubsup><mml:mi>W</mml:mi><mml:mi mathvariant="italic">τ</mml:mi><mml:mi>r</mml:mi></mml:msubsup><mml:mo>)</mml:mo></mml:mrow><mml:mrow><mml:msubsup><mml:mo>max⁡</mml:mo><mml:mrow><mml:mi mathvariant="italic">τ</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">1</mml:mn></mml:mrow><mml:mn>50</mml:mn></mml:msubsup><mml:mo>(</mml:mo><mml:msubsup><mml:mi>W</mml:mi><mml:mi mathvariant="italic">τ</mml:mi><mml:mi>r</mml:mi></mml:msubsup><mml:mo>)</mml:mo><mml:mo>-</mml:mo><mml:msubsup><mml:mo>min⁡</mml:mo><mml:mrow><mml:mi mathvariant="italic">τ</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">1</mml:mn></mml:mrow><mml:mn>50</mml:mn></mml:msubsup><mml:mo>(</mml:mo><mml:msubsup><mml:mi>W</mml:mi><mml:mi mathvariant="italic">τ</mml:mi><mml:mi>r</mml:mi></mml:msubsup><mml:mo>)</mml:mo></mml:mrow></mml:mfrac></mml:mstyle></mml:mrow></mml:mtd></mml:mtr><mml:mlabeledtr id="Ch1.E8"><mml:mtd/><mml:mtd/><mml:mtd><mml:mrow><mml:mo>⋅</mml:mo><mml:mspace linebreak="nobreak" width="0.25em"/><mml:mfenced open="(" close=")"><mml:munderover><mml:mo movablelimits="false">max⁡</mml:mo><mml:mrow><mml:mi mathvariant="italic">τ</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">1</mml:mn></mml:mrow><mml:mn>50</mml:mn></mml:munderover><mml:mo>(</mml:mo><mml:msubsup><mml:mi>o</mml:mi><mml:mi mathvariant="italic">τ</mml:mi><mml:mi>r</mml:mi></mml:msubsup><mml:mo>)</mml:mo><mml:mo>-</mml:mo><mml:munderover><mml:mo movablelimits="false">min⁡</mml:mo><mml:mrow><mml:mi mathvariant="italic">τ</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">1</mml:mn></mml:mrow><mml:mn>50</mml:mn></mml:munderover><mml:mo>(</mml:mo><mml:msubsup><mml:mi>o</mml:mi><mml:mi mathvariant="italic">τ</mml:mi><mml:mi>r</mml:mi></mml:msubsup><mml:mo>)</mml:mo></mml:mfenced><mml:mo>+</mml:mo><mml:munderover><mml:mo movablelimits="false">min⁡</mml:mo><mml:mrow><mml:mi mathvariant="italic">τ</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">1</mml:mn></mml:mrow><mml:mn>50</mml:mn></mml:munderover><mml:mo>(</mml:mo><mml:msubsup><mml:mi>o</mml:mi><mml:mi mathvariant="italic">τ</mml:mi><mml:mi>r</mml:mi></mml:msubsup><mml:mo>)</mml:mo><mml:mo>.</mml:mo></mml:mrow></mml:mtd></mml:mlabeledtr></mml:mtable></mml:math></disp-formula>

            This linear approach corresponds to our skill analysis, where a linear
connection between the link strength and the number of heat periods is
assumed as well. Again we note that this study presents only the skill
analysis of hindcast data and Eq. (<xref ref-type="disp-formula" rid="Ch1.E8"/>) is actually not used
now.</p>

      <?xmltex \floatpos{t}?><fig id="Ch1.F4"><caption><p>Number of heat periods (1961–2010) in France
(Prudence 3) in summer from E-OBS <inline-formula><mml:math display="inline"><mml:mi>o</mml:mi></mml:math></inline-formula> (solid line) and corresponding E-OBS
link strength <inline-formula><mml:math display="inline"><mml:mi>W</mml:mi></mml:math></inline-formula> (dashed line). The M's denote the absolute mean
difference within a decade between E-OBS standard approach and the E-OBS link
strength after normalization (cf. Eq. <xref ref-type="disp-formula" rid="Ch1.E7"/>).</p></caption>
          <?xmltex \igopts{width=241.848425pt}?><graphic xlink:href="https://npg.copernicus.org/articles/23/307/2016/npg-23-307-2016-f04.pdf"/>

        </fig>

</sec>
</sec>
<sec id="Ch1.S5">
  <title>Results</title>
      <p>Figure <xref ref-type="fig" rid="Ch1.F4"/> depicts the number of observed heat periods (solid
line) and the corresponding link strength (dashed line) retrieved from the
complex evolving network, both from E-OBS data for France (Prudence region 3),
and shows that the link strength <inline-formula><mml:math display="inline"><mml:mrow><mml:msub><mml:mi>W</mml:mi><mml:mi mathvariant="italic">τ</mml:mi></mml:msub></mml:mrow></mml:math></inline-formula> is a suitable estimator of
heat periods. It shows that the network contains climate information in the
sense that the dynamics of the link strength <inline-formula><mml:math display="inline"><mml:mrow><mml:msub><mml:mi>W</mml:mi><mml:mi mathvariant="italic">τ</mml:mi></mml:msub></mml:mrow></mml:math></inline-formula> is similar to the
dynamics of heat periods, both based on the same data. So, the link strength
can here be considered as an estimator for heat periods, which is comparable
to the standard heat period estimator. Jumps between the decades occur as the
running mean filter is only applied within the decades (see
Sect. <xref ref-type="sec" rid="Ch1.S4.SS3"/>). The corresponding figures for the seven other
Prudence regions can be found in the supplementary material.</p>
      <p>As an example, Prudence region 8 (Eastern Europe) is a region where the
network method performs better than the standard approach
(Figs. <xref ref-type="fig" rid="Ch1.F5"/> and <xref ref-type="fig" rid="Ch1.F6"/>). Figure <xref ref-type="fig" rid="Ch1.F5"/>
shows the E-OBS number of heat periods <inline-formula><mml:math display="inline"><mml:mi>o</mml:mi></mml:math></inline-formula> (black) and the CCLM ensemble mean
number of heat periods <inline-formula><mml:math display="inline"><mml:mi>m</mml:mi></mml:math></inline-formula> (blue) for Eastern Europe together with the
interquartile range (<inline-formula><mml:math display="inline"><mml:mn>25</mml:mn></mml:math></inline-formula>th and <inline-formula><mml:math display="inline"><mml:mn>75</mml:mn></mml:math></inline-formula>th percentiles), and
Fig. <xref ref-type="fig" rid="Ch1.F6"/> shows again the E-OBS number of heat periods now
compared to the CCLM link strength. Comparing the absolute mean differences,
denoted as <inline-formula><mml:math display="inline"><mml:mi>M</mml:mi></mml:math></inline-formula> in the two figures, reveals that our network approach enhances
the skill in four decades, namely 1970s, 1980s, 1990s, and 2000s. Especially the
1970s, 1980s, and 1990s show a clear improvement and our network approach better
reflects the low-frequency dynamics of the heat periods. The 2000s seem to be
off in both model cases, the number of heat periods, and the link strength,
which indicates a failed model initialization.</p>

      <?xmltex \floatpos{t}?><fig id="Ch1.F5"><caption><p>Number of heat periods (1961–2010) in Eastern
Europe (Prudence 8) in summer from E-OBS <inline-formula><mml:math display="inline"><mml:mi>o</mml:mi></mml:math></inline-formula> (black) and CCLM number of heat
periods (blue: ensemble mean and interquartile range). The M's denote the
absolute mean difference within a decade between E-OBS and the CCLM ensemble
mean after normalization (see Eq. <xref ref-type="disp-formula" rid="Ch1.E6"/>).</p></caption>
        <?xmltex \igopts{width=241.848425pt}?><graphic xlink:href="https://npg.copernicus.org/articles/23/307/2016/npg-23-307-2016-f05.pdf"/>

      </fig>

      <?xmltex \floatpos{t}?><fig id="Ch1.F6"><caption><p>Number of heat periods (1961–2010) in Eastern
Europe (Prudence 8) in summer from E-OBS <inline-formula><mml:math display="inline"><mml:mi>o</mml:mi></mml:math></inline-formula> (black) and CCLM link strength
or correlation threshold <inline-formula><mml:math display="inline"><mml:mi>W</mml:mi></mml:math></inline-formula> (red: ensemble mean and interquartile range).
The M's denote the absolute mean difference within a decade between E-OBS
and the CCLM ensemble mean after normalization (see Eq. <xref ref-type="disp-formula" rid="Ch1.E7"/>).</p></caption>
        <?xmltex \igopts{width=241.848425pt}?><graphic xlink:href="https://npg.copernicus.org/articles/23/307/2016/npg-23-307-2016-f06.pdf"/>

      </fig>

      <?xmltex \floatpos{t}?><fig id="Ch1.F7" specific-use="star"><caption><p>Absolute mean differences like in
Figs. <xref ref-type="fig" rid="Ch1.F4"/> to <xref ref-type="fig" rid="Ch1.F6"/> of all Prudence regions for
E-OBS standard approach compared to E-OBS link strength (left), to CCLM
standard approach (middle), and to CCLM link strength (right).</p></caption>
        <?xmltex \igopts{width=384.112205pt}?><graphic xlink:href="https://npg.copernicus.org/articles/23/307/2016/npg-23-307-2016-f07.pdf"/>

      </fig>

      <p>In order to see how the prediction skill of the standard as well as the
network heat period estimators vary with the considered region, we performed
the same analysis as above for the eight Prudence regions in Europe and for
the 1960s, 1970s, 1980s, 1990s, and 2000s. The corresponding figures for the
other regions can be found in the Supplement.</p>
      <p>To summarize the results we calculated the absolute mean differences (Eqs. 6
and 7) for all the Prudence regions, see Fig. <xref ref-type="fig" rid="Ch1.F7"/>. Blue colors
in the panels stand for low values (high skill) whereas red colors depict
high values (low skill) in the absolute mean difference.</p>
      <p>The left panel of Fig. <xref ref-type="fig" rid="Ch1.F7"/> shows how the network method
performs using only E-OBS data similar to Fig. <xref ref-type="fig" rid="Ch1.F4"/>. Therefore
we estimated the number of heat periods in the E-OBS data and the link
strength (from the complex network) of the E-OBS data and accordingly
calculated the differences (after normalization, cf. Eq. <xref ref-type="disp-formula" rid="Ch1.E5"/>)
between these two estimators. As can be seen blue colors dominate the plot,
i.e., low differences and hence high skill. Thus, this reference test shows
that the link strength is coupled to the number of heat periods in maximum
daily summer temperature data and so can be used as an alternative, possibly
better, heat period estimator. There are some exceptions like the 1990s and
2000s of Prudence region 6. Further investigation on the reasons of these
cases has to be performed.</p>
      <p>The middle panel of Fig. <xref ref-type="fig" rid="Ch1.F7"/> shows how well the standard
method performs in predicting heat periods using E-OBS observations and CCLM
model data. The right panel indicates the performance of the new network
method in estimating heat periods using E-OBS and CCLM data. In contrast to
the relatively low values in the left panel, the values in the middle and
right panels on the one hand are higher for many decades and Prudence
regions. On the other hand, the visual impression is that the absolute
differences of the right panel are slightly smaller than those of the middle
panel, especially during the 1990s and 2000s.</p>
      <p>Thus, we can conclude with Fig. <xref ref-type="fig" rid="Ch1.F7"/> that the method works in
principle but that the uncertainties in the model simulations lead to
increased differences between observations and model simulations. In
addition, the link strength seems to work better than the standard approach
for the model simulations with respect to the observations.</p>

      <?xmltex \floatpos{t}?><fig id="Ch1.F8"><caption><p>Differences between the two right panels of
Fig. <xref ref-type="fig" rid="Ch1.F7"/>. Blue: network approach performs better, red:
standard approach performs better, white: tie.</p></caption>
        <?xmltex \igopts{width=241.848425pt}?><graphic xlink:href="https://npg.copernicus.org/articles/23/307/2016/npg-23-307-2016-f08.pdf"/>

      </fig>

      <p>To quantify this last statement, we calculated the difference between the
middle and right panels of Fig. <xref ref-type="fig" rid="Ch1.F7"/> (see
Fig. <xref ref-type="fig" rid="Ch1.F8"/>). This basically shows which method performs better
regarding the eight regions (columns) and five decades (rows). Blue color in
Fig. <xref ref-type="fig" rid="Ch1.F8"/> indicates that the network approach performs better
(<inline-formula><mml:math display="inline"><mml:mrow><mml:msubsup><mml:mi>M</mml:mi><mml:mi>d</mml:mi><mml:mi>r</mml:mi></mml:msubsup><mml:mo>(</mml:mo><mml:mi mathvariant="italic">ψ</mml:mi><mml:mo>)</mml:mo></mml:mrow></mml:math></inline-formula> <inline-formula><mml:math display="inline"><mml:mo>&lt;</mml:mo></mml:math></inline-formula> <inline-formula><mml:math display="inline"><mml:mrow><mml:msubsup><mml:mi>M</mml:mi><mml:mi>d</mml:mi><mml:mi>r</mml:mi></mml:msubsup><mml:mo>(</mml:mo><mml:mi mathvariant="italic">μ</mml:mi><mml:mo>)</mml:mo></mml:mrow></mml:math></inline-formula>) and red color stands for a better
performance of the standard approach (<inline-formula><mml:math display="inline"><mml:mrow><mml:msubsup><mml:mi>M</mml:mi><mml:mi>d</mml:mi><mml:mi>r</mml:mi></mml:msubsup><mml:mo>(</mml:mo><mml:mi mathvariant="italic">ψ</mml:mi><mml:mo>)</mml:mo></mml:mrow></mml:math></inline-formula> <inline-formula><mml:math display="inline"><mml:mo>&gt;</mml:mo></mml:math></inline-formula> <inline-formula><mml:math display="inline"><mml:mrow><mml:msubsup><mml:mi>M</mml:mi><mml:mi>d</mml:mi><mml:mi>r</mml:mi></mml:msubsup><mml:mo>(</mml:mo><mml:mi mathvariant="italic">μ</mml:mi><mml:mo>)</mml:mo></mml:mrow></mml:math></inline-formula>).
White boxes in Fig. <xref ref-type="fig" rid="Ch1.F8"/> denote a tie between the methods in the
case of too small differences (<inline-formula><mml:math display="inline"><mml:mrow><mml:mo>|</mml:mo><mml:msubsup><mml:mi>M</mml:mi><mml:mi>d</mml:mi><mml:mi>r</mml:mi></mml:msubsup><mml:mo>(</mml:mo><mml:mi mathvariant="italic">ψ</mml:mi><mml:mo>)</mml:mo><mml:mo>-</mml:mo><mml:msubsup><mml:mi>M</mml:mi><mml:mi>d</mml:mi><mml:mi>r</mml:mi></mml:msubsup><mml:mo>(</mml:mo><mml:mi mathvariant="italic">μ</mml:mi><mml:mo>)</mml:mo><mml:mo>|</mml:mo></mml:mrow></mml:math></inline-formula> <inline-formula><mml:math display="inline"><mml:mo>≤</mml:mo></mml:math></inline-formula> <inline-formula><mml:math display="inline"><mml:mn>0.05</mml:mn></mml:math></inline-formula>).
The matrix of Fig. <xref ref-type="fig" rid="Ch1.F8"/> shows that the network method is clearly
superior in three regions (5, 7, 8) and slightly superior in two regions (4,
6), the standard approach is superior in two regions (1, 3), and in region 2
we observed a tie, i.e., no clear result.</p>
      <p>The crucial question is whether this result indicates that the network method
performs significantly better than the standard approach or not. However,
testing for statistical significance bears serious problems. There are so
many factors involved in the analysis, i.e., the models themselves, the
downscaling, the ensemble, the initialization, the different regions, the
filtering, etc. that any null hypothesis would be not well-posed and any test
would be questionable. This issue is discussed in detail in a 2013 paper
entitled “Testing ensembles of climate change scenarios for `statistical
significance”' by climate statistics instances of Hans von Storch and Francis
Zwiers <xref ref-type="bibr" rid="bib1.bibx36" id="paren.36"/>, who claim that “a statistical
null hypothesis may not be a well-posed problem…” and “Even if
statistical testing were completely appropriate, the dependency of the power
of statistical tests on the sample size <inline-formula><mml:math display="inline"><mml:mi>n</mml:mi></mml:math></inline-formula> remains a limitation on
interpretation.” and finally “propose to employ instead a simple
descriptive approach for characterising the information in an ensemble…”.
Although we totally agree with the argumentation by <xref ref-type="bibr" rid="bib1.bibx36" id="text.37"/>
that a “classical” significance test would most probably fail in our
analysis, we think that alternative significance tests, based on
bootstrapping or surrogate data, could definitely help obtain a better
interpretation of the results. Thus, we construct the following significance
test based on surrogate data to answer the following question: what is the
probability of getting a rank matrix like the one in Fig. <xref ref-type="fig" rid="Ch1.F8"/>
by chance?</p>

<table-wrap id="Ch1.T2"><caption><p>Probability that blue matrix elements in
Fig. <xref ref-type="fig" rid="Ch1.F8"/> dominate in <inline-formula><mml:math display="inline"><mml:mi>n</mml:mi></mml:math></inline-formula> regions by chance. Half of the
elements are colored blue and red, respectively, and eight white elements are
randomly added subsequently.</p></caption><oasis:table frame="topbot"><?xmltex \begin{scaleboxenv}{.9}[.9]?><oasis:tgroup cols="10">
     <oasis:colspec colnum="1" colname="col1" align="left"/>
     <oasis:colspec colnum="2" colname="col2" align="center"/>
     <oasis:colspec colnum="3" colname="col3" align="center"/>
     <oasis:colspec colnum="4" colname="col4" align="center"/>
     <oasis:colspec colnum="5" colname="col5" align="center"/>
     <oasis:colspec colnum="6" colname="col6" align="center"/>
     <oasis:colspec colnum="7" colname="col7" align="center"/>
     <oasis:colspec colnum="8" colname="col8" align="center"/>
     <oasis:colspec colnum="9" colname="col9" align="center"/>
     <oasis:colspec colnum="10" colname="col10" align="left"/>
     <oasis:thead>
       <oasis:row rowsep="1">  
         <oasis:entry colname="col1">Number of regions <inline-formula><mml:math display="inline"><mml:mi>n</mml:mi></mml:math></inline-formula></oasis:entry>  
         <oasis:entry colname="col2">1</oasis:entry>  
         <oasis:entry colname="col3">2</oasis:entry>  
         <oasis:entry colname="col4">3</oasis:entry>  
         <oasis:entry colname="col5">4</oasis:entry>  
         <oasis:entry colname="col6">5</oasis:entry>  
         <oasis:entry colname="col7">6</oasis:entry>  
         <oasis:entry colname="col8">7</oasis:entry>  
         <oasis:entry colname="col9">8</oasis:entry>  
         <oasis:entry colname="col10"/>
       </oasis:row>
     </oasis:thead>
     <oasis:tbody>
       <oasis:row>  
         <oasis:entry colname="col1">Probability in %</oasis:entry>  
         <oasis:entry colname="col2">100</oasis:entry>  
         <oasis:entry colname="col3">99</oasis:entry>  
         <oasis:entry colname="col4">82</oasis:entry>  
         <oasis:entry colname="col5">35</oasis:entry>  
         <oasis:entry colname="col6">5</oasis:entry>  
         <oasis:entry colname="col7">0.1</oasis:entry>  
         <oasis:entry colname="col8">0</oasis:entry>  
         <oasis:entry colname="col9">0</oasis:entry>  
         <oasis:entry colname="col10"/>
       </oasis:row>
     </oasis:tbody>
   </oasis:tgroup><?xmltex \end{scaleboxenv}?></oasis:table></table-wrap>

      <p>First, we have to define what is the possibly “significant” characteristic
of the matrix in Fig. <xref ref-type="fig" rid="Ch1.F8"/>. It is, as we concluded above, that
the network method is superior in five regions. Thus the question is the following: what
is the probability to observe at least five regions in which we have in each at
least one blue matrix element more than a red one <italic>by chance</italic>?
Accordingly we constructed matrices like in Fig. <xref ref-type="fig" rid="Ch1.F8"/> by
randomly coloring 20 matrix elements blue and 20 red. Afterwards we colored
8 matrix elements white as in Fig. <xref ref-type="fig" rid="Ch1.F8"/>. Finally, we repeated
this surrogate procedure 1000 times and counted the cases (regions) where the
blue matrix elements dominate. Table <xref ref-type="table" rid="Ch1.T2"/> shows the probabilities that
blue matrix elements dominate in <inline-formula><mml:math display="inline"><mml:mi>n</mml:mi></mml:math></inline-formula> regions. Since we have 16 blue elements
and 16 red, it is sure that blue dominates in <inline-formula><mml:math display="inline"><mml:mrow><mml:mi>n</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">1</mml:mn></mml:mrow></mml:math></inline-formula> region, and it is impossible to
dominate in <inline-formula><mml:math display="inline"><mml:mrow><mml:mi>n</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">7</mml:mn></mml:mrow></mml:math></inline-formula> and <inline-formula><mml:math display="inline"><mml:mrow><mml:mi>n</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">8</mml:mn></mml:mrow></mml:math></inline-formula> regions. As can be seen from Table <xref ref-type="table" rid="Ch1.T2"/> the
probability of dominating in <inline-formula><mml:math display="inline"><mml:mrow><mml:mi>n</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">5</mml:mn></mml:mrow></mml:math></inline-formula> regions by chance is only about <inline-formula><mml:math display="inline"><mml:mn mathvariant="normal">5</mml:mn></mml:math></inline-formula> %;
thus the results of our network approach have to be stated significant. Due
to the symmetry of the test, the same argumentation is valid for red matrix
elements. Dominating in <inline-formula><mml:math display="inline"><mml:mrow><mml:mi>n</mml:mi><mml:mo>=</mml:mo><mml:mn mathvariant="normal">2</mml:mn></mml:mrow></mml:math></inline-formula> regions, as achieved by the standard approach
(Fig. <xref ref-type="fig" rid="Ch1.F8"/>), can be realized easily by chance with a probability
of approx. <inline-formula><mml:math display="inline"><mml:mn>99</mml:mn></mml:math></inline-formula> %. Page 1 in the Supplement shows an example of 12 of
these randomly generated matrices, where one matrix, depicted by a black
frame, fulfills the “significance” criterion.</p>
</sec>
<sec id="Ch1.S6" sec-type="conclusions">
  <title>Conclusions and outlook</title>
      <p>We presented a novel approach examining heat periods using a complex network
analysis. We have investigated the predictability of the slow dynamics of the
occurrence of heat periods in Europe based on daily maximum near-surface
temperature data.</p>
      <p>We found that the network approach is superior (significance is <inline-formula><mml:math display="inline"><mml:mrow><mml:mo>≈</mml:mo><mml:mn> 5</mml:mn></mml:mrow></mml:math></inline-formula> %)
to the standard approach in estimating heat periods in Europe,
hence highlighting the potential of network methods to improve the skill
estimation in decadal prediction experiments. Picking up our hypothesis and
simplified argumentation from Sect. <xref ref-type="sec" rid="Ch1.S3"/>, the crucial point
why we detect heat periods with the network link strength is that heat
periods are cooperative events in space and time. Thus, the link strength can
be used as an estimator of heat periods. The drawback of the standard
approach is most probably the inflexible threshold for the detection of heat
periods (cf. Fig. <xref ref-type="fig" rid="Ch1.F2"/>). If the climate model contains the
signal of a heat period, but with a slightly too small amplitude, the
threshold will not be crossed and no heat period will be detected. In
contrast, the complex climate network does not depend on such fixed
thresholds and can use this information, which makes it the more robust
estimator of heat periods.</p>
      <p>The general prediction skill of climate in Europe using standard measures is
still moderate. In this sense our work adds new aspects to our previous study
<xref ref-type="bibr" rid="bib1.bibx25" id="paren.38"/> and also the work of <xref ref-type="bibr" rid="bib1.bibx11" id="text.39"/>, who found
a strong variation of skill with region and decade. In essence, we found
regions and decades in Europe where our climate model output, or more
specifically the used network estimator, follows the slowly evolving dynamics
of observed heat periods. We also found regions and decades in which the
network estimator is not able to represent the observational reference.
Understanding of this variability in prediction skill is one of the future
challenges of decadal predictions.</p>
      <p>Concluding, our approach shows that the complex climate networks approach
yields meaningful climate information and has the potential to improve skill
measures within the framework of climate prediction. It is the first time
that such network techniques have been used in climate predictions. Since
climate or decadal predictions aim to predict natural variability on the
order of years, suitable statistics are needed. Natural variability on the
order of years evolves highly dynamically and often nonlinearly. Thus, the
complex climate networks could bear the potential to be very useful in
climate predictions. Our approach, which is even based on the most simple
network measure, the node degree (or as we used it the link strength), yields
optimistic results. So, we think that our analysis could be the starting
point for using the complex networks in climate predictions. Using other
measures and/or multivariate data could turn out to be the better way of
analyzing predictions of natural variability years ahead than using methods
from short- or medium-range forecasting. Further, from the network
perspective it would be interesting to analyze other network measures like
clustering, similarities, or path lengths and how they are connected to
climate evolution. The incorporation of other relevant variables like
precipitation, wind, or soil moisture into the network is an appealing aspect.
From a physical or climatological point of view it is important to understand
why the network measures are able to represent climate dynamics, which could
also contribute to a better understanding of the sources of decadal
predictability. Thus, the incorporation and investigation of processes like
the AMOC, PDO, or NAO together with complex networks and climate prediction
might be an option for the future.</p>
</sec>
<sec id="Ch1.S7">
  <title>Data availability</title>
      <p>E-OBS can be downloaded via the website <uri>www.ecad.eu</uri>.</p>
</sec>

      
      </body>
    <back><app-group>
        <supplementary-material position="anchor"><p><bold>The Supplement related to this article is available online at <inline-supplementary-material xlink:href="http://dx.doi.org/10.5194/npg-23-307-2016-supplement" xlink:title="pdf">doi:10.5194/npg-23-307-2016-supplement</inline-supplementary-material>.</bold></p></supplementary-material>
        </app-group><ack><title>Acknowledgements</title><p>We acknowledge the E-OBS data set from the EU-FP6 project ENSEMBLES
(<uri>http://ensembles-eu.metoffice.com</uri>) and the data providers in
the ECA&amp;D project (<uri>http://www.ecad.eu</uri>).</p><p>The research programme MiKlip is funded by the German Ministry of
Education and Research (BMBF).</p><p>We also acknowledge the ETOPO1 data set <xref ref-type="bibr" rid="bib1.bibx1" id="paren.40"/> from the
NGDC (National Geophysical Data Center, Boulder, Colorado).<?xmltex \hack{\\\\}?>The
article processing charges for this open-access <?xmltex \hack{\newline}?>
publication  were covered by a Research <?xmltex \hack{\newline}?> Centre of the Helmholtz
Association.<?xmltex \hack{\\\\}?>Edited by: A. M. Mancho <?xmltex \hack{\\}?>
Reviewed by: four anonymous referees</p></ack><ref-list>
    <title>References</title>

      <ref id="bib1.bibx1"><label>Amante and Eakins(2009)</label><mixed-citation>Amante, C. and Eakins, B.: ETOPO1 1 Arc-Minute Global Relief Model:
Procedures, Data Sources and Analysis. NOAA Technical Memorandum, Tech. Rep.
NESDIS NGDC-24, National Geophysical Data Center, NOAA, Boulder, Colorado,
USA, <ext-link xlink:href="http://dx.doi.org/10.7289/V5C8276M" ext-link-type="DOI">10.7289/V5C8276M</ext-link>, 2009.</mixed-citation></ref>
      <ref id="bib1.bibx2"><label>Berezin et al.(2012)Berezin, Gozolchiani, Guez, and Havlin</label><mixed-citation>Berezin, Y., Gozolchiani, A., Guez, O., and Havlin, S.: Stability of climate
networks with time, Sci. Rep., 2, 666, <ext-link xlink:href="http://dx.doi.org/10.1038/srep00666" ext-link-type="DOI">10.1038/srep00666</ext-link>, 2012.</mixed-citation></ref>
      <ref id="bib1.bibx3"><label>Boers et al.(2014)Boers, Bookhagen, Barbosa, Marwan, Kurths, and Marengo</label><mixed-citation>Boers, N., Bookhagen, B., Barbosa, H. M. J., Marwan, N., Kurths, J., and
Marengo, J. A.: Prediction of extreme floods in the eastern Central Andes
based on a complex networks approach, Nat. Commun., 5, 5199,
<ext-link xlink:href="http://dx.doi.org/10.1038/ncomms6199" ext-link-type="DOI">10.1038/ncomms6199</ext-link>, 2014.</mixed-citation></ref>
      <ref id="bib1.bibx4"><label>Chikamoto et al.(2015)Chikamoto, Timmermann, Luo,
Mochizuki, Kimoto, Watanabe, Ishii, Xie, and Jin</label><mixed-citation>Chikamoto, Y., Timmermann, A., Luo, J.-J., Mochizuki, T., Kimoto, M.,
Watanabe, M., Ishii, M., Xie, S.-P., and Jin, F.-F.: Skilful multi-year
predictions of tropical trans-basin climate variability, Nat. Commun., 6,
6869, <ext-link xlink:href="http://dx.doi.org/10.1038/ncomms7869" ext-link-type="DOI">10.1038/ncomms7869</ext-link>, 2015.</mixed-citation></ref>
      <ref id="bib1.bibx5"><label>Corti et al.(2012)Corti, Weisheimer, Palmer, Doblas-Reyes, and Magnusson</label><mixed-citation>Corti, S., Weisheimer, A., Palmer, T. N., Doblas-Reyes, F. J., and
Magnusson, L.: Reliability of decadal predictions, Geophys. Res. Lett., 39,
L21712, <ext-link xlink:href="http://dx.doi.org/10.1029/2012GL053354" ext-link-type="DOI">10.1029/2012GL053354</ext-link>, 2012.</mixed-citation></ref>
      <ref id="bib1.bibx6"><label>Doblas-Reyes et al.(2013)Doblas-Reyes, Andreu-Burillo, Chikamoto,
García-Serrano, Guemas, Kimoto, Mochizuki, Rodrigues, and van
Oldenborgh</label><mixed-citation>Doblas-Reyes, F. J., Andreu-Burillo, I.,
Chikamoto, Y., García-Serrano, J., Guemas, V., Kimoto, M., Mochizuki, T.,
Rodrigues, L. R. L., and van Oldenborgh, G. J.: Initialized near-term
regional climate change prediction, Nat. Commun., 4, 1715,
<ext-link xlink:href="http://dx.doi.org/10.1038/ncomms2704" ext-link-type="DOI">10.1038/ncomms2704</ext-link>, 2013.</mixed-citation></ref>
      <ref id="bib1.bibx7"><label>Doms and Schättler(2002)</label><mixed-citation>
Doms, G. and Schättler, U.: A Description of the Non-Hydrostatic Regional
Model LM, Part I: Dynamics and Numerics, tech. rep., Deutscher
Wetterdienst, P.O. Box 100465, 63004 Offenbach, Germany, LM_F90 2.18, 2002.</mixed-citation></ref>
      <ref id="bib1.bibx8"><label>Donges et al.(2009)Donges, Zou, Marwan, and Kurths</label><mixed-citation>Donges, J. F., Zou, Y., Marwan, N., and Kurths, J.: Complex networks in
climatic dynamics, Eur. Phys. J.-Spec. Top., 174, 157–179,
doi:<ext-link xlink:href="http://dx.doi.org/10.1140/epjst/e2009-01098-2">10.1140/epjst/e2009-01098-2</ext-link>,
2009.</mixed-citation></ref>
      <ref id="bib1.bibx9"><label>Donges et al.(2011)Donges, Donner, Trauth, Marwan, Schellnhuber, and Kurths</label><mixed-citation>Donges, J. F., Donner, R. V., Trauth, M. H., Marwan, N., Schellnhuber, H.-J.,
and Kurths, J.: Nonlinear detection of paleoclimate-variability transitions
possibly related to human evolution, P. Natl. Acad. Sci. USA, 108,
20422–20427, <ext-link xlink:href="http://dx.doi.org/10.1073/pnas.1117052108" ext-link-type="DOI">10.1073/pnas.1117052108</ext-link>, 2011.</mixed-citation></ref>
      <ref id="bib1.bibx10"><label>Dosio et al.(2015)Dosio, Panitz, Schubert-Frisius, and Lüthi</label><mixed-citation>Dosio, A., Panitz, H.-J., Schubert-Frisius, M., and Lüthi, D.: Dynamical
downscaling of CMIP5 global circulation models over CORDEX-Africa with
COSMO-CLM: evaluation over the present climate and analysis of the added
value, Clim. Dynam., 44, 2637–2661,
doi:<ext-link xlink:href="http://dx.doi.org/10.1007/s00382-014-2262-x">10.1007/s00382-014-2262-x</ext-link>,
2015.</mixed-citation></ref>
      <ref id="bib1.bibx11"><label>Eade et al.(2012)Eade, Hamilton, Smith, Graham, and Scaife</label><mixed-citation>Eade, R., Hamilton, E., Smith, D. M., Graham, R. J., and Scaife, A. A.:
Forecasting the number of extreme daily events out to a decade ahead, J.
Geophys. Res.-Atmos., Res., 117, D21110, <ext-link xlink:href="http://dx.doi.org/10.1029/2012JD018015" ext-link-type="DOI">10.1029/2012JD018015</ext-link>, 2012.</mixed-citation></ref>
      <ref id="bib1.bibx12"><label>Frich et al.(2002)Frich, Alexander, Della-Marta, Gleason, Haylock,  Klein Tank, and Peterson</label><mixed-citation>Frich, P., Alexander, L., Della-Marta, P., Gleason, B., Haylock, M.,
Klein Tank, A., and Peterson, T.: Observed coherent changes in climatic
extremes during the second half of the twentieth century, Clim. Res., 19,
193–212, <ext-link xlink:href="http://dx.doi.org/10.3354/cr019193" ext-link-type="DOI">10.3354/cr019193</ext-link>, 2002.</mixed-citation></ref>
      <ref id="bib1.bibx13"><label>García-Serrano et al.(2013)García-Serrano, Doblas-Reyes, Haarsma, and Polo</label><mixed-citation>García-Serrano, J., Doblas-Reyes, F. J., Haarsma, R. J., and Polo, I.:
Decadal prediction of the dominant West African monsoon rainfall modes, J.
Geophys. Res.-Atmos., 118, 5260–5279, <ext-link xlink:href="http://dx.doi.org/10.1002/jgrd.50465" ext-link-type="DOI">10.1002/jgrd.50465</ext-link>, 2013.</mixed-citation></ref>
      <ref id="bib1.bibx14"><label>Giorgi et al.(2009)Giorgi, Jones, and Asrar</label><mixed-citation>
Giorgi, F., Jones, C., and Asrar, G.: Addressing climate information needs
at the regional level: the CORDEX framework, Bull. World Meteor. Org., 58,
175–183, 2009.</mixed-citation></ref>
      <ref id="bib1.bibx15"><label>Haylock et al.(2008)Haylock, Hofstra, Klein Tank, Klok, Jones, and New</label><mixed-citation>Haylock, M. R., Hofstra, N., Klein Tank, A. M. G., Klok, E. J., Jones, P. D.,
and New, M.: A European daily high-resolution gridded data set of surface
temperature and precipitation for 1950–2006, J. Geophys. Res., 113, D20119,
<ext-link xlink:href="http://dx.doi.org/10.1029/2008JD010201" ext-link-type="DOI">10.1029/2008JD010201</ext-link>, 2008.</mixed-citation></ref>
      <ref id="bib1.bibx16"><label>Hlinka et al.(2014)Hlinka, Hartman, Jajcay, Vejmelka, Donner, Marwan, Kurths, and Paluš</label><mixed-citation>Hlinka, J., Hartman, D., Jajcay, N., Vejmelka, M., Donner, R., Marwan, N.,
Kurths, J., and Paluš, M.: Regional and inter-regional effects in
evolving climate networks, Nonlin. Processes Geophys., 21, 451–462,
doi:<ext-link xlink:href="http://dx.doi.org/10.5194/npg-21-451-2014">10.5194/npg-21-451-2014</ext-link>,
2014.</mixed-citation></ref>
      <ref id="bib1.bibx17"><label>Jacob et al.(2013)Jacob, Petersen, Eggert, Alias, Christensen,
Bouwer, Braun, Colette, Déqué, Georgievski, Georgopoulou, Gobiet,
Menut, Nikulin, Haensler, Hempelmann, Jones, Keuler, Kovats, Kröner,
Kotlarski, Kriegsmann, Martin, Meijgaard, Moseley, Pfeifer, Preuschmann,
Radermacher, Radtke, Rechid, Rounsevell, Samuelsson, Somot, Soussana,
Teichmann, Valentini, Vautard, Weber, and Yiou</label><mixed-citation>Jacob, D.,
Petersen, J., Eggert, B., Alias, A., Christensen, O. B., Bouwer, L.,
Braun, A., Colette, A., Déqué, M., Georgievski, G., Georgopoulou, E.,
Gobiet, A., Menut, L., Nikulin, G., Haensler, A., Hempelmann, N., Jones, C.,
Keuler, K., Kovats, S., Kröner, N., Kotlarski, S., Kriegsmann, A.,
Martin, E., Meijgaard, E., Moseley, C., Pfeifer, S., Preuschmann, S.,
Radermacher, C., Radtke, K., Rechid, D., Rounsevell, M., Samuelsson, P.,
Somot, S., Soussana, J.-F., Teichmann, C., Valentini, R., Vautard, R.,
Weber, B., and Yiou, P.: EURO-CORDEX: new high-resolution climate change
projections for European impact research, Reg. Environ. Change, 14, 1–16,
<ext-link xlink:href="http://dx.doi.org/10.1007/s10113-013-0499-2" ext-link-type="DOI">10.1007/s10113-013-0499-2</ext-link>, 2013.</mixed-citation></ref>
      <ref id="bib1.bibx18"><label>Kadow et al.(2015)Kadow, Illing, Kunst, Rust,
Pohlmann, Müller, and Cubasch</label><mixed-citation>Kadow, C., Illing,
S., Kunst, O., Rust, H. W., Pohlmann, H., Müller, W. A., and Cubasch, U.:
Evaluation of forecasts by accuracy and spread in the miklip decadal climate
prediction system, Meteorol. Z., <ext-link xlink:href="http://dx.doi.org/10.1127/metz/2015/0639" ext-link-type="DOI">10.1127/metz/2015/0639</ext-link>, 2015.</mixed-citation></ref>
      <ref id="bib1.bibx19"><label>Keenlyside et al.(2008)Keenlyside, Latif, Jungclaus, Kornblueh, and Roeckner</label><mixed-citation>Keenlyside, N. S., Latif, M., Jungclaus, J., Kornblueh, L., and Roeckner, E.:
Advancing decadal-scale climate prediction in the North Atlantic sector,
Nature, 453, 84–88, <ext-link xlink:href="http://dx.doi.org/10.1038/nature06921" ext-link-type="DOI">10.1038/nature06921</ext-link>, 2008.</mixed-citation></ref>
      <ref id="bib1.bibx20"><label>Kothe et al.(2014)Kothe, Panitz, and Ahrens</label><mixed-citation>Kothe, S., Panitz, H.-J., and Ahrens, B.: Analysis of the radiation budget in
regional climate simulations with COSMO-CLM for Africa, Meteorol. Z., 23,
123–141,
doi:<ext-link xlink:href="http://dx.doi.org/10.1127/0941-2948/2014/0527">10.1127/0941-2948/2014/0527</ext-link>,
2014.</mixed-citation></ref>
      <ref id="bib1.bibx21"><label>Ludescher et al.(2013)Ludescher, Gozolchiani, Bogachev, Bunde, Havlin,
and Schellnhuber</label><mixed-citation>Ludescher, J., Gozolchiani, A.,
Bogachev, M. I., Bunde, A., Havlin, S., and Schellnhuber, H. J.: Improved El
Niño forecasting by cooperativity detection, P. Natl. Acad. Sci. USA, 110,
11742–11745,
doi:<ext-link xlink:href="http://dx.doi.org/10.1073/pnas.1309353110">10.1073/pnas.1309353110</ext-link>,
2013.</mixed-citation></ref>
      <ref id="bib1.bibx22"><label>MacLeod et al.(2012)MacLeod, Caminade, and Morse</label><mixed-citation>MacLeod, D. A., Caminade, C., and Morse, A. P.: Useful decadal climate
prediction at regional scales? A look at the ENSEMBLES
stream 2 decadal hindcasts, Environ. Res. Lett., 7, 044012,
<ext-link xlink:href="http://dx.doi.org/10.1088/1748-9326/7/4/044012" ext-link-type="DOI">10.1088/1748-9326/7/4/044012</ext-link>, 2012.</mixed-citation></ref>
      <ref id="bib1.bibx23"><label>Matei et al.(2012)Matei, Pohlmann, Jungclaus, Müller, Haak, and Marotzke</label><mixed-citation>Matei, D., Pohlmann, H., Jungclaus, J., Müller, W., Haak, H., and
Marotzke, J.: Two Tales of Initializing Decadal Climate Prediction
Experiments with the ECHAM5/MPI-OM Model, J. Climate, 25, 8502–8523, <ext-link xlink:href="http://dx.doi.org/10.1175/JCLI-D-11-00633.1" ext-link-type="DOI">10.1175/JCLI-D-11-00633.1</ext-link>, 2012.</mixed-citation></ref>
      <ref id="bib1.bibx24"><label>Meehl et al.(2014)Meehl, Teng, and Arblaster</label><mixed-citation>Meehl, G. A., Teng, H., and Arblaster, J. M.: Climate model simulations of
the observed early-2000s hiatus of global warming, Nature Clim. Change, 4,
898–902,
doi:<ext-link xlink:href="http://dx.doi.org/10.1038/nclimate2357">10.1038/nclimate2357</ext-link>,
2014.</mixed-citation></ref>
      <ref id="bib1.bibx25"><label>Mieruch et al.(2014)Mieruch, Feldmann, Schädler, Lenz, Kothe, and Kottmeier</label><mixed-citation>Mieruch, S., Feldmann, H., Schädler, G., Lenz, C.-J., Kothe, S., and
Kottmeier, C.: The regional MiKlip decadal forecast ensemble for Europe: the
added value of downscaling, Geosci. Model Dev., 7, 2983–2999,
doi:<ext-link xlink:href="http://dx.doi.org/10.5194/gmd-7-2983-2014">10.5194/gmd-7-2983-2014</ext-link>,
2014.</mixed-citation></ref>
      <ref id="bib1.bibx26"><label>Müller et al.(2012)Müller, Baehr, Haak, Jungclaus, Kröger,
Matei, Notz, Pohlmann, von Storch, and Marotzke</label><mixed-citation>Müller, W. A., Baehr, J., Haak, H., Jungclaus, J. H., Kröger, J.,
Matei, D., Notz, D., Pohlmann, H., von Storch, J. S., and Marotzke, J.:
Forecast skill of multi-year seasonal means in the decadal prediction system
of the Max Planck Institute for Meteorology, Geophys. Res. Lett., 39, L22707,
<ext-link xlink:href="http://dx.doi.org/10.1029/2012GL053326" ext-link-type="DOI">10.1029/2012GL053326</ext-link>, 2012.</mixed-citation></ref>
      <ref id="bib1.bibx27"><label>Peron et al.(2014)Peron, Comin, Amancio, da F. Costa, Rodrigues, and Kurths</label><mixed-citation>Peron, T. K. D., Comin, C. H., Amancio, D. R., da F. Costa, L., Rodrigues, F. A.,
and Kurths, J.: Correlations between climate network and relief data, Nonlin.
Processes Geophys., 21, 1127–1132,
doi:<ext-link xlink:href="http://dx.doi.org/10.5194/npg-21-1127-2014">10.5194/npg-21-1127-2014</ext-link>,
2014.</mixed-citation></ref>
      <ref id="bib1.bibx28"><label>Radebach et al.(2013)Radebach, Donner, Runge, Donges, and Kurths</label><mixed-citation>Radebach, A., Donner, R. V., Runge, J., Donges, J. F., and Kurths, J.:
Disentangling different types of El Niño episodes by evolving climate
network analysis, Phys. Rev. E, 88, 052807, <ext-link xlink:href="http://dx.doi.org/10.1103/PhysRevE.88.052807" ext-link-type="DOI">10.1103/PhysRevE.88.052807</ext-link>,
2013.</mixed-citation></ref>
      <ref id="bib1.bibx29"><label>Scaife et al.(2014)Scaife, Arribas, Blockley, Brookshaw, Clark,
Dunstone, Eade, Fereday, Folland, Gordon, Hermanson, Knight, Lea, MacLachlan,
Maidens, Martin, Peterson, Smith, Vellinga, Wallace, Waters, and
Williams</label><mixed-citation>Scaife, A. A., Arribas, A., Blockley, E.,
Brookshaw, A., Clark, R. T., Dunstone, N., Eade, R., Fereday, D.,
Folland, C. K., Gordon, M., Hermanson, L., Knight, J. R., Lea, D. J.,
MacLachlan, C., Maidens, A., Martin, M., Peterson, A. K., Smith, D.,
Vellinga, M., Wallace, E., Waters, J., and Williams, A.: Skillful long-range
prediction of European and North American winters, Geophys. Res. Lett., 41,
2514–2519, <ext-link xlink:href="http://dx.doi.org/10.1002/2014GL059637" ext-link-type="DOI">10.1002/2014GL059637</ext-link>, 2014.</mixed-citation></ref>
      <ref id="bib1.bibx30"><label>Smith et al.(2013)Smith, Eade, and Pohlmann</label><mixed-citation>Smith, D., Eade, R., and Pohlmann, H.: A comparison of full-field and anomaly
initialization for seasonal to decadal climate prediction, Clim. Dynam., 41,
3325–3338,
doi:<ext-link xlink:href="http://dx.doi.org/10.1007/s00382-013-1683-2">10.1007/s00382-013-1683-2</ext-link>,
2013.</mixed-citation></ref>
      <ref id="bib1.bibx31"><label>Stevens et al.(2013)Stevens, Giorgetta, Esch, Mauritsen, Crueger,
Rast, Salzmann, Schmidt, Bader, Block, Brokopf, Fast, Kinne, Kornblueh,
Lohmann, Pincus, Reichler, and Roeckner</label><mixed-citation>Stevens, B.,
Giorgetta, M., Esch, M., Mauritsen, T., Crueger, T., Rast, S., Salzmann, M.,
Schmidt, H., Bader, J., Block, K., Brokopf, R., Fast, I., Kinne, S.,
Kornblueh, L., Lohmann, U., Pincus, R., Reichler, T., and Roeckner, E.:
Atmospheric component of the MPI-M Earth System Model: ECHAM6, Adv. Model.
Earth Syst., 5, 146–172, <ext-link xlink:href="http://dx.doi.org/10.1002/jame.20015" ext-link-type="DOI">10.1002/jame.20015</ext-link>, 2013.</mixed-citation></ref>
      <ref id="bib1.bibx32"><label>Taylor et al.(2012)Taylor, Stouffer, and Meehl</label><mixed-citation>Taylor, K. E., Stouffer, R. J., and Meehl, G. A.: An overview of CMIP5 and
the experiment design, B. Am. Meteorol. Soc., 93, 485–498,
<ext-link xlink:href="http://dx.doi.org/10.1175/BAMS-D-11-00094.1" ext-link-type="DOI">10.1175/BAMS-D-11-00094.1</ext-link>, 2012.</mixed-citation></ref>
      <ref id="bib1.bibx33"><label>Tsonis and Swanson(2012)</label><mixed-citation>Tsonis, A. A. and Swanson, K. L.: Review article “On the origins of
decadal climate variability: a network perspective”, Nonlin. Processes
Geophys., 19, 559–568,
doi:<ext-link xlink:href="http://dx.doi.org/10.5194/npg-19-559-2012">10.5194/npg-19-559-2012</ext-link>,
2012.</mixed-citation></ref>
      <ref id="bib1.bibx34"><label>Tsonis et al.(2007)Tsonis, Swanson, and Kravtsov</label><mixed-citation>Tsonis, A. A., Swanson, K., and Kravtsov, S.: A new dynamical mechanism for
major climate shifts, Geophys. Res. Lett., 34, L13705,
<ext-link xlink:href="http://dx.doi.org/10.1029/2007GL030288" ext-link-type="DOI">10.1029/2007GL030288</ext-link>, 2007.
</mixed-citation></ref><?xmltex \hack{\newpage}?>
      <ref id="bib1.bibx35"><label>van Oldenborgh et al.(2012)van Oldenborgh, Doblas-Reyes, Wouters, and Hazeleger</label><mixed-citation>van Oldenborgh, G. J., Doblas-Reyes, F. J., Wouters, B., and Hazeleger, W.:
Skill in the trend and internal variability in a multi-model decadal
prediction ensemble, Clim. Dynam., 38, 1263–1280, <ext-link xlink:href="http://dx.doi.org/10.1007/s00382-012-1313-4" ext-link-type="DOI">10.1007/s00382-012-1313-4</ext-link>, 2012.</mixed-citation></ref>
      <ref id="bib1.bibx36"><label>von Storch and Zwiers(2013)</label><mixed-citation>von Storch, H. and Zwiers, F. W.: Testing ensembles of climate change scenarios
for “statistical significance”, Clim. Change, 117, 1–9, <ext-link xlink:href="http://dx.doi.org/10.1007/s10584-012-0551-0" ext-link-type="DOI">10.1007/s10584-012-0551-0</ext-link>, 2013.</mixed-citation></ref>
      <ref id="bib1.bibx37"><label>Zou et al.(2014)Zou, Donner, Marwan, Small, and Kurths</label><mixed-citation>Zou, Y., Donner, R. V., Marwan, N., Small, M., and Kurths, J.: Long-term
changes in the north–south asymmetry of solar activity: a nonlinear dynamics
characterization using visibility graphs, Nonlin. Processes Geophys., 21,
1113–1126,
doi:<ext-link xlink:href="http://dx.doi.org/10.5194/npg-21-1113-2014">10.5194/npg-21-1113-2014</ext-link>,
2014.</mixed-citation></ref>

  </ref-list><app-group content-type="float"><app><title/>

    </app></app-group></back>
    <!--<article-title-html>A new estimator of heat periods for decadal climate predictions – a complex network approach</article-title-html>
<abstract-html><p class="p">Regional decadal predictions have emerged in the past few years as a research
field with high application potential, especially for extremes like heat and
drought periods. However, up to now the prediction skill of decadal
hindcasts, as evaluated with standard methods, is moderate and for extreme
values even rarely investigated. In this study, we use hindcast data from
a regional climate model (CCLM) for eight regions in Europe and quantify the
skill of the model alternatively by constructing time-evolving climate
networks and use the network correlation threshold (link strength) as
a predictor for heat periods. We show that the skill of the network measure
to estimate the low-frequency dynamics of heat periods is superior for
decadal predictions with respect to the typical approach of using a fixed
temperature threshold for estimating the number of heat periods in Europe.</p></abstract-html>
<ref-html id="bib1.bib1"><label>Amante and Eakins(2009)</label><mixed-citation>
Amante, C. and Eakins, B.: ETOPO1 1 Arc-Minute Global Relief Model:
Procedures, Data Sources and Analysis. NOAA Technical Memorandum, Tech. Rep.
NESDIS NGDC-24, National Geophysical Data Center, NOAA, Boulder, Colorado,
USA, <a href="http://dx.doi.org/10.7289/V5C8276M" target="_blank">doi:10.7289/V5C8276M</a>, 2009.
</mixed-citation></ref-html>
<ref-html id="bib1.bib2"><label>Berezin et al.(2012)Berezin, Gozolchiani, Guez, and Havlin</label><mixed-citation>
Berezin, Y., Gozolchiani, A., Guez, O., and Havlin, S.: Stability of climate
networks with time, Sci. Rep., 2, 666, <a href="http://dx.doi.org/10.1038/srep00666" target="_blank">doi:10.1038/srep00666</a>, 2012.
</mixed-citation></ref-html>
<ref-html id="bib1.bib3"><label>Boers et al.(2014)Boers, Bookhagen, Barbosa, Marwan, Kurths, and Marengo</label><mixed-citation>
Boers, N., Bookhagen, B., Barbosa, H. M. J., Marwan, N., Kurths, J., and
Marengo, J. A.: Prediction of extreme floods in the eastern Central Andes
based on a complex networks approach, Nat. Commun., 5, 5199,
<a href="http://dx.doi.org/10.1038/ncomms6199" target="_blank">doi:10.1038/ncomms6199</a>, 2014.
</mixed-citation></ref-html>
<ref-html id="bib1.bib4"><label>Chikamoto et al.(2015)Chikamoto, Timmermann, Luo,
Mochizuki, Kimoto, Watanabe, Ishii, Xie, and Jin</label><mixed-citation>
Chikamoto, Y., Timmermann, A., Luo, J.-J., Mochizuki, T., Kimoto, M.,
Watanabe, M., Ishii, M., Xie, S.-P., and Jin, F.-F.: Skilful multi-year
predictions of tropical trans-basin climate variability, Nat. Commun., 6,
6869, <a href="http://dx.doi.org/10.1038/ncomms7869" target="_blank">doi:10.1038/ncomms7869</a>, 2015.
</mixed-citation></ref-html>
<ref-html id="bib1.bib5"><label>Corti et al.(2012)Corti, Weisheimer, Palmer, Doblas-Reyes, and Magnusson</label><mixed-citation>
Corti, S., Weisheimer, A., Palmer, T. N., Doblas-Reyes, F. J., and
Magnusson, L.: Reliability of decadal predictions, Geophys. Res. Lett., 39,
L21712, <a href="http://dx.doi.org/10.1029/2012GL053354" target="_blank">doi:10.1029/2012GL053354</a>, 2012.
</mixed-citation></ref-html>
<ref-html id="bib1.bib6"><label>Doblas-Reyes et al.(2013)Doblas-Reyes, Andreu-Burillo, Chikamoto,
García-Serrano, Guemas, Kimoto, Mochizuki, Rodrigues, and van
Oldenborgh</label><mixed-citation> Doblas-Reyes, F. J., Andreu-Burillo, I.,
Chikamoto, Y., García-Serrano, J., Guemas, V., Kimoto, M., Mochizuki, T.,
Rodrigues, L. R. L., and van Oldenborgh, G. J.: Initialized near-term
regional climate change prediction, Nat. Commun., 4, 1715,
<a href="http://dx.doi.org/10.1038/ncomms2704" target="_blank">doi:10.1038/ncomms2704</a>, 2013.
</mixed-citation></ref-html>
<ref-html id="bib1.bib7"><label>Doms and Schättler(2002)</label><mixed-citation>
Doms, G. and Schättler, U.: A Description of the Non-Hydrostatic Regional
Model LM, Part I: Dynamics and Numerics, tech. rep., Deutscher
Wetterdienst, P.O. Box 100465, 63004 Offenbach, Germany, LM_F90 2.18, 2002.
</mixed-citation></ref-html>
<ref-html id="bib1.bib8"><label>Donges et al.(2009)Donges, Zou, Marwan, and Kurths</label><mixed-citation>
Donges, J. F., Zou, Y., Marwan, N., and Kurths, J.: Complex networks in
climatic dynamics, Eur. Phys. J.-Spec. Top., 174, 157–179,
doi:<a href="http://dx.doi.org/10.1140/epjst/e2009-01098-2" target="_blank">10.1140/epjst/e2009-01098-2</a>,
2009.
</mixed-citation></ref-html>
<ref-html id="bib1.bib9"><label>Donges et al.(2011)Donges, Donner, Trauth, Marwan, Schellnhuber, and Kurths</label><mixed-citation>
Donges, J. F., Donner, R. V., Trauth, M. H., Marwan, N., Schellnhuber, H.-J.,
and Kurths, J.: Nonlinear detection of paleoclimate-variability transitions
possibly related to human evolution, P. Natl. Acad. Sci. USA, 108,
20422–20427, <a href="http://dx.doi.org/10.1073/pnas.1117052108" target="_blank">doi:10.1073/pnas.1117052108</a>, 2011.
</mixed-citation></ref-html>
<ref-html id="bib1.bib10"><label>Dosio et al.(2015)Dosio, Panitz, Schubert-Frisius, and Lüthi</label><mixed-citation>
Dosio, A., Panitz, H.-J., Schubert-Frisius, M., and Lüthi, D.: Dynamical
downscaling of CMIP5 global circulation models over CORDEX-Africa with
COSMO-CLM: evaluation over the present climate and analysis of the added
value, Clim. Dynam., 44, 2637–2661,
doi:<a href="http://dx.doi.org/10.1007/s00382-014-2262-x" target="_blank">10.1007/s00382-014-2262-x</a>,
2015.
</mixed-citation></ref-html>
<ref-html id="bib1.bib11"><label>Eade et al.(2012)Eade, Hamilton, Smith, Graham, and Scaife</label><mixed-citation>
Eade, R., Hamilton, E., Smith, D. M., Graham, R. J., and Scaife, A. A.:
Forecasting the number of extreme daily events out to a decade ahead, J.
Geophys. Res.-Atmos., Res., 117, D21110, <a href="http://dx.doi.org/10.1029/2012JD018015" target="_blank">doi:10.1029/2012JD018015</a>, 2012.
</mixed-citation></ref-html>
<ref-html id="bib1.bib12"><label>Frich et al.(2002)Frich, Alexander, Della-Marta, Gleason, Haylock,  Klein Tank, and Peterson</label><mixed-citation>
Frich, P., Alexander, L., Della-Marta, P., Gleason, B., Haylock, M.,
Klein Tank, A., and Peterson, T.: Observed coherent changes in climatic
extremes during the second half of the twentieth century, Clim. Res., 19,
193–212, <a href="http://dx.doi.org/10.3354/cr019193" target="_blank">doi:10.3354/cr019193</a>, 2002.
</mixed-citation></ref-html>
<ref-html id="bib1.bib13"><label>García-Serrano et al.(2013)García-Serrano, Doblas-Reyes, Haarsma, and Polo</label><mixed-citation>
García-Serrano, J., Doblas-Reyes, F. J., Haarsma, R. J., and Polo, I.:
Decadal prediction of the dominant West African monsoon rainfall modes, J.
Geophys. Res.-Atmos., 118, 5260–5279, <a href="http://dx.doi.org/10.1002/jgrd.50465" target="_blank">doi:10.1002/jgrd.50465</a>, 2013.
</mixed-citation></ref-html>
<ref-html id="bib1.bib14"><label>Giorgi et al.(2009)Giorgi, Jones, and Asrar</label><mixed-citation>
Giorgi, F., Jones, C., and Asrar, G.: Addressing climate information needs
at the regional level: the CORDEX framework, Bull. World Meteor. Org., 58,
175–183, 2009.
</mixed-citation></ref-html>
<ref-html id="bib1.bib15"><label>Haylock et al.(2008)Haylock, Hofstra, Klein Tank, Klok, Jones, and New</label><mixed-citation>
Haylock, M. R., Hofstra, N., Klein Tank, A. M. G., Klok, E. J., Jones, P. D.,
and New, M.: A European daily high-resolution gridded data set of surface
temperature and precipitation for 1950–2006, J. Geophys. Res., 113, D20119,
<a href="http://dx.doi.org/10.1029/2008JD010201" target="_blank">doi:10.1029/2008JD010201</a>, 2008.
</mixed-citation></ref-html>
<ref-html id="bib1.bib16"><label>Hlinka et al.(2014)Hlinka, Hartman, Jajcay, Vejmelka, Donner, Marwan, Kurths, and Paluš</label><mixed-citation>
Hlinka, J., Hartman, D., Jajcay, N., Vejmelka, M., Donner, R., Marwan, N.,
Kurths, J., and Paluš, M.: Regional and inter-regional effects in
evolving climate networks, Nonlin. Processes Geophys., 21, 451–462,
doi:<a href="http://dx.doi.org/10.5194/npg-21-451-2014" target="_blank">10.5194/npg-21-451-2014</a>,
2014.
</mixed-citation></ref-html>
<ref-html id="bib1.bib17"><label>Jacob et al.(2013)Jacob, Petersen, Eggert, Alias, Christensen,
Bouwer, Braun, Colette, Déqué, Georgievski, Georgopoulou, Gobiet,
Menut, Nikulin, Haensler, Hempelmann, Jones, Keuler, Kovats, Kröner,
Kotlarski, Kriegsmann, Martin, Meijgaard, Moseley, Pfeifer, Preuschmann,
Radermacher, Radtke, Rechid, Rounsevell, Samuelsson, Somot, Soussana,
Teichmann, Valentini, Vautard, Weber, and Yiou</label><mixed-citation> Jacob, D.,
Petersen, J., Eggert, B., Alias, A., Christensen, O. B., Bouwer, L.,
Braun, A., Colette, A., Déqué, M., Georgievski, G., Georgopoulou, E.,
Gobiet, A., Menut, L., Nikulin, G., Haensler, A., Hempelmann, N., Jones, C.,
Keuler, K., Kovats, S., Kröner, N., Kotlarski, S., Kriegsmann, A.,
Martin, E., Meijgaard, E., Moseley, C., Pfeifer, S., Preuschmann, S.,
Radermacher, C., Radtke, K., Rechid, D., Rounsevell, M., Samuelsson, P.,
Somot, S., Soussana, J.-F., Teichmann, C., Valentini, R., Vautard, R.,
Weber, B., and Yiou, P.: EURO-CORDEX: new high-resolution climate change
projections for European impact research, Reg. Environ. Change, 14, 1–16,
<a href="http://dx.doi.org/10.1007/s10113-013-0499-2" target="_blank">doi:10.1007/s10113-013-0499-2</a>, 2013.
</mixed-citation></ref-html>
<ref-html id="bib1.bib18"><label>Kadow et al.(2015)Kadow, Illing, Kunst, Rust,
Pohlmann, Müller, and Cubasch</label><mixed-citation> Kadow, C., Illing,
S., Kunst, O., Rust, H. W., Pohlmann, H., Müller, W. A., and Cubasch, U.:
Evaluation of forecasts by accuracy and spread in the miklip decadal climate
prediction system, Meteorol. Z., <a href="http://dx.doi.org/10.1127/metz/2015/0639" target="_blank">doi:10.1127/metz/2015/0639</a>, 2015.
</mixed-citation></ref-html>
<ref-html id="bib1.bib19"><label>Keenlyside et al.(2008)Keenlyside, Latif, Jungclaus, Kornblueh, and Roeckner</label><mixed-citation>
Keenlyside, N. S., Latif, M., Jungclaus, J., Kornblueh, L., and Roeckner, E.:
Advancing decadal-scale climate prediction in the North Atlantic sector,
Nature, 453, 84–88, <a href="http://dx.doi.org/10.1038/nature06921" target="_blank">doi:10.1038/nature06921</a>, 2008.
</mixed-citation></ref-html>
<ref-html id="bib1.bib20"><label>Kothe et al.(2014)Kothe, Panitz, and Ahrens</label><mixed-citation>
Kothe, S., Panitz, H.-J., and Ahrens, B.: Analysis of the radiation budget in
regional climate simulations with COSMO-CLM for Africa, Meteorol. Z., 23,
123–141,
doi:<a href="http://dx.doi.org/10.1127/0941-2948/2014/0527" target="_blank">10.1127/0941-2948/2014/0527</a>,
2014.
</mixed-citation></ref-html>
<ref-html id="bib1.bib21"><label>Ludescher et al.(2013)Ludescher, Gozolchiani, Bogachev, Bunde, Havlin,
and Schellnhuber</label><mixed-citation> Ludescher, J., Gozolchiani, A.,
Bogachev, M. I., Bunde, A., Havlin, S., and Schellnhuber, H. J.: Improved El
Niño forecasting by cooperativity detection, P. Natl. Acad. Sci. USA, 110,
11742–11745,
doi:<a href="http://dx.doi.org/10.1073/pnas.1309353110" target="_blank">10.1073/pnas.1309353110</a>,
2013.
</mixed-citation></ref-html>
<ref-html id="bib1.bib22"><label>MacLeod et al.(2012)MacLeod, Caminade, and Morse</label><mixed-citation>
MacLeod, D. A., Caminade, C., and Morse, A. P.: Useful decadal climate
prediction at regional scales? A look at the ENSEMBLES
stream 2 decadal hindcasts, Environ. Res. Lett., 7, 044012,
<a href="http://dx.doi.org/10.1088/1748-9326/7/4/044012" target="_blank">doi:10.1088/1748-9326/7/4/044012</a>, 2012.
</mixed-citation></ref-html>
<ref-html id="bib1.bib23"><label>Matei et al.(2012)Matei, Pohlmann, Jungclaus, Müller, Haak, and Marotzke</label><mixed-citation>
Matei, D., Pohlmann, H., Jungclaus, J., Müller, W., Haak, H., and
Marotzke, J.: Two Tales of Initializing Decadal Climate Prediction
Experiments with the ECHAM5/MPI-OM Model, J. Climate, 25, 8502–8523, <a href="http://dx.doi.org/10.1175/JCLI-D-11-00633.1" target="_blank">doi:10.1175/JCLI-D-11-00633.1</a>, 2012.
</mixed-citation></ref-html>
<ref-html id="bib1.bib24"><label>Meehl et al.(2014)Meehl, Teng, and Arblaster</label><mixed-citation>
Meehl, G. A., Teng, H., and Arblaster, J. M.: Climate model simulations of
the observed early-2000s hiatus of global warming, Nature Clim. Change, 4,
898–902,
doi:<a href="http://dx.doi.org/10.1038/nclimate2357" target="_blank">10.1038/nclimate2357</a>,
2014.
</mixed-citation></ref-html>
<ref-html id="bib1.bib25"><label>Mieruch et al.(2014)Mieruch, Feldmann, Schädler, Lenz, Kothe, and Kottmeier</label><mixed-citation>
Mieruch, S., Feldmann, H., Schädler, G., Lenz, C.-J., Kothe, S., and
Kottmeier, C.: The regional MiKlip decadal forecast ensemble for Europe: the
added value of downscaling, Geosci. Model Dev., 7, 2983–2999,
doi:<a href="http://dx.doi.org/10.5194/gmd-7-2983-2014" target="_blank">10.5194/gmd-7-2983-2014</a>,
2014.
</mixed-citation></ref-html>
<ref-html id="bib1.bib26"><label>Müller et al.(2012)Müller, Baehr, Haak, Jungclaus, Kröger,
Matei, Notz, Pohlmann, von Storch, and Marotzke</label><mixed-citation>
Müller, W. A., Baehr, J., Haak, H., Jungclaus, J. H., Kröger, J.,
Matei, D., Notz, D., Pohlmann, H., von Storch, J. S., and Marotzke, J.:
Forecast skill of multi-year seasonal means in the decadal prediction system
of the Max Planck Institute for Meteorology, Geophys. Res. Lett., 39, L22707,
<a href="http://dx.doi.org/10.1029/2012GL053326" target="_blank">doi:10.1029/2012GL053326</a>, 2012.
</mixed-citation></ref-html>
<ref-html id="bib1.bib27"><label>Peron et al.(2014)Peron, Comin, Amancio, da F. Costa, Rodrigues, and Kurths</label><mixed-citation>
Peron, T. K. D., Comin, C. H., Amancio, D. R., da F. Costa, L., Rodrigues, F. A.,
and Kurths, J.: Correlations between climate network and relief data, Nonlin.
Processes Geophys., 21, 1127–1132,
doi:<a href="http://dx.doi.org/10.5194/npg-21-1127-2014" target="_blank">10.5194/npg-21-1127-2014</a>,
2014.
</mixed-citation></ref-html>
<ref-html id="bib1.bib28"><label>Radebach et al.(2013)Radebach, Donner, Runge, Donges, and Kurths</label><mixed-citation>
Radebach, A., Donner, R. V., Runge, J., Donges, J. F., and Kurths, J.:
Disentangling different types of El Niño episodes by evolving climate
network analysis, Phys. Rev. E, 88, 052807, <a href="http://dx.doi.org/10.1103/PhysRevE.88.052807" target="_blank">doi:10.1103/PhysRevE.88.052807</a>,
2013.
</mixed-citation></ref-html>
<ref-html id="bib1.bib29"><label>Scaife et al.(2014)Scaife, Arribas, Blockley, Brookshaw, Clark,
Dunstone, Eade, Fereday, Folland, Gordon, Hermanson, Knight, Lea, MacLachlan,
Maidens, Martin, Peterson, Smith, Vellinga, Wallace, Waters, and
Williams</label><mixed-citation> Scaife, A. A., Arribas, A., Blockley, E.,
Brookshaw, A., Clark, R. T., Dunstone, N., Eade, R., Fereday, D.,
Folland, C. K., Gordon, M., Hermanson, L., Knight, J. R., Lea, D. J.,
MacLachlan, C., Maidens, A., Martin, M., Peterson, A. K., Smith, D.,
Vellinga, M., Wallace, E., Waters, J., and Williams, A.: Skillful long-range
prediction of European and North American winters, Geophys. Res. Lett., 41,
2514–2519, <a href="http://dx.doi.org/10.1002/2014GL059637" target="_blank">doi:10.1002/2014GL059637</a>, 2014.
</mixed-citation></ref-html>
<ref-html id="bib1.bib30"><label>Smith et al.(2013)Smith, Eade, and Pohlmann</label><mixed-citation>
Smith, D., Eade, R., and Pohlmann, H.: A comparison of full-field and anomaly
initialization for seasonal to decadal climate prediction, Clim. Dynam., 41,
3325–3338,
doi:<a href="http://dx.doi.org/10.1007/s00382-013-1683-2" target="_blank">10.1007/s00382-013-1683-2</a>,
2013.
</mixed-citation></ref-html>
<ref-html id="bib1.bib31"><label>Stevens et al.(2013)Stevens, Giorgetta, Esch, Mauritsen, Crueger,
Rast, Salzmann, Schmidt, Bader, Block, Brokopf, Fast, Kinne, Kornblueh,
Lohmann, Pincus, Reichler, and Roeckner</label><mixed-citation> Stevens, B.,
Giorgetta, M., Esch, M., Mauritsen, T., Crueger, T., Rast, S., Salzmann, M.,
Schmidt, H., Bader, J., Block, K., Brokopf, R., Fast, I., Kinne, S.,
Kornblueh, L., Lohmann, U., Pincus, R., Reichler, T., and Roeckner, E.:
Atmospheric component of the MPI-M Earth System Model: ECHAM6, Adv. Model.
Earth Syst., 5, 146–172, <a href="http://dx.doi.org/10.1002/jame.20015" target="_blank">doi:10.1002/jame.20015</a>, 2013.
</mixed-citation></ref-html>
<ref-html id="bib1.bib32"><label>Taylor et al.(2012)Taylor, Stouffer, and Meehl</label><mixed-citation>
Taylor, K. E., Stouffer, R. J., and Meehl, G. A.: An overview of CMIP5 and
the experiment design, B. Am. Meteorol. Soc., 93, 485–498,
<a href="http://dx.doi.org/10.1175/BAMS-D-11-00094.1" target="_blank">doi:10.1175/BAMS-D-11-00094.1</a>, 2012.
</mixed-citation></ref-html>
<ref-html id="bib1.bib33"><label>Tsonis and Swanson(2012)</label><mixed-citation>
Tsonis, A. A. and Swanson, K. L.: Review article “On the origins of
decadal climate variability: a network perspective”, Nonlin. Processes
Geophys., 19, 559–568,
doi:<a href="http://dx.doi.org/10.5194/npg-19-559-2012" target="_blank">10.5194/npg-19-559-2012</a>,
2012.
</mixed-citation></ref-html>
<ref-html id="bib1.bib34"><label>Tsonis et al.(2007)Tsonis, Swanson, and Kravtsov</label><mixed-citation>
Tsonis, A. A., Swanson, K., and Kravtsov, S.: A new dynamical mechanism for
major climate shifts, Geophys. Res. Lett., 34, L13705,
<a href="http://dx.doi.org/10.1029/2007GL030288" target="_blank">doi:10.1029/2007GL030288</a>, 2007.

</mixed-citation></ref-html>
<ref-html id="bib1.bib35"><label>van Oldenborgh et al.(2012)van Oldenborgh, Doblas-Reyes, Wouters, and Hazeleger</label><mixed-citation>
van Oldenborgh, G. J., Doblas-Reyes, F. J., Wouters, B., and Hazeleger, W.:
Skill in the trend and internal variability in a multi-model decadal
prediction ensemble, Clim. Dynam., 38, 1263–1280, <a href="http://dx.doi.org/10.1007/s00382-012-1313-4" target="_blank">doi:10.1007/s00382-012-1313-4</a>, 2012.
</mixed-citation></ref-html>
<ref-html id="bib1.bib36"><label>von Storch and Zwiers(2013)</label><mixed-citation>
von Storch, H. and Zwiers, F. W.: Testing ensembles of climate change scenarios
for “statistical significance”, Clim. Change, 117, 1–9, <a href="http://dx.doi.org/10.1007/s10584-012-0551-0" target="_blank">doi:10.1007/s10584-012-0551-0</a>, 2013.
</mixed-citation></ref-html>
<ref-html id="bib1.bib37"><label>Zou et al.(2014)Zou, Donner, Marwan, Small, and Kurths</label><mixed-citation>
Zou, Y., Donner, R. V., Marwan, N., Small, M., and Kurths, J.: Long-term
changes in the north–south asymmetry of solar activity: a nonlinear dynamics
characterization using visibility graphs, Nonlin. Processes Geophys., 21,
1113–1126,
doi:<a href="http://dx.doi.org/10.5194/npg-21-1113-2014" target="_blank">10.5194/npg-21-1113-2014</a>,
2014.
</mixed-citation></ref-html>--></article>
