Articles | Volume 6, issue 2
https://doi.org/10.5194/ascmo-6-103-2020
© Author(s) 2020. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/ascmo-6-103-2020
© Author(s) 2020. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Comparing forecast systems with multiple correlation decomposition based on partial correlation
Rita Glowienka-Hense
CORRESPONDING AUTHOR
Institute for Geosciences, Universität Bonn, Bonn, Germany
Andreas Hense
Institute for Geosciences, Universität Bonn, Bonn, Germany
Sebastian Brune
Institute of Oceanography, Center for Earth System Research and Sustainability (CEN), Universität Hamburg, Hamburg, Germany
Johanna Baehr
Institute of Oceanography, Center for Earth System Research and Sustainability (CEN), Universität Hamburg, Hamburg, Germany
Related authors
Rita Glowienka-Hense, Andreas Hense, Thomas Spangehl, and Marc Schröder
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2018-141, https://doi.org/10.5194/gmd-2018-141, 2018
Revised manuscript not accepted
Short summary
Short summary
Ensemble forecast verification treats the issues of forecast errors and uncertainty estimated from ensemble spread. We suggest measures based on relative entropy. For continuous variables correlation and the mean ratio of the ensemble spread to climate variance (analysis of variance (anova)) are related to these entropies. For categorical data corresponding scores are deduced that allow the comparison with continuous data.
Laura Schaffer, Andreas Boesch, Johanna Baehr, and Tim Kruschke
EGUsphere, https://doi.org/10.5194/egusphere-2024-3144, https://doi.org/10.5194/egusphere-2024-3144, 2024
Short summary
Short summary
We developed a simple yet effective model to predict storm surges in the German Bight, using wind data and a multiple linear regression approach. Trained on historical data from 1959 to 2022, our storm surge model demonstrates high predictive skill and performs as well as more complex models, despite its simplicity. It can predict both moderate and extreme storm surges, making it a valuable tool for future climate change studies.
Daniel Krieger, Sebastian Brune, Johanna Baehr, and Ralf Weisse
Nat. Hazards Earth Syst. Sci., 24, 1539–1554, https://doi.org/10.5194/nhess-24-1539-2024, https://doi.org/10.5194/nhess-24-1539-2024, 2024
Short summary
Short summary
Previous studies found that climate models can predict storm activity in the German Bight well for averages of 5–10 years but struggle in predicting the next winter season. Here, we improve winter storm activity predictions by linking them to physical phenomena that occur before the winter. We guess the winter storm activity from these phenomena and discard model solutions that stray too far from the guess. The remaining solutions then show much higher prediction skill for storm activity.
Timon Netzel, Andrea Miebach, Thomas Litt, and Andreas Hense
EGUsphere, https://doi.org/10.5194/egusphere-2023-1790, https://doi.org/10.5194/egusphere-2023-1790, 2023
Short summary
Short summary
New probabilistic methods for local quantitative palaeoclimate reconstructions are presented in a Bayesian framework and applied to plant proxy data from Lake Kinneret. We use recent climate data and arboreal pollen from the sediment of this lake as predefined boundary conditions. The result shows a climate reconstruction of the mean December–February temperature and annual precipitation with the corresponding uncertainty ranges during the Holocene in this region.
Julianna Carvalho-Oliveira, Giorgia di Capua, Leonard Borchert, Reik Donner, and Johanna Baehr
EGUsphere, https://doi.org/10.5194/egusphere-2023-1412, https://doi.org/10.5194/egusphere-2023-1412, 2023
Short summary
Short summary
We demonstrate with a causality analysis that an important recurrent summer atmospheric pattern, the so-called East Atlantic teleconnection, is influenced by the extratropical North Atlantic in spring during the second half of the 20th century. This causal link is, however, not well represented by our evaluated seasonal climate prediction system. We show that simulations able to reproduce this link show improved surface climate prediction credibility over those that do not.
Manuel Chevalier, Anne Dallmeyer, Nils Weitzel, Chenzhi Li, Jean-Philippe Baudouin, Ulrike Herzschuh, Xianyong Cao, and Andreas Hense
Clim. Past, 19, 1043–1060, https://doi.org/10.5194/cp-19-1043-2023, https://doi.org/10.5194/cp-19-1043-2023, 2023
Short summary
Short summary
Data–data and data–model vegetation comparisons are commonly based on comparing single vegetation estimates. While this approach generates good results on average, reducing pollen assemblages to single single plant functional type (PFT) or biome estimates can oversimplify the vegetation signal. We propose using a multivariate metric, the Earth mover's distance (EMD), to include more details about the vegetation structure when performing such comparisons.
Daniel Krieger, Sebastian Brune, Patrick Pieper, Ralf Weisse, and Johanna Baehr
Nat. Hazards Earth Syst. Sci., 22, 3993–4009, https://doi.org/10.5194/nhess-22-3993-2022, https://doi.org/10.5194/nhess-22-3993-2022, 2022
Short summary
Short summary
Accurate predictions of storm activity are desirable for coastal management. We investigate how well a climate model can predict storm activity in the German Bight 1–10 years in advance. We let the model predict the past, compare these predictions to observations, and analyze whether the model is doing better than simple statistical predictions. We find that the model generally shows good skill for extreme periods, but the prediction timeframes with good skill depend on the type of prediction.
Yiyu Zheng, Maria Rugenstein, Patrick Pieper, Goratz Beobide-Arsuaga, and Johanna Baehr
Earth Syst. Dynam., 13, 1611–1623, https://doi.org/10.5194/esd-13-1611-2022, https://doi.org/10.5194/esd-13-1611-2022, 2022
Short summary
Short summary
El Niño–Southern Oscillation (ENSO) is one of the dominant climatic phenomena in the equatorial Pacific. Understanding and predicting how ENSO might change in a warmer climate is both societally and scientifically important. We use 1000-year-long simulations from seven climate models to analyze ENSO in an idealized stable climate. We show that ENSO will be weaker and last shorter under the warming, while the skill of ENSO prediction will unlikely change.
Tim Rohrschneider, Johanna Baehr, Veit Lüschow, Dian Putrasahan, and Jochem Marotzke
Ocean Sci., 18, 979–996, https://doi.org/10.5194/os-18-979-2022, https://doi.org/10.5194/os-18-979-2022, 2022
Short summary
Short summary
This paper presents an analysis of wind sensitivity experiments in order to provide insight into the wind forcing dependence of the AMOC by understanding the behavior of its depth scale(s).
Marcel Meyer, Iuliia Polkova, Kameswar Rao Modali, Laura Schaffer, Johanna Baehr, Stephan Olbrich, and Marc Rautenhaus
Weather Clim. Dynam., 2, 867–891, https://doi.org/10.5194/wcd-2-867-2021, https://doi.org/10.5194/wcd-2-867-2021, 2021
Short summary
Short summary
Novel techniques from computer science are used to study extreme weather events. Inspired by the interactive 3-D visual analysis of the recently released ERA5 reanalysis data, we improve commonly used metrics for measuring polar winter storms and outbreaks of cold air. The software (Met.3D) that we have extended and applied as part of this study is freely available and can be used generically for 3-D visualization of a broad variety of atmospheric processes in weather and climate data.
Julianna Carvalho-Oliveira, Leonard Friedrich Borchert, Aurélie Duchez, Mikhail Dobrynin, and Johanna Baehr
Weather Clim. Dynam., 2, 739–757, https://doi.org/10.5194/wcd-2-739-2021, https://doi.org/10.5194/wcd-2-739-2021, 2021
Short summary
Short summary
This work questions the influence of the Atlantic Meridional Overturning Circulation, an important component of the climate system, on the variability in North Atlantic sea surface temperature (SST) a season ahead, particularly how this influence affects SST prediction credibility 2–4 months into the future. While we find this relationship is relevant for assessing SST predictions, it strongly depends on the time period and season we analyse and is more subtle than what is found in observations.
Hilla Afargan-Gerstman, Iuliia Polkova, Lukas Papritz, Paolo Ruggieri, Martin P. King, Panos J. Athanasiadis, Johanna Baehr, and Daniela I. V. Domeisen
Weather Clim. Dynam., 1, 541–553, https://doi.org/10.5194/wcd-1-541-2020, https://doi.org/10.5194/wcd-1-541-2020, 2020
Short summary
Short summary
We investigate the stratospheric influence on marine cold air outbreaks (MCAOs) in the North Atlantic using ERA-Interim reanalysis data. MCAOs are associated with severe Arctic weather, such as polar lows and strong surface winds. Sudden stratospheric events are found to be associated with more frequent MCAOs in the Barents and the Norwegian seas, affected by the anomalous circulation over Greenland and Scandinavia. Identification of MCAO precursors is crucial for improved long-range prediction.
Patrick Pieper, André Düsterhus, and Johanna Baehr
Hydrol. Earth Syst. Sci., 24, 4541–4565, https://doi.org/10.5194/hess-24-4541-2020, https://doi.org/10.5194/hess-24-4541-2020, 2020
Short summary
Short summary
The Standardized Precipitation Index (SPI) is a widely accepted drought index. SPI normalizes the precipitation distribution via a probability density function (PDF). However, which PDF properly normalizes SPI is still disputed. We suggest using a previously mostly overlooked PDF, namely the exponentiated Weibull distribution. The proposed PDF ensures the normality of the index. We demonstrate this – for the first time – for all common accumulation periods in both observations and simulations.
Nils Weitzel, Andreas Hense, and Christian Ohlwein
Clim. Past, 15, 1275–1301, https://doi.org/10.5194/cp-15-1275-2019, https://doi.org/10.5194/cp-15-1275-2019, 2019
Short summary
Short summary
A new method for probabilistic spatial reconstructions of past climate states is presented, which combines pollen data with a multi-model ensemble of climate simulations in a Bayesian framework. The approach is applied to reconstruct summer and winter temperature in Europe during the mid-Holocene. Our reconstructions account for multiple sources of uncertainty and are well suited for quantitative statistical analyses of the climate under different forcing conditions.
Rita Glowienka-Hense, Andreas Hense, Thomas Spangehl, and Marc Schröder
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2018-141, https://doi.org/10.5194/gmd-2018-141, 2018
Revised manuscript not accepted
Short summary
Short summary
Ensemble forecast verification treats the issues of forecast errors and uncertainty estimated from ensemble spread. We suggest measures based on relative entropy. For continuous variables correlation and the mean ratio of the ensemble spread to climate variance (analysis of variance (anova)) are related to these entropies. For categorical data corresponding scores are deduced that allow the comparison with continuous data.
Matthias Fischer, Daniela I. V. Domeisen, Wolfgang A. Müller, and Johanna Baehr
Earth Syst. Dynam., 8, 129–146, https://doi.org/10.5194/esd-8-129-2017, https://doi.org/10.5194/esd-8-129-2017, 2017
Short summary
Short summary
In a climate projection experiment with the Max Planck Institute Earth System Model (MPI-ESM), we find that a decline in the Atlantic Ocean meridional heat transport (OHT) is accompanied by a change in the seasonal cycle of the total OHT and its components. We found a northward shift of 5° and latitude-dependent shifts between 1 and 6 months in the seasonal cycle that are mainly associated with changes in the meridional velocity field rather than the temperature field.
Olga Lyapina, Martin G. Schultz, and Andreas Hense
Atmos. Chem. Phys., 16, 6863–6881, https://doi.org/10.5194/acp-16-6863-2016, https://doi.org/10.5194/acp-16-6863-2016, 2016
Short summary
Short summary
This study applies numerical clustering for the classification of about 1500 ozone data sets in Europe. We show the usefulness of cluster analysis (CA) for the quantitative evaluation of a global model: pre-selection of stations and validation of a global model in a phase-space produce clearer and more interpretable results. CA can be easily updated for new stations, different length of data, and other type of input properties, as well as other type of data (for example, meteorological).
J. D. Keller and A. Hense
Nonlin. Processes Geophys. Discuss., https://doi.org/10.5194/npgd-1-1509-2014, https://doi.org/10.5194/npgd-1-1509-2014, 2014
Preprint withdrawn
J. Baehr and R. Piontek
Geosci. Model Dev., 7, 453–461, https://doi.org/10.5194/gmd-7-453-2014, https://doi.org/10.5194/gmd-7-453-2014, 2014
Related subject area
Atmospheric science
Forecasting 24 h averaged PM2.5 concentration in the Aburrá Valley using tree-based machine learning models, global forecasts, and satellite information
A generalized Spatio-Temporal Threshold Clustering method for identification of extreme event patterns
Nonlinear time series models for the North Atlantic Oscillation
Postprocessing ensemble forecasts of vertical temperature profiles
Using wavelets to verify the scale structure of precipitation forecasts
Automated detection of weather fronts using a deep learning neural network
Low-visibility forecasts for different flight planning horizons using tree-based boosting models
Skewed logistic distribution for statistical temperature post-processing in mountainous areas
Hourly probabilistic snow forecasts over complex terrain: a hybrid ensemble postprocessing approach
A statistical framework for conditional extreme event attribution
Mixture model-based atmospheric air mass classification: a probabilistic view of thermodynamic profiles
A path towards uncertainty assignment in an operational cloud-phase algorithm from ARM vertically pointing active sensors
Characterization of extreme precipitation within atmospheric river events over California
Jhayron S. Pérez-Carrasquilla, Paola A. Montoya, Juan Manuel Sánchez, K. Santiago Hernández, and Mauricio Ramírez
Adv. Stat. Clim. Meteorol. Oceanogr., 9, 121–135, https://doi.org/10.5194/ascmo-9-121-2023, https://doi.org/10.5194/ascmo-9-121-2023, 2023
Short summary
Short summary
This study uses tree-based machine learning (ML) to forecast PM2.5 in a complex terrain region. The models show the potential to predict pollution events with several hours of anticipation, and they integrate multiple sources of information, including in situ stations, satellite data, and deterministic model outputs. The importance analysis helps understand the processes affecting air quality in the region and highlights the relevance of external sources of pollution in PM2.5 predictability.
Vitaly Kholodovsky and Xin-Zhong Liang
Adv. Stat. Clim. Meteorol. Oceanogr., 7, 35–52, https://doi.org/10.5194/ascmo-7-35-2021, https://doi.org/10.5194/ascmo-7-35-2021, 2021
Short summary
Short summary
Consistent definition and verification of extreme events are still lacking. We propose a new generalized spatio-temporal threshold clustering method to identify extreme event episodes. We observe changes in the distribution of extreme precipitation frequency from large-scale well-connected spatial patterns to smaller-scale, more isolated rainfall clusters, possibly leading to more localized droughts and heat waves.
Thomas Önskog, Christian L. E. Franzke, and Abdel Hannachi
Adv. Stat. Clim. Meteorol. Oceanogr., 6, 141–157, https://doi.org/10.5194/ascmo-6-141-2020, https://doi.org/10.5194/ascmo-6-141-2020, 2020
Short summary
Short summary
The North Atlantic Oscillation (NAO) has a significant impact on seasonal climate and surface weather conditions throughout Europe, North America and the North Atlantic. In this paper, we study a number of linear and nonlinear models for a station-based time series of the daily winter NAO. We find that a class of nonlinear models, including both short and long lags, excellently reproduce the characteristic statistical properties of the NAO. These models can hence be used to simulate the NAO.
David Schoenach, Thorsten Simon, and Georg Johann Mayr
Adv. Stat. Clim. Meteorol. Oceanogr., 6, 45–60, https://doi.org/10.5194/ascmo-6-45-2020, https://doi.org/10.5194/ascmo-6-45-2020, 2020
Short summary
Short summary
State-of-the-art statistical methods are applied to postprocess an ensemble of numerical forecasts for vertical profiles of air temperature. These profiles are important tools in weather forecasting as they show the stratification and the static stability of the atmosphere. Flexible regression models combined with the multi-dimensionality of the data lead to better calibration and representation of uncertainty of the vertical profiles.
Sebastian Buschow and Petra Friederichs
Adv. Stat. Clim. Meteorol. Oceanogr., 6, 13–30, https://doi.org/10.5194/ascmo-6-13-2020, https://doi.org/10.5194/ascmo-6-13-2020, 2020
Short summary
Short summary
Two-dimensional wavelet transformations can be used to analyse the local structure of predicted and observed precipitation fields and allow for a forecast verification which focuses on the spatial correlation structure alone. This paper applies the novel concept to real numerical weather predictions and radar observations. Systematic similarities and differences between nature and simulation can be detected, localized in space and attributed to particular weather situations.
James C. Biard and Kenneth E. Kunkel
Adv. Stat. Clim. Meteorol. Oceanogr., 5, 147–160, https://doi.org/10.5194/ascmo-5-147-2019, https://doi.org/10.5194/ascmo-5-147-2019, 2019
Short summary
Short summary
A deep learning convolutional neural network (DL-FRONT) was around 90 % successful in determining the locations of weather fronts over North America when compared against front locations determined manually by forecasters. DL-FRONT detects fronts using maps of air pressure, temperature, humidity, and wind from historical observations or climate models. DL-FRONT makes it possible to do science that was previously impractical because manual front identification would take too much time.
Sebastian J. Dietz, Philipp Kneringer, Georg J. Mayr, and Achim Zeileis
Adv. Stat. Clim. Meteorol. Oceanogr., 5, 101–114, https://doi.org/10.5194/ascmo-5-101-2019, https://doi.org/10.5194/ascmo-5-101-2019, 2019
Short summary
Short summary
Low-visibility conditions reduce the flight capacity of airports and can lead to delays and supplemental costs for airlines and airports. In this study, the forecasting skill and most important model predictors of airport-relevant low visibility are investigated for multiple flight planning horizons with different statistical models.
Manuel Gebetsberger, Reto Stauffer, Georg J. Mayr, and Achim Zeileis
Adv. Stat. Clim. Meteorol. Oceanogr., 5, 87–100, https://doi.org/10.5194/ascmo-5-87-2019, https://doi.org/10.5194/ascmo-5-87-2019, 2019
Short summary
Short summary
This article presents a method for improving probabilistic air temperature forecasts, particularly at Alpine sites. Using a nonsymmetric forecast distribution, the probabilistic forecast quality can be improved with respect to the common symmetric Gaussian distribution used. Furthermore, a long-term training approach of 3 years is presented to ensure the stability of the regression coefficients. The research was based on a PhD project on building an automated forecast system for northern Italy.
Reto Stauffer, Georg J. Mayr, Jakob W. Messner, and Achim Zeileis
Adv. Stat. Clim. Meteorol. Oceanogr., 4, 65–86, https://doi.org/10.5194/ascmo-4-65-2018, https://doi.org/10.5194/ascmo-4-65-2018, 2018
Short summary
Short summary
Snowfall forecasts are important for a range of economic sectors as well as for the safety of people and infrastructure, especially in mountainous regions. This work presents a novel statistical approach to provide accurate forecasts for fresh snow amounts and the probability of snowfall combining data from various sources. The results demonstrate that the new approach is able to provide reliable high-resolution hourly snowfall forecasts for the eastern European Alps up to 3 days ahead.
Pascal Yiou, Aglaé Jézéquel, Philippe Naveau, Frederike E. L. Otto, Robert Vautard, and Mathieu Vrac
Adv. Stat. Clim. Meteorol. Oceanogr., 3, 17–31, https://doi.org/10.5194/ascmo-3-17-2017, https://doi.org/10.5194/ascmo-3-17-2017, 2017
Short summary
Short summary
The attribution of classes of extreme events, such as heavy precipitation or heatwaves, relies on the estimate of small probabilities (with and without climate change). Such events are connected to the large-scale atmospheric circulation. This paper links such probabilities with properties of the atmospheric circulation by using a Bayesian decomposition. We test this decomposition on a case of extreme precipitation in the UK, in January 2014.
Jérôme Pernin, Mathieu Vrac, Cyril Crevoisier, and Alain Chédin
Adv. Stat. Clim. Meteorol. Oceanogr., 2, 115–136, https://doi.org/10.5194/ascmo-2-115-2016, https://doi.org/10.5194/ascmo-2-115-2016, 2016
Short summary
Short summary
Here, we propose a classification methodology of various space-time atmospheric datasets into discrete air mass groups homogeneous in temperature and humidity through a probabilistic point of view: both the classification process and the data are probabilistic. Unlike conventional classification algorithms, this methodology provides the probability of belonging to each class as well as the corresponding uncertainty, which can be used in various applications.
Laura D. Riihimaki, Jennifer M. Comstock, Kevin K. Anderson, Aimee Holmes, and Edward Luke
Adv. Stat. Clim. Meteorol. Oceanogr., 2, 49–62, https://doi.org/10.5194/ascmo-2-49-2016, https://doi.org/10.5194/ascmo-2-49-2016, 2016
Short summary
Short summary
Between atmospheric temperatures of 0 and −38 °C, clouds contain ice crystals, super-cooled liquid droplets, or a mixture of both, impacting how they influence the atmospheric energy budget and challenging our ability to simulate climate change. Better cloud-phase measurements are needed to improve simulations. We demonstrate how a Bayesian method to identify cloud phase can improve on currently used methods by including information from multiple measurements and probability estimates.
S. Jeon, Prabhat, S. Byna, J. Gu, W. D. Collins, and M. F. Wehner
Adv. Stat. Clim. Meteorol. Oceanogr., 1, 45–57, https://doi.org/10.5194/ascmo-1-45-2015, https://doi.org/10.5194/ascmo-1-45-2015, 2015
Short summary
Short summary
This paper investigates the influence of atmospheric rivers on spatial coherence of extreme precipitation under a changing climate. We use our TECA software developed for detecting atmospheric river events and apply statistical techniques based on extreme value theory to characterize the spatial dependence structure between precipitation extremes within the events. The results show that extreme rainfall caused by atmospheric river events is less spatially correlated under the warming scenario.
Cited articles
Balmaseda, M. A., Trenberth, K. E., and Källén, E.: Distinctive climate
signals in reanalysis of global ocean heat content, Geophys. Res.
Lett., 40, 1754–1759, https://doi.org/10.1002/grl.50382,
2013. a
Bougeault, P., Toth, Z., Bishop, C., Brown, B., Burridge, D. C., De Hui, E. B., Fuentes, M., Hamill, T. M., Mylne, K., Nicolau, J., Paccagnella, T., Park, Y.-Y., Parsons, D., Raoult, B., Schuster, D., Dias, P. S., Swinbank, R., Takeuchi, Y., Tennant, W., Wilson, L., Worley, S.: The THORPEX Interactive Grand Global Ensemble, B. Am. Meteorol. Soc., 91, 1059–1072, https://doi.org/10.1175/2010BAMS2853.1, 2010. a
Brune, S. and Baehr, J.: Preserving the coupled atmosphere–ocean feedback in
initializations of decadal climate predictions, WIREs Clim. Change, 2020, 11:e637,
https://doi.org/10.1002/wcc.637, 2020. a, b
Brune, S., Nerger, L., and Baehr, J.: Assimilation of oceanic observations in a
global coupled Earth system model with the SEIK filter, Ocean Model., 96,
254–264, https://doi.org/10.1016/j.ocemod.2015.09.011, 2015. a
Dee, D. P., Uppala, S. M., Simmons, A. J., Berrisford, P., Poli, P., Kobayashi,
S., Andrae, U., Balmaseda, M. A., Balsamo, G., and Bau: The ERA-Interim
reanalysis: configuration and performance of the data assimilation system,
Q. J. Roy. Meteor. Soc., 137, 553–597, https://doi.org/10.1002/qj.828,
2011. a
DelSole, T. and Tippett, M. K.: Comparing Forecast Skill, Mon. Weather
Rev., 142, 4658–4678, https://doi.org/10.1175/MWR-D-14-00045.1,
2014. a
Gilleland, E., Hering, A. S., and Fowler, T. L.and Brown, B. G.: Testing the
Tests: What are the impacts of incorrect assumptions when applying confidence
intervals or hypothesis tests to compare competing forecasts?, Mon. Weather
Rev., 146, 1685–1703, https://doi.org/10.1175/MWR-D-17-0295.1, 2018. a
Giorgetta, M. A., Jungclaus, J., Reick, C. H., Legutke, S., Bader, J.,
Böttinger, M., Band Brovkin, V., and Crueger, Stevens, B.: Climate and
carbon cycle changes from 1850 to 2100 in MPI-ESM simulations for the Coupled
Model Intercomparison Project phase 5, J. Adv. Model. Earth Sy., 5,
572–597, 2013. a, b
Good, S. A., Martin, M. J., and Rayner, N. A.: EN4: quality controlled ocean
temperature and salinity profiles and monthly objective analyses with
uncertainty estimates, J. Geophys. Res.-Oceans, 118,
6704–6716, https://doi.org/10.1002/2013JC009067, 2013. a
Hering, A. S. and Genton, M. G.: Comparing spatial predictions, Technometrics,
53, 414–425, https://doi.org/10.1198/TECH.2011.10136, 2011. a
Kadow, C., Illing, S., Kunst, O., Rust, H. W., Pohlmann, H., Müller, W. A.,
and Cubasch, U.: Evaluation of Forecasts by Accuracy and Spread in the
MiKlip Decadal Climate Prediction System, Meteorol. Z., 25, 631–643,
https://doi.org/10.1127/metz/2015/0639, 2016. a
Kleeman, R.: Measuring Dynamical Prediction Utility Using Relative Entropy,
JAS, 59, 2057–2072, https://doi.org/10.1175/1520-0469(2002)059<2057:MDPUUR>2.0.CO;2,
2002. a, b
Krishnamurti, T., Kishtawal, C. M.and LaRow, T. E., Bachiochi, D. R., Zhang,
Z., Williford, C. E., Gadgil, S., and Surendran, S.: Improved Weather and
Seasonal Climate Forecasts from Multimodel Superensemble, Science, 285,
1548–1550, https://doi.org/10.1126/science.285.5433.1548, 1999. a
Marotzke, J., Müller, W. A., Vamborg, F. S. E., Becker, P., Cubasch, U.,
Feldmann, H., Kaspar, F., Kottmeier, C., Marini, C., Polkova, I., Prömmel,
K., Rust, H. W., Stammer, D., Ulbrich, U., Kadow, C., Köhl, A., Kröger, J.,
Kruschke, T., Pinto, J. G., Pohlmann, H., Reyers, M., Schröder, M., Sienz,
F., Timmreck, C., and Ziese, M.: MiKlip: A National Research Project on
Decadal Climate Prediction, B. Am. Meteorol. Soc.,
97, 2379–2394, https://doi.org/10.1175/BAMS-D-15-00184.1,
2016. a, b
Massey, J.: Causality, Feedback and directed information, Proc. 1990 Intl.
Symp. on Info. Th. and its Applications, Waikiki, Hawaii, 27–30 November 1990,
1990. a
Morice, C. P., Kennedy, J. J., Rayner, N. A., and Jones, P. D.: Quantifying
uncertainties in global and regional temperature change using an ensemble of
observational estimates: The HadCRUT4 data set, J. Geophys.
Res.-Atmos., 117, D08101, https://doi.org/10.1029/2011JD017187,
2012.
a
Owens, R. G. and Hewson, T. D.: ECMWF Forecast User Guide. Reading: ECMWF,
https://doi.org/10.21957/m1cs7h, 2018. a
Polkova, I., Brune, S., Kadow, C., Romanova, V., Gollan, G., Baehr, J.,
Glowienka-Hense, R., Greatbatch, R. J., Hense, A., Illing, S., Köhl, A.,
Kröger, J., Müller, W. A., Pankatz, K., and Stammer, D.: Initialization
and ensemble generation for decadal climate predictions: A comparison of
different methods, J. Adv. Model. Earth Sy., 11, 149–172,
https://doi.org/10.1029/2018MS001439, 2019. a, b, c, d, e, f
Quinn, C. J., Coleman, T. P., Kiyavash, N., and Hatsopoulos, N. G.: Estimating
the directed information to infer causal relationships in ensemble neural
spike train recordings, J. Comput. Neurosci., 30, 17–44,
https://doi.org/10.1007/s10827-010-0247-2, 2011. a, b
Runge, J., Petoukhov, V., and Kurths, J.: Quantifying the strength and delay
of climatic interactions: The ambiguities of cross correlation and a novel
measure based on graphical models, J. Climate, 27, 720–739,
https://doi.org/10.1175/JCLI-D-13-00159.1, 2014. a
Siegert, S., Bellprat, O., Ménégoz, M., Stephenson, D. B., and Doblas-Reyes,
F. J.: Detecting Improvements in Forecast Correlation Skill: Statistical
Testing and Power Analysis, Mon. Weather Rev., 145, 437–450,
https://doi.org/10.1175/MWR-D-16-0037.1,
2017. a
Swinbank, R., Kyouda, M., Buchanan, P., Froude, L., Hamill, T. M., Hewson,
T. D., Keller, J. H., Matsueda, M., Methven, J., Pappenberger, F., Scheuerer,
M., Titley, H. A., Wilson, L., and Yamaguchi, M.: The TIGGE project and its
achievements, B. Am. Meteorol. Soc., 97, 49–67, https://doi.org/10.1175/BAMS-D-13-00191.1, 2016. a, b, c
Taylor, K. E., Stouffer, R. J., and Meehl, G. A.: An overview of CMIP5 and the
experiment design, B. Am. Meteorol. Soc., 93,
485–498, 2012. a
Uppala, S. M., Allberg, P., Simmons, A., Andrae, U., Dacostabechtold, V.,
Fiorino, M., Gibson, J., Haseler, J., Hernandez, A., Kelly, G., Li, X.,
Onogi, K., and Saarinen, S.: The ERA40 re-analysis, Q. J. Roy. Meteor. Soc.,
131, 2961–3012, https://doi.org/10.1256/qj.04.176, 2005. a
Wibral, M., Priesemann, V., Kay, J. W., Lizier, J. T., and Phillips, W. A.:
Partial information decomposition as a unified approach to the specification
of neural goal functions, Brain Cognition, 112, 25–38,
https://doi.org/10.1016/j.bandc.2015.09.004, 2015. a, b, c
Yule: On the Theory of Correlation for any Number of variables, treated by a
New System of Notation, 239 Report by W. Burnside, 182–193, 1907. a
Short summary
A new method for weather and climate forecast model evaluation with respect to observations is proposed. Individually added values are estimated for each model, together with shared information both models provide equally on the observations. Finally, shared model information, which is not present in the observations, is calculated. The method is applied to two examples from climate and weather forecasting, showing new perspectives for model evaluation.
A new method for weather and climate forecast model evaluation with respect to observations is...