Articles | Volume 7, issue 2
https://doi.org/10.5194/ascmo-7-53-2021
© Author(s) 2021. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/ascmo-7-53-2021
© Author(s) 2021. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
23 Sep 2021
| 23 Sep 2021
Forecast score distributions with imperfect observations
Julie Bessac
CORRESPONDING AUTHOR
Mathematics and Computer Science Division, Argonne National Laboratory, Lemont, IL 60439, USA
Philippe Naveau
Laboratoire de Sciences du Climat et de l'Environnement, IPSL-CNRS, Gif-sur-Yvette, 91191, France
Related authors
Qiuyi Wu, Julie Bessac, Whitney Huang, Jiali Wang, and Rao Kotamarthi
Adv. Stat. Clim. Meteorol. Oceanogr., 8, 205–224, https://doi.org/10.5194/ascmo-8-205-2022, https://doi.org/10.5194/ascmo-8-205-2022, 2022
Short summary
Short summary
We study wind conditions and their potential future changes across the U.S. via a statistical conditional framework. We conclude that changes between historical and future wind directions are small, but wind speeds are generally weakened in the projected period, with some locations being intensified. Moreover, winter wind speeds are projected to decrease in the northwest, Colorado, and the northern Great Plains (GP), while summer wind speeds over the southern GP slightly increase in the future.
Julie Bessac, Pierre Ailliot, Julien Cattiaux, and Valerie Monbet
Adv. Stat. Clim. Meteorol. Oceanogr., 2, 1–16, https://doi.org/10.5194/ascmo-2-1-2016, https://doi.org/10.5194/ascmo-2-1-2016, 2016
Short summary
Short summary
Several multi-site stochastic generators of zonal and meridional components of wind are proposed in this paper. Various questions are explored, such as the modeling of the regime in a multi-site context, the extraction of relevant clusterings from extra variables or from the local wind data, and the link between weather types extracted from wind data and large-scale weather regimes. We also discuss the relative advantages of hidden and observed regime-switching models.
Romain Pic, Clément Dombry, Philippe Naveau, and Maxime Taillardat
Adv. Stat. Clim. Meteorol. Oceanogr., 11, 23–58, https://doi.org/10.5194/ascmo-11-23-2025, https://doi.org/10.5194/ascmo-11-23-2025, 2025
Short summary
Short summary
Correctly forecasting weather is crucial for decision-making in various fields. Standard multivariate verification tools have limitations, and a single tool cannot fully characterize predictive performance. We formalize a framework based on aggregation and transformation to build interpretable verification tools. These tools target specific features of forecasts, improving predictive performance characterization and bridging the gap between theoretical and physics-based tools.
Cedric Gacial Ngoungue Langue, Helene Brogniez, and Philippe Naveau
EGUsphere, https://doi.org/10.5194/egusphere-2024-3481, https://doi.org/10.5194/egusphere-2024-3481, 2025
This preprint is open for discussion and under review for Atmospheric Measurement Techniques (AMT).
Short summary
Short summary
This work evaluates the representation of total column water vapor and total cloud cover in General Circulation Models, ERA5 reanalysis and satellite data records from the European Space Agency Climate Change Initiative. A new technique, called "multiresolution analysis," is applied to this evaluation, which enables an analysis of model behavior across different temporal frequencies, from daily to decadal scales, including subseasonal and seasonal variations.
Pauline Rivoire, Olivia Martius, Philippe Naveau, and Alexandre Tuel
Nat. Hazards Earth Syst. Sci., 23, 2857–2871, https://doi.org/10.5194/nhess-23-2857-2023, https://doi.org/10.5194/nhess-23-2857-2023, 2023
Short summary
Short summary
Heavy precipitation can lead to floods and landslides, resulting in widespread damage and significant casualties. Some of its impacts can be mitigated if reliable forecasts and warnings are available. In this article, we assess the capacity of the precipitation forecast provided by ECMWF to predict heavy precipitation events on a subseasonal-to-seasonal (S2S) timescale over Europe. We find that the forecast skill of such events is generally higher in winter than in summer.
Manuela Irene Brunner and Philippe Naveau
Hydrol. Earth Syst. Sci., 27, 673–687, https://doi.org/10.5194/hess-27-673-2023, https://doi.org/10.5194/hess-27-673-2023, 2023
Short summary
Short summary
Reservoir regulation affects various streamflow characteristics. Still, information on when water is stored in and released from reservoirs is hardly available. We develop a statistical model to reconstruct reservoir operation signals from observed streamflow time series. By applying this approach to 74 catchments in the Alps, we find that reservoir management varies by catchment elevation and that seasonal redistribution from summer to winter is strongest in high-elevation catchments.
Qiuyi Wu, Julie Bessac, Whitney Huang, Jiali Wang, and Rao Kotamarthi
Adv. Stat. Clim. Meteorol. Oceanogr., 8, 205–224, https://doi.org/10.5194/ascmo-8-205-2022, https://doi.org/10.5194/ascmo-8-205-2022, 2022
Short summary
Short summary
We study wind conditions and their potential future changes across the U.S. via a statistical conditional framework. We conclude that changes between historical and future wind directions are small, but wind speeds are generally weakened in the projected period, with some locations being intensified. Moreover, winter wind speeds are projected to decrease in the northwest, Colorado, and the northern Great Plains (GP), while summer wind speeds over the southern GP slightly increase in the future.
Antoine Grisart, Mathieu Casado, Vasileios Gkinis, Bo Vinther, Philippe Naveau, Mathieu Vrac, Thomas Laepple, Bénédicte Minster, Frederic Prié, Barbara Stenni, Elise Fourré, Hans Christian Steen-Larsen, Jean Jouzel, Martin Werner, Katy Pol, Valérie Masson-Delmotte, Maria Hoerhold, Trevor Popp, and Amaelle Landais
Clim. Past, 18, 2289–2301, https://doi.org/10.5194/cp-18-2289-2022, https://doi.org/10.5194/cp-18-2289-2022, 2022
Short summary
Short summary
This paper presents a compilation of high-resolution (11 cm) water isotopic records, including published and new measurements, for the last 800 000 years from the EPICA Dome C ice core, Antarctica. Using this new combined water isotopes (δ18O and δD) dataset, we study the variability and possible influence of diffusion at the multi-decadal to multi-centennial scale. We observe a stronger variability at the onset of the interglacial interval corresponding to a warm period.
Jakob Zscheischler, Philippe Naveau, Olivia Martius, Sebastian Engelke, and Christoph C. Raible
Earth Syst. Dynam., 12, 1–16, https://doi.org/10.5194/esd-12-1-2021, https://doi.org/10.5194/esd-12-1-2021, 2021
Short summary
Short summary
Compound extremes such as heavy precipitation and extreme winds can lead to large damage. To date it is unclear how well climate models represent such compound extremes. Here we present a new measure to assess differences in the dependence structure of bivariate extremes. This measure is applied to assess differences in the dependence of compound precipitation and wind extremes between three model simulations and one reanalysis dataset in a domain in central Europe.
Yoann Robin, Mathieu Vrac, Philippe Naveau, and Pascal Yiou
Hydrol. Earth Syst. Sci., 23, 773–786, https://doi.org/10.5194/hess-23-773-2019, https://doi.org/10.5194/hess-23-773-2019, 2019
Short summary
Short summary
Bias correction methods are used to calibrate climate model outputs with respect to observations. In this article, a non-stationary, multivariate and stochastic bias correction method is developed based on optimal transport, accounting for inter-site and inter-variable correlations. Optimal transport allows us to construct a joint distribution that minimizes energy spent in bias correction. Our methodology is tested on precipitation and temperatures over 12 locations in southern France.
Yoann Robin, Pascal Yiou, and Philippe Naveau
Nonlin. Processes Geophys., 24, 393–405, https://doi.org/10.5194/npg-24-393-2017, https://doi.org/10.5194/npg-24-393-2017, 2017
Short summary
Short summary
If climate is viewed as a chaotic dynamical system, its trajectories yield on an object called an attractor. Being perturbed by an external forcing, this attractor could be modified. With Wasserstein distance, we estimate on a derived Lorenz model the impact of a forcing similar to climate change. Our approach appears to work with small data sizes. We have obtained a methodology quantifying the deformation of well-known attractors, coherent with the size of data available.
Pascal Yiou, Aglaé Jézéquel, Philippe Naveau, Frederike E. L. Otto, Robert Vautard, and Mathieu Vrac
Adv. Stat. Clim. Meteorol. Oceanogr., 3, 17–31, https://doi.org/10.5194/ascmo-3-17-2017, https://doi.org/10.5194/ascmo-3-17-2017, 2017
Short summary
Short summary
The attribution of classes of extreme events, such as heavy precipitation or heatwaves, relies on the estimate of small probabilities (with and without climate change). Such events are connected to the large-scale atmospheric circulation. This paper links such probabilities with properties of the atmospheric circulation by using a Bayesian decomposition. We test this decomposition on a case of extreme precipitation in the UK, in January 2014.
Allison H. Baker, Dorit M. Hammerling, Sheri A. Mickelson, Haiying Xu, Martin B. Stolpe, Phillipe Naveau, Ben Sanderson, Imme Ebert-Uphoff, Savini Samarasinghe, Francesco De Simone, Francesco Carbone, Christian N. Gencarelli, John M. Dennis, Jennifer E. Kay, and Peter Lindstrom
Geosci. Model Dev., 9, 4381–4403, https://doi.org/10.5194/gmd-9-4381-2016, https://doi.org/10.5194/gmd-9-4381-2016, 2016
Short summary
Short summary
We apply lossy data compression to output from the Community Earth System Model Large Ensemble Community Project. We challenge climate scientists to examine features of the data relevant to their interests and identify which of the ensemble members have been compressed, and we perform direct comparisons on features critical to climate science. We find that applying lossy data compression to climate model data effectively reduces data volumes with minimal effect on scientific results.
Julie Bessac, Pierre Ailliot, Julien Cattiaux, and Valerie Monbet
Adv. Stat. Clim. Meteorol. Oceanogr., 2, 1–16, https://doi.org/10.5194/ascmo-2-1-2016, https://doi.org/10.5194/ascmo-2-1-2016, 2016
Short summary
Short summary
Several multi-site stochastic generators of zonal and meridional components of wind are proposed in this paper. Various questions are explored, such as the modeling of the regime in a multi-site context, the extraction of relevant clusterings from extra variables or from the local wind data, and the link between weather types extracted from wind data and large-scale weather regimes. We also discuss the relative advantages of hidden and observed regime-switching models.
Related subject area
Statistics
Proper scoring rules for multivariate probabilistic forecasts based on aggregation and transformation
Reducing reliability bias in assessments of extreme weather risk using calibrating priors
A non-stationary climate-informed weather generator for assessing future flood risks
A robust approach to Gaussian process implementation
Spatiotemporal functional permutation tests for comparing observed climate behavior to climate model projections
Parametric model for post-processing visibility ensemble forecasts
Spatiotemporal methods for estimating subsurface ocean thermal response to tropical cyclones
Applying different methods to model dry and wet spells at daily scale in a large range of rainfall regimes across Europe
Comparison of climate time series – Part 5: Multivariate annual cycles
Regridding uncertainty for statistical downscaling of solar radiation
Quantifying the statistical dependence of mid-latitude heatwave intensity and likelihood on prevalent physical drivers and climate change
Statistical modeling of the space–time relation between wind and significant wave height
Modeling general circulation model bias via a combination of localized regression and quantile mapping methods
Evaluation of simulated responses to climate forcings: a flexible statistical framework using confirmatory factor analysis and structural equation modelling – Part 1: Theory
Evaluation of simulated responses to climate forcings: a flexible statistical framework using confirmatory factor analysis and structural equation modelling – Part 2: Numerical experiment
A conditional approach for joint estimation of wind speed and direction under future climates
Comparing climate time series – Part 2: A multivariate test
Novel measures for summarizing high-resolution forecast performance
Copula approach for simulated damages caused by landfalling US hurricanes
Nonstationary extreme value analysis for event attribution combining climate models and observations
Comparing climate time series – Part 1: Univariate test
A statistical approach to fast nowcasting of lightning potential fields
Spatial trend analysis of gridded temperature data at varying spatial scales
An improved projection of climate observations for detection and attribution
Bivariate Gaussian models for wind vectors in a distributional regression framework
Fitting a stochastic fire spread model to data
Influence of initial ocean conditions on temperature and precipitation in a coupled climate model's solution
NWP-based lightning prediction using flexible count data regression
An integration and assessment of multiple covariates of nonstationary storm surge statistical behavior by Bayesian model averaging
Probabilistic evaluation of competing climate models
Assessing NARCCAP climate model effects using spatial confidence regions
Generalised block bootstrap and its use in meteorology
Estimating trends in the global mean temperature record
Reconstruction of spatio-temporal temperature from sparse historical records using robust probabilistic principal component regression
Analysis of variability of tropical Pacific sea surface temperatures
Evaluating NARCCAP model performance for frequencies of severe-storm environments
Estimating changes in temperature extremes from millennial-scale climate simulations using generalized extreme value (GEV) distributions
A comparison of two methods for detecting abrupt changes in the variance of climatic time series
Calibrating regionally downscaled precipitation over Norway through quantile-based approaches
Comparison of hidden and observed regime-switching autoregressive models for (u, v)-components of wind fields in the northeastern Atlantic
Autoregressive spatially varying coefficients model for predicting daily PM2.5 using VIIRS satellite AOT
Bivariate spatial analysis of temperature and precipitation from general circulation models and observation proxies
Joint inference of misaligned irregular time series with application to Greenland ice core data
Simulation of future climate under changing temporal covariance structures
Romain Pic, Clément Dombry, Philippe Naveau, and Maxime Taillardat
Adv. Stat. Clim. Meteorol. Oceanogr., 11, 23–58, https://doi.org/10.5194/ascmo-11-23-2025, https://doi.org/10.5194/ascmo-11-23-2025, 2025
Short summary
Short summary
Correctly forecasting weather is crucial for decision-making in various fields. Standard multivariate verification tools have limitations, and a single tool cannot fully characterize predictive performance. We formalize a framework based on aggregation and transformation to build interpretable verification tools. These tools target specific features of forecasts, improving predictive performance characterization and bridging the gap between theoretical and physics-based tools.
Stephen Jewson, Trevor Sweeting, and Lynne Jewson
Adv. Stat. Clim. Meteorol. Oceanogr., 11, 1–22, https://doi.org/10.5194/ascmo-11-1-2025, https://doi.org/10.5194/ascmo-11-1-2025, 2025
Short summary
Short summary
We investigate how to make statistical predictions of extreme weather such that events predicted to occur with a probability of 1 % will occur 1 % of the time. We apply the methods we describe to a standard extreme weather attribution example from the recent climate literature. We find that the methods we describe imply that extremes are roughly twice as likely as when estimated using maximum likelihood. We have developed a software package to make it easy to apply these methods.
Viet Dung Nguyen, Sergiy Vorogushyn, Katrin Nissen, Lukas Brunner, and Bruno Merz
Adv. Stat. Clim. Meteorol. Oceanogr., 10, 195–216, https://doi.org/10.5194/ascmo-10-195-2024, https://doi.org/10.5194/ascmo-10-195-2024, 2024
Short summary
Short summary
We present a novel stochastic weather generator conditioned on circulation patterns and regional temperature, accounting for dynamic and thermodynamic atmospheric changes. We extensively evaluate the model for the central European region. It statistically downscales precipitation for future periods, generating long, spatially and temporally consistent series. Results suggest an increase in extreme precipitation over the region, offering key benefits for hydrological impact studies.
Juliette Mukangango, Amanda Muyskens, and Benjamin W. Priest
Adv. Stat. Clim. Meteorol. Oceanogr., 10, 143–158, https://doi.org/10.5194/ascmo-10-143-2024, https://doi.org/10.5194/ascmo-10-143-2024, 2024
Short summary
Short summary
In this study, we investigated the performance of Gaussian process regression (GP) models in handling outlier-affected spatial datasets. Our findings emphasized that models with the proposed methods provided accurate predictions and reliable uncertainty quantification, showcasing resilience against outliers. Overall, our study contributes to advancing the understanding of GP regression in spatial contexts and offers practical solutions to enhance its applicability in outlier-rich environments.
Joshua P. French, Piotr S. Kokoszka, and Seth McGinnis
Adv. Stat. Clim. Meteorol. Oceanogr., 10, 123–141, https://doi.org/10.5194/ascmo-10-123-2024, https://doi.org/10.5194/ascmo-10-123-2024, 2024
Short summary
Short summary
Future climate behavior is typically modeled using computer-based simulations, which are generated for both historical and future time periods. The trustworthiness of these models can be assessed by determining whether the simulated historical climate matches what was observed. We provide a tool that allows researchers to identify major differences between observed climate and climate model predictions, which will hopefully lead to further model refinements.
Ágnes Baran and Sándor Baran
Adv. Stat. Clim. Meteorol. Oceanogr., 10, 105–122, https://doi.org/10.5194/ascmo-10-105-2024, https://doi.org/10.5194/ascmo-10-105-2024, 2024
Short summary
Short summary
The paper proposes a novel parametric model for statistical post-processing of visibility ensemble forecasts; investigates various approaches to parameter estimation; and, using two case studies, provides a detailed comparison with the existing state-of-the-art forecasts. The introduced approach consistently outperforms both the raw ensemble forecasts and the reference parametric post-processing method.
Addison J. Hu, Mikael Kuusela, Ann B. Lee, Donata Giglio, and Kimberly M. Wood
Adv. Stat. Clim. Meteorol. Oceanogr., 10, 69–93, https://doi.org/10.5194/ascmo-10-69-2024, https://doi.org/10.5194/ascmo-10-69-2024, 2024
Short summary
Short summary
We introduce a new statistical framework to estimate the change in subsurface ocean temperature following the passage of a tropical cyclone (TC). Our approach combines tools handling seasonal variations and spatial dependence in the data, culminating in a three-dimensional characterization of the interaction between TCs and the ocean. Our work allows us to obtain new scientific insights, and we expect it to be generally applicable to studying the impact of TCs on other ocean phenomena.
Giorgio Baiamonte, Carmelo Agnese, Carmelo Cammalleri, Elvira Di Nardo, Stefano Ferraris, and Tommaso Martini
Adv. Stat. Clim. Meteorol. Oceanogr., 10, 51–67, https://doi.org/10.5194/ascmo-10-51-2024, https://doi.org/10.5194/ascmo-10-51-2024, 2024
Short summary
Short summary
In hydrology, the probability distributions are used to determine the probability of occurrence of rainfall events. In this study, two different methods for modeling rainfall time characteristics have been applied: a direct method and an indirect method that make it possible to relax the assumptions of the renewal process. The analysis was extended to two additional time variables that may be of great interest for practical hydrological applications: wet chains and dry chains.
Timothy DelSole and Michael K. Tippett
Adv. Stat. Clim. Meteorol. Oceanogr., 10, 1–27, https://doi.org/10.5194/ascmo-10-1-2024, https://doi.org/10.5194/ascmo-10-1-2024, 2024
Short summary
Short summary
This paper introduces a method to assess whether two data sets come from the same source. Current methods do not adequately consider spatial and temporal correlations and their annual cycles in a comprehensive test. This method addresses that gap, thereby providing a new and rigorous tool for evaluating the realism of climate simulations and measuring changes in variability over time.
Maggie D. Bailey, Douglas Nychka, Manajit Sengupta, Aron Habte, Yu Xie, and Soutir Bandyopadhyay
Adv. Stat. Clim. Meteorol. Oceanogr., 9, 103–120, https://doi.org/10.5194/ascmo-9-103-2023, https://doi.org/10.5194/ascmo-9-103-2023, 2023
Short summary
Short summary
To ensure photovoltaic (PV) plants last, we need to understand how climate change affects solar radiation. Climate models help predict future radiation for PV plants, but there is often uncertainty. We explore this uncertainty and its impact on building PV plants. We highlight the importance of considering uncertainties for accurate planning and management. A California case study shows a practical application for the solar industry.
Joel Zeder and Erich M. Fischer
Adv. Stat. Clim. Meteorol. Oceanogr., 9, 83–102, https://doi.org/10.5194/ascmo-9-83-2023, https://doi.org/10.5194/ascmo-9-83-2023, 2023
Short summary
Short summary
The intensities of recent heatwave events, such as the record-breaking heatwave in early June 2021 in the Pacific Northwest area, are substantially altered by climate change. We further quantify the contribution of the local weather situation and the land surface conditions with a statistical model suited for extreme data. Based on this method, we can answer
what ifquestions, such as estimating the change in the 2021 heatwave temperature if it happened in a world without climate change.
Said Obakrim, Pierre Ailliot, Valérie Monbet, and Nicolas Raillard
Adv. Stat. Clim. Meteorol. Oceanogr., 9, 67–81, https://doi.org/10.5194/ascmo-9-67-2023, https://doi.org/10.5194/ascmo-9-67-2023, 2023
Short summary
Short summary
Ocean wave climate has a significant impact on human activities, and its understanding is of socioeconomic and environmental importance. In this study, we propose a statistical model that predicts wave heights in a location in the Bay of Biscay. The proposed method allows us to understand the spatiotemporal relationship between wind and waves and predicts well both wind seas and swells.
Benjamin James Washington, Lynne Seymour, and Thomas L. Mote
Adv. Stat. Clim. Meteorol. Oceanogr., 9, 1–28, https://doi.org/10.5194/ascmo-9-1-2023, https://doi.org/10.5194/ascmo-9-1-2023, 2023
Short summary
Short summary
We develop new methodology to statistically model known bias in general atmospheric circulation models. We focus on Puerto Rico specifically because of other important ongoing and long-term ecological and environmental research taking place there. Our methods work even in the presence of Puerto Rico's broken climate record. With our methods, we find that climate change will not only favor a warmer and wetter climate in Puerto Rico, but also increase the frequency of extreme rainfall events.
Katarina Lashgari, Gudrun Brattström, Anders Moberg, and Rolf Sundberg
Adv. Stat. Clim. Meteorol. Oceanogr., 8, 225–248, https://doi.org/10.5194/ascmo-8-225-2022, https://doi.org/10.5194/ascmo-8-225-2022, 2022
Short summary
Short summary
This work theoretically motivates an extension of the statistical model used in so-called detection and attribution studies to structural equation modelling. The application of one of the models suggested is exemplified in a small numerical study, whose aim was to check the assumptions typically placed on ensembles of climate model simulations when constructing mean sequences. he result of this study indicated that some ensembles for some regions may not satisfy the assumptions in question.
Katarina Lashgari, Anders Moberg, and Gudrun Brattström
Adv. Stat. Clim. Meteorol. Oceanogr., 8, 249–271, https://doi.org/10.5194/ascmo-8-249-2022, https://doi.org/10.5194/ascmo-8-249-2022, 2022
Short summary
Short summary
The performance of a new statistical framework containing various structural equation modelling (SEM) models is evaluated in a pseudo-proxy experiment in comparison with the performance of statistical models used in many detection and attribution studies. Each statistical model was fitted to seven continental-scale regional temperature data sets. The results indicated the SEM specification is the most appropriate for describing the underlying latent structure of the simulated data analysed.
Qiuyi Wu, Julie Bessac, Whitney Huang, Jiali Wang, and Rao Kotamarthi
Adv. Stat. Clim. Meteorol. Oceanogr., 8, 205–224, https://doi.org/10.5194/ascmo-8-205-2022, https://doi.org/10.5194/ascmo-8-205-2022, 2022
Short summary
Short summary
We study wind conditions and their potential future changes across the U.S. via a statistical conditional framework. We conclude that changes between historical and future wind directions are small, but wind speeds are generally weakened in the projected period, with some locations being intensified. Moreover, winter wind speeds are projected to decrease in the northwest, Colorado, and the northern Great Plains (GP), while summer wind speeds over the southern GP slightly increase in the future.
Timothy DelSole and Michael K. Tippett
Adv. Stat. Clim. Meteorol. Oceanogr., 7, 73–85, https://doi.org/10.5194/ascmo-7-73-2021, https://doi.org/10.5194/ascmo-7-73-2021, 2021
Short summary
Short summary
After a new climate model is constructed, a natural question is whether it generates realistic simulations. Here,
realisticdoes not mean that the detailed patterns on a particular day are correct, but rather that the statistics over many years are realistic. Past approaches to answering this question often neglect correlations in space and time. This paper proposes a method for answering this question that accounts for correlations in space and time.
Eric Gilleland
Adv. Stat. Clim. Meteorol. Oceanogr., 7, 13–34, https://doi.org/10.5194/ascmo-7-13-2021, https://doi.org/10.5194/ascmo-7-13-2021, 2021
Short summary
Short summary
Verifying high-resolution weather forecasts has become increasingly complicated,
and simple, easy-to-understand summary measures are a good alternative. Recent work has demonstrated some common pitfalls with many such summaries. Here, new summary measures are introduced that do not suffer from these drawbacks, while still providing meaningful information.
Thomas Patrick Leahy
Adv. Stat. Clim. Meteorol. Oceanogr., 7, 1–11, https://doi.org/10.5194/ascmo-7-1-2021, https://doi.org/10.5194/ascmo-7-1-2021, 2021
Short summary
Short summary
This study looked at estimating damages caused by hurricanes in the United States. It assessed the relationship between the maximum wind speed at landfall and the resulting damage caused. The study found that the complex processes that determine the size of the damages inflicted could be estimated using this simple relationship. This work could be used to examine how often extreme damage events are likely to occur and the impact of stronger hurricane winds on the US Atlantic and Gulf coasts.
Yoann Robin and Aurélien Ribes
Adv. Stat. Clim. Meteorol. Oceanogr., 6, 205–221, https://doi.org/10.5194/ascmo-6-205-2020, https://doi.org/10.5194/ascmo-6-205-2020, 2020
Short summary
Short summary
We have developed a new statistical method to describe how a severe weather event, such as a heat wave, may have been influenced by climate change. Our method incorporates both observations and data from various climate models to reflect climate model uncertainty. Our results show that both the probability and the intensity of the French July 2019 heatwave have increased significantly in response to human influence. We find that this heat wave might not have been possible without climate change.
Timothy DelSole and Michael K. Tippett
Adv. Stat. Clim. Meteorol. Oceanogr., 6, 159–175, https://doi.org/10.5194/ascmo-6-159-2020, https://doi.org/10.5194/ascmo-6-159-2020, 2020
Short summary
Short summary
Scientists often are confronted with the question of whether two time series are statistically distinguishable. This paper proposes a test for answering this question. The basic idea is to fit each time series to a time series model and then test whether the parameters in that model are equal. If a difference is detected, then new ways of visualizing those differences are proposed, including a clustering technique and a method based on optimal initial conditions.
Joshua North, Zofia Stanley, William Kleiber, Wiebke Deierling, Eric Gilleland, and Matthias Steiner
Adv. Stat. Clim. Meteorol. Oceanogr., 6, 79–90, https://doi.org/10.5194/ascmo-6-79-2020, https://doi.org/10.5194/ascmo-6-79-2020, 2020
Short summary
Short summary
Very short-term forecasting, called nowcasting, is used to monitor storms that pose a significant threat to people and infrastructure. These threats could include lightning strikes, hail, heavy precipitation, strong winds, and possible tornados. This paper proposes a fast approach to nowcasting lightning threats using simple statistical methods. The proposed model results in fast nowcasts that are more accurate than a competitive, computationally expensive, approach.
Ola Haug, Thordis L. Thorarinsdottir, Sigrunn H. Sørbye, and Christian L. E. Franzke
Adv. Stat. Clim. Meteorol. Oceanogr., 6, 1–12, https://doi.org/10.5194/ascmo-6-1-2020, https://doi.org/10.5194/ascmo-6-1-2020, 2020
Short summary
Short summary
Trends in gridded temperature data are commonly assessed independently for each grid cell, ignoring spatial coherencies. This may severely affect the interpretation of the results. This article proposes a space–time model for temperatures that allows for joint assessments of the trend across locations. In a case study of summer season trends in Europe, it is found that the region with a significant trend under spatial coherency is vastly different from that under independent assessments.
Alexis Hannart
Adv. Stat. Clim. Meteorol. Oceanogr., 5, 161–171, https://doi.org/10.5194/ascmo-5-161-2019, https://doi.org/10.5194/ascmo-5-161-2019, 2019
Short summary
Short summary
In climate change attribution studies, one often seeks to maximize a signal-to-noise ratio, where the
signalis the anthropogenic response and the
noiseis climate variability. A solution commonly used in D&A studies thus far consists of projecting the signal on the subspace spanned by the leading eigenvectors of climate variability. Here I show that this approach is vastly suboptimal – in fact, it leads instead to maximizing the noise-to-signal ratio. I then describe an improved solution.
Moritz N. Lang, Georg J. Mayr, Reto Stauffer, and Achim Zeileis
Adv. Stat. Clim. Meteorol. Oceanogr., 5, 115–132, https://doi.org/10.5194/ascmo-5-115-2019, https://doi.org/10.5194/ascmo-5-115-2019, 2019
Short summary
Short summary
Accurate wind forecasts are of great importance for decision-making processes in today's society. This work presents a novel probabilistic post-processing method for wind vector forecasts employing a bivariate Gaussian response distribution. To capture a possible mismatch between the predicted and observed wind direction caused by location-specific properties, the approach incorporates a smooth rotation of the wind direction conditional on the season and the forecasted ensemble wind direction.
X. Joey Wang, John R. J. Thompson, W. John Braun, and Douglas G. Woolford
Adv. Stat. Clim. Meteorol. Oceanogr., 5, 57–66, https://doi.org/10.5194/ascmo-5-57-2019, https://doi.org/10.5194/ascmo-5-57-2019, 2019
Short summary
Short summary
This paper presents the analysis of data from small-scale laboratory experimental smouldering fires that were digitally video-recorded. The video images of these fires bear a resemblance to remotely sensed images of wildfires and provide an opportunity to fit and assess a spatial model for fire spread that attempts to account for uncertainty in fire growth. We found that the fitting method is feasible, and the spatial model provides a suitable mathematical for the fire spread process.
Robin Tokmakian and Peter Challenor
Adv. Stat. Clim. Meteorol. Oceanogr., 5, 17–35, https://doi.org/10.5194/ascmo-5-17-2019, https://doi.org/10.5194/ascmo-5-17-2019, 2019
Short summary
Short summary
As an example of how to robustly determine climate model uncertainty, the paper describes an experiment that perturbs the initial conditions for the ocean's temperature of a climate model. A total of 30 perturbed simulations are used (via an emulator) to estimate spatial uncertainties for temperature and precipitation fields. We also examined (using maximum covariance analysis) how ocean temperatures affect air temperatures and precipitation over land and the importance of feedback processes.
Thorsten Simon, Georg J. Mayr, Nikolaus Umlauf, and Achim Zeileis
Adv. Stat. Clim. Meteorol. Oceanogr., 5, 1–16, https://doi.org/10.5194/ascmo-5-1-2019, https://doi.org/10.5194/ascmo-5-1-2019, 2019
Short summary
Short summary
Lightning in Alpine regions is associated with events such as thunderstorms,
extreme precipitation, high wind gusts, flash floods, and debris flows.
We present a statistical approach to predict lightning counts based on
numerical weather predictions. Lightning counts are considered on a grid
with 18 km mesh size. Skilful prediction is obtained for a forecast horizon
of 5 days over complex terrain.
Tony E. Wong
Adv. Stat. Clim. Meteorol. Oceanogr., 4, 53–63, https://doi.org/10.5194/ascmo-4-53-2018, https://doi.org/10.5194/ascmo-4-53-2018, 2018
Short summary
Short summary
Millions of people worldwide are at a risk of coastal flooding, and this number will increase as the climate continues to change. This study analyzes how climate change affects future flood hazards. A new model that uses multiple climate variables for flood hazard is developed. For the case study of Norfolk, Virginia, the model predicts 23 cm higher flood levels relative to previous work. This work shows the importance of accounting for climate change in effectively managing coastal risks.
Amy Braverman, Snigdhansu Chatterjee, Megan Heyman, and Noel Cressie
Adv. Stat. Clim. Meteorol. Oceanogr., 3, 93–105, https://doi.org/10.5194/ascmo-3-93-2017, https://doi.org/10.5194/ascmo-3-93-2017, 2017
Short summary
Short summary
In this paper, we introduce a method for expressing the agreement between climate model output time series and time series of observational data as a probability value. Our metric is an estimate of the probability that one would obtain two time series as similar as the ones under consideration, if the climate model and the observed series actually shared the same underlying climate signal.
Joshua P. French, Seth McGinnis, and Armin Schwartzman
Adv. Stat. Clim. Meteorol. Oceanogr., 3, 67–92, https://doi.org/10.5194/ascmo-3-67-2017, https://doi.org/10.5194/ascmo-3-67-2017, 2017
Short summary
Short summary
We assess the mean temperature effect of global and regional climate model combinations for the North American Regional Climate Change Assessment Program using varying classes of linear regression models, including possible interaction effects. We use both pointwise and simultaneous inference procedures to identify regions where global and regional climate model effects differ. We conclusively show that accounting for multiple comparisons is important for making proper inference.
László Varga and András Zempléni
Adv. Stat. Clim. Meteorol. Oceanogr., 3, 55–66, https://doi.org/10.5194/ascmo-3-55-2017, https://doi.org/10.5194/ascmo-3-55-2017, 2017
Short summary
Short summary
This paper proposes a new generalisation of the block bootstrap methodology, which allows for any positive real number as expected block size. We use this bootstrap for determining the p values of a homogeneity test for copulas. The methods are applied to a temperature data set - we have found some significant changes in the dependence structure between the standardised temperature values of pairs of observation points within the Carpathian Basin.
Andrew Poppick, Elisabeth J. Moyer, and Michael L. Stein
Adv. Stat. Clim. Meteorol. Oceanogr., 3, 33–53, https://doi.org/10.5194/ascmo-3-33-2017, https://doi.org/10.5194/ascmo-3-33-2017, 2017
Short summary
Short summary
We show that ostensibly empirical methods of analyzing trends in the global mean temperature record, which appear to de-emphasize assumptions, can nevertheless produce misleading inferences about trends and associated uncertainty. We illustrate how a simple but physically motivated trend model can provide better-fitting and more broadly applicable results, and show the importance of adequately characterizing internal variability for estimating trend uncertainty.
John Tipton, Mevin Hooten, and Simon Goring
Adv. Stat. Clim. Meteorol. Oceanogr., 3, 1–16, https://doi.org/10.5194/ascmo-3-1-2017, https://doi.org/10.5194/ascmo-3-1-2017, 2017
Short summary
Short summary
We present a statistical framework for the reconstruction of historic temperature patterns from sparse, irregular data collected from observer stations. A common statistical technique for climate reconstruction uses modern era data as a set of temperature patterns that can be used to estimate the spatial temperature patterns. We present a framework for exploration of different assumptions about the sets of patterns used in the reconstruction while providing statistically rigorous estimates.
Georgina Davies and Noel Cressie
Adv. Stat. Clim. Meteorol. Oceanogr., 2, 155–169, https://doi.org/10.5194/ascmo-2-155-2016, https://doi.org/10.5194/ascmo-2-155-2016, 2016
Short summary
Short summary
Sea surface temperature (SST) is a key component of global climate models, particularly in the tropical Pacific Ocean where El Niño and La Nina events have worldwide implications. In our paper, we analyse monthly SSTs in the Niño 3.4 region and find a transformation that removes a spatial mean-variance dependence for each month. For 10 out of 12 months in the year, the transformed monthly time series gave more accurate or as accurate forecasts than those from the untransformed time series.
Eric Gilleland, Melissa Bukovsky, Christopher L. Williams, Seth McGinnis, Caspar M. Ammann, Barbara G. Brown, and Linda O. Mearns
Adv. Stat. Clim. Meteorol. Oceanogr., 2, 137–153, https://doi.org/10.5194/ascmo-2-137-2016, https://doi.org/10.5194/ascmo-2-137-2016, 2016
Short summary
Short summary
Several climate models are evaluated under current climate conditions to determine how well they are able to capture frequencies of severe-storm environments (conditions conducive for the formation of hail storms, tornadoes, etc.). They are found to underpredict the spatial extent of high-frequency areas (such as tornado alley), as well as underpredict the frequencies in the areas.
Whitney K. Huang, Michael L. Stein, David J. McInerney, Shanshan Sun, and Elisabeth J. Moyer
Adv. Stat. Clim. Meteorol. Oceanogr., 2, 79–103, https://doi.org/10.5194/ascmo-2-79-2016, https://doi.org/10.5194/ascmo-2-79-2016, 2016
Sergei N. Rodionov
Adv. Stat. Clim. Meteorol. Oceanogr., 2, 63–78, https://doi.org/10.5194/ascmo-2-63-2016, https://doi.org/10.5194/ascmo-2-63-2016, 2016
David Bolin, Arnoldo Frigessi, Peter Guttorp, Ola Haug, Elisabeth Orskaug, Ida Scheel, and Jonas Wallin
Adv. Stat. Clim. Meteorol. Oceanogr., 2, 39–47, https://doi.org/10.5194/ascmo-2-39-2016, https://doi.org/10.5194/ascmo-2-39-2016, 2016
Julie Bessac, Pierre Ailliot, Julien Cattiaux, and Valerie Monbet
Adv. Stat. Clim. Meteorol. Oceanogr., 2, 1–16, https://doi.org/10.5194/ascmo-2-1-2016, https://doi.org/10.5194/ascmo-2-1-2016, 2016
Short summary
Short summary
Several multi-site stochastic generators of zonal and meridional components of wind are proposed in this paper. Various questions are explored, such as the modeling of the regime in a multi-site context, the extraction of relevant clusterings from extra variables or from the local wind data, and the link between weather types extracted from wind data and large-scale weather regimes. We also discuss the relative advantages of hidden and observed regime-switching models.
E. M. Schliep, A. E. Gelfand, and D. M. Holland
Adv. Stat. Clim. Meteorol. Oceanogr., 1, 59–74, https://doi.org/10.5194/ascmo-1-59-2015, https://doi.org/10.5194/ascmo-1-59-2015, 2015
Short summary
Short summary
There is considerable demand for accurate air quality information in human health analyses. The sparsity of ground monitoring stations across the US motivates the need for advanced statistical models to predict air quality metrics. We propose a statistical model that jointly models ground-monitoring station data and satellite-obtained data allowing for temporal and spatial misalignment, missingness, and spatially and temporally varying correlation to enhance prediction of particulate matter.
R. Philbin and M. Jun
Adv. Stat. Clim. Meteorol. Oceanogr., 1, 29–44, https://doi.org/10.5194/ascmo-1-29-2015, https://doi.org/10.5194/ascmo-1-29-2015, 2015
T. K. Doan, J. Haslett, and A. C. Parnell
Adv. Stat. Clim. Meteorol. Oceanogr., 1, 15–27, https://doi.org/10.5194/ascmo-1-15-2015, https://doi.org/10.5194/ascmo-1-15-2015, 2015
W. B. Leeds, E. J. Moyer, and M. L. Stein
Adv. Stat. Clim. Meteorol. Oceanogr., 1, 1–14, https://doi.org/10.5194/ascmo-1-1-2015, https://doi.org/10.5194/ascmo-1-1-2015, 2015
Cited articles
Anderson, J. L.: A method for producing and evaluating probabilistic forecasts
from ensemble model integrations, J. Clim., 9, 1518–1530, 1996. a
Bessac, J.: Codes for scoring under uncertain verification data, available at: https://github.com/jbessac/uncertainty_scoring, GitHub [code], last access: 8 September 2021. a
Bowler, N. E.: Accounting for the effect of observation errors on verification
of MOGREPS, Meteorol. Appl., 15, 199–205, 2008. a
Bröcker, J. and Ben Bouallègue, Z.: Stratified rank histograms for
ensemble forecast verification under serial dependence, Q. J.
Roy. Meteorol. Soc., 146, 1976–1990,
https://doi.org/10.1002/qj.3778, 2020. a
Bröcker, J. and Smith, L. A.: Scoring probabilistic forecasts: The
importance of being proper, Weather Forecast., 22, 382–388, 2007. a
Candille, G. and Talagrand, O.: Retracted and replaced: Impact of observational
error on the validation of ensemble prediction systems, Q. J.
Roy. Meteorol. Soc., 134, 509–521, 2008. a
Cressie, N. and Wikle, C. K.: Statistics for spatio-temporal data, John Wiley
& Sons, Hoboken, N.J., 2015. a
Daley, R.: Estimating observation error statistics for atmospheric data
assimilation, Ann. Geophys., 11, 634–647, 1993. a
Gelman, A., Carlin, J. B., Stern, H. S., Dunson, D. B., Vehtari, A., and Rubin,
D. B.: Bayesian data analysis, CRC press, 2013. a
Gneiting, T. and Raftery, A. E.: Strictly proper scoring rules, prediction, and
estimation, J. Am. Stat. Assoc., 102, 359–378,
2007. a
Gneiting, T., Raftery, A. E., Westveld III, A. H., and Goldman, T.: Calibrated
probabilistic forecasting using ensemble model output statistics and minimum
CRPS estimation, Mon. Weather Rev., 133, 1098–1118, 2005. a
Gorgas, T. and Dorninger, M.: Quantifying verification uncertainty by reference
data variation, Meteorol. Z., 21, 259–277, 2012. a
Hamill, T. M.: Interpretation of rank histograms for verifying ensemble
forecasts, Mon. Weather Rev., 129, 550–560, 2001. a
Janjić, T., Bormann, N., Bocquet, M., Carton, J. A., Cohn, S. E., Dance,
S. L., Losa, S. N., Nichols, N. K., Potthast, R., Waller, J. A., and Weston,
P.: On the representation error in data assimilation, Q. J.
Roy. Meteorol. Soc., 144, 1257–1278, 2017. a
Jolliffe, I. T.: Uncertainty and inference for verification measures, Weather
Forecast., 22, 637–650, 2007. a
Jolliffe, T. and Stephenson, D. B.: Forecast verification: A practitioner's
guide in atmospheric science, edited by: Wiley, I., Chichester, Weather, 59, 132–132, https://doi.org/10.1256/wea.123.03,
2004. a, b, c
Kalman, R. E.: A new approach to linear prediction and filtering problems,
Transactions of the ASME, J. Basic Eng., 82, 35–45, 1960. a
Kalman, R. E. and Bucy, R. S.: New results in linear filtering and prediction
theory, J. Basic Eng., 83, 95–108, 1961. a
Kavetski, D., Kuczera, G., and Franks, S. W.: Bayesian analysis of input
uncertainty in hydrological modeling: 1. Theory, Water Resour. Res.,
42, 3, https://doi.org/10.1029/2005WR004368, 2006a. a
Kavetski, D., Kuczera, G., and Franks, S. W.: Bayesian analysis of input
uncertainty in hydrological modeling: 2. Application, Water Resour.
Res., 42, 3, https://doi.org/10.1029/2005WR004376, 2006b. a
Kleen, O.: Measurement Error Sensitivity of Loss Functions for Distribution
Forecasts, SSRN 3476461, https://doi.org/10.2139/ssrn.3476461, 2019. a
Murphy, A. H.: A new vector partition of the probability score, J.
Appl. Meteorol., 12, 595–600, 1973. a
Murphy, A. H. and Winkler, R. L.: A general framework for forecast
verification, Mon. Weather Rev., 115, 1330–1338, 1987. a
Muskulus, M. and Verduyn-Lunel, S.: Wasserstein distances in the analysis of
time series and dynamical systems, Physica D, 240,
45–58, 2011. a
National Centers for Environmental Information, National Oceanic Atmospheric Administration, U.S. Department of Commerce: Automated Surface Observing Systems (ASOS) program, [code], available at: ftp://ftp.ncdc.noaa.gov/pub/data/asos-onemin, last access: 8 September 2021. a
Pappenberger, F., Ghelli, A., Buizza, R., and Bodis, K.: The skill of
probabilistic precipitation forecasts under observational uncertainties
within the generalized likelihood uncertainty estimation framework for
hydrological applications, J. Hydrometeorol., 10, 807–819, 2009. a
Robert, C. and Casella, G.: Monte Carlo statistical methods, Springer Science
& Business Media, 2013. a
Robin, Y., Yiou, P., and Naveau, P.: Detecting changes in forced climate
attractors with Wasserstein distance, Nonl. Process. Geophys.,
24, 393–405, 2017. a
Santambrogio, F.: Optimal transport for applied mathematicians, Vol. 87, Birkhäuser Basel, 2015. a
Scheuerer, M. and Möller, D.: Probabilistic wind speed forecasting on a
grid based on ensemble model output statistics, Ann. Appl.
Stat., 9, 1328–1349, 2015. a
Schuhmacher, D., Bähre, B., Gottschlich, C., Hartmann, V., Heinemann, F.,
Schmitzer, B., Schrieber, J., and Wilm, T.: transport: Computation of
Optimal Transport Plans and Wasserstein Distances, R package
version 0.12-2,
https://cran.r-project.org/package=transport (last access: 8 September 2021), 2020. a
Skamarock, W., Klemp, J., Dudhia, J., Gill, D., Barker, D., Duda, M., Huang,
X.-Y., Wang, W., and Powers, J.: A description of the Advanced Research
WRF Version 3, Tech. Rep., https://doi.org/10.5065/D68S4MVH, 2008. a
Stein, C. M.: Estimation of the mean of a multivariate normal distribution,
Ann. Stat., 9, 1135–1151, https://doi.org/10.1214/aos/1176345632, 1981. a
Taillardat, M., Mestre, O., Zamo, M., and Naveau, P.: Calibrated Ensemble
Forecasts using Quantile Regression Forests and Ensemble Model Output
Statistics, Mon. Weather Rev., 144, 2375–2393,
https://doi.org/10.1175/MWR-D-15-0260.1, 2016. a, b
Taillardat, M., Fougères, A.-L., Naveau, P., and de Fondeville, R.: Extreme
events evaluation using CRPS distributions, arXiv preprint arXiv:1905.04022, available at: https://arxiv.org/abs/1905.04022
(last access: 8 September 2021),
2019. a
Waller, J. A., Dance, S. L., Lawless, A. S., and Nichols, N. K.: Estimating
correlated observation error statistics using an ensemble transform Kalman
filter, Tellus A, 66, 23294, https://doi.org/10.3402/tellusa.v66.23294, 2014. a
Weijs, S. V. and Van De Giesen, N.: Accounting for observational uncertainty in
forecast verification: an information-theoretical view on forecasts,
observations, and truth, Mon. Weather Rev., 139, 2156–2162, 2011. a
Weijs, S. V., Van Nooijen, R., and Van De Giesen, N.: Kullback–Leibler
divergence as a forecast skill score with classic
reliability–resolution–uncertainty decomposition, Mon. Weather Rev.,
138, 3387–3399, 2010. a
Zamo, M. and Naveau, P.: Estimation of the Continuous Ranked Probability Score
with Limited Information and Applications to Ensemble Weather Forecasts,
Math. Geosci., 50, 209–234, 2018. a
Short summary
We propose a new forecast evaluation scheme in the context of models that incorporate errors of the verification data. We rely on existing scoring rules and incorporate uncertainty and error of the verification data through a hidden variable and the conditional expectation of scores. By considering scores to be random variables, one can access the entire range of their distribution and illustrate that the commonly used mean score can be a misleading representative of the distribution.
We propose a new forecast evaluation scheme in the context of models that incorporate errors of...
