Intercomparison of spatial verification methods [presentation]

AMS Citation:
Ahijevych, D. A., E. Gilleland, B. G. Brown, E. Ebert, L. Holland, and C. A. Davis, 2008: Intercomparison of spatial verification methods [presentation]. 19th Conference on Probability and Statistics, American Meteorological Society, New Orleans, LA, US.
Date:2008-01-23
Resource Type:conference material
Title:Intercomparison of spatial verification methods [presentation]
Abstract: Faster and more powerful computers can handle weather models with less sub-gridscale parameterization and smaller grid spacing. At the same time, advances in model verification are needed to keep pace with these advances in computing resources. As finer-scale features are resolved by today's models, valuable information about storm structure and organization may be inferred. Unfortunately, traditional verification measures based on collocated points between observation and forecast (e.g. Gilbert Skill Score, root mean squared error, probability of detection) are insensitive to this potential added quality. Other information about weather features that may help diagnose model deficiencies (such as scale-dependent bias, or displacement error) are not forthcoming from the traditional methods. In this paper, we attempt to compile the latest and most relevant approaches to this problem from a broad segment of the verification research community. We divide the approaches into four broad categories: neighborhood, scale-decomposition, feature, and field verification, and apply them to specific weather events from spring 2005. We also explore how these metrics compare to a subjective evaluation of forecast quality based on a survey of 30 individuals. Some of the goals of this intercomparison are to guide the user to the proper verification method based on his or her needs and to show some of the inherent strengths and weaknesses of the various methods.
Peer Review:Non-refereed
Copyright Information:Copyright Author(s). This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
OpenSky citable URL: ark:/85065/d77080h2
Author(s):
  • David Ahijevych - NCAR/UCAR
  • Eric Gilleland - NCAR/UCAR
  • Barbara Brown - NCAR/UCAR
  • E. Ebert
  • L. Holland - NCAR/UCAR
  • Christopher Davis - NCAR/UCAR
  • Random Profile

    NCAR LAB DIR

    Recent & Upcoming Visitors