Related Experiment Video
Updated: Nov 8, 2025

Implementation of a Real-Time Psychosis Risk Detection and Alerting System Based on Electronic Health Records using CogStack
Published on: May 15, 2020
Object-based verification of a prototype Warn-on-Forecast system
Patrick S Skinner1,2, Dustan M Wheatley3, Kent H Knopfmeier1,2
1Cooperative Institute for Mesoscale Meteorological Studies, University of Oklahoma, Norman, Oklahoma.
Abstract:
An object-based verification methodology for the NSSL Experimental Warn-on-Forecast System for ensembles (NEWS-e) has been developed and applied to 32 cases between December 2015 and June 2017. NEWS-e forecast objects of composite reflectivity and 30-minute rotation tracks of updraft helicity are matched to corresponding objects in Multi-Radar Multi-Sensor data on space and time scales typical of a National Weather Service warning. Object matching allows contingency table-based verification statistics to be used to establish baseline performance metrics for NEWS-e thunderstorm and mesocyclone forecasts. NEWS-e critical Success Index (CSI) scores of reflectivity (updraft helicity) forecasts decrease from approximately 0.7 (0.4) to 0.4 (0.2) over 3 hours of forecast time. CSI scores decrease through the forecast period, indicating that errors have not saturated and skill is retained at 3 hours of forecast time. Lower verification scores for rotation track forecasts are primarily a result of a high frequency bias. Comparison of different system configurations used in 2016 and 2017 show an increase in skill for 2017 reflectivity forecasts, attributable mainly to improvements in the forecast initial condition. A small decrease in skill in 2017 rotation track forecasts is likely a result of sample differences between 2016 and 2017. Although large case-to-case variation is present, evidence is found that NEWS-e forecast skill improves with increasing object size and intensity, as well as in mesoscale environments in which an enhanced or higher risk of severe thunderstorms was forecast.
Related Concept Videos
Propagation of Uncertainty from Systematic Error
Types of Errors: Detection and Minimization
Absolute error in a measurement is the numerical difference from the true or central value. Relative error is the ratio between absolute error and the true or central value, expressed as a percentage.
Errors can be classified by source, magnitude, and sign. There are three types of errors: systematic, random, and gross.
Systematic or...
Propagation of Uncertainty from Random Error
What is Weather?
Detection of Gross Error: The Q Test
Precipitation Titration: Endpoint Detection Methods
In the Volhard method, a standard excess of AgNO3 is first added to the...

