Collaborative Exploration of Storm-Scale Probabilistic Guidance for NWS Forecast Operations

Abstract

Abstract The operational utility of the NOAA National Severe Storm Laboratory’s storm-scale probabilistic Warn-on-Forecast System (WoFS) was examined across the watch-to-warning time frame in a virtual NOAA Hazardous Weather Testbed (HWT) experiment. Over four weeks, 16 NWS forecasters from local Weather Forecast Offices, the Storm Prediction Center, and the Weather Prediction Center participated in simulated forecasting tasks and focus groups. Bringing together multiple NWS entities to explore new guidance impacts on the broader forecast process is atypical of prior NOAA HWT experiments. This study therefore provides a framework for designing such a testbed experiment, including methodological and logistical considerations necessary to meet the needs of both local office and national center NWS participants. Furthermore, this study investigated two research questions: 1) How do forecasters envision WoFS guidance fitting into their existing forecast process? and 2) How could WoFS guidance be used most effectively across the current watch-to-warning forecast process? Content and thematic analyses were completed on flowcharts of operational workflows, real-time simulation interactions, and focus group activities and discussions. Participants reported numerous potential applications of WoFS, including improved coordination and consistency between local offices and national centers, enhanced hazard messaging, and improved operations planning. Challenges were also reported, including the knowledge and training required to incorporate WoFS guidance effectively and forecasters’ trust in new guidance and openness to change. The solutions identified to these challenges will take WoFS one step closer to transition, and in the meantime, improve the capabilities of WoFS for experimental use within the operational community. Significance Statement A first-of-its-kind experiment brought together forecasters from local weather forecast offices and national centers to examine the experimental Warn-on-Forecast System’s (WoFS’s) potential applications across watch-to-warning scales. This experiment demonstrated that WoFS can provide great benefit to forecasters, though a few challenges remain. Benefits provided by WoFS frequently overlap roles and responsibilities at local and national scales, suggesting the potential for enhanced cross-office collaboration. The challenges anticipated for WoFS operational use are far fewer than the benefits, and some solutions to these challenges are now being implemented. Finally, the mixed-methods experimental framework described herein also provides guidance for future collaborative experiments in testbed research that examine impacts of new technologies across NWS entities.