170 likes | 262 Views
COMPARISONS OF NOWCASTING TECHNIQUES FOR OCEANIC CONVECTION. Huaqing Cai, Cathy Kessinger, Nancy Rehak, Daniel Megenhardt and Matthias Steiner National Center for Atmospheric Research Boulder, CO 14 th Conference on Aviation, Range, and Aerospace Meteorology Atlanta, GA 18-21 January, 2010.
E N D
COMPARISONS OF NOWCASTING TECHNIQUES FOR OCEANIC CONVECTION Huaqing Cai, Cathy Kessinger, Nancy Rehak, Daniel Megenhardt and Matthias Steiner National Center for Atmospheric Research Boulder, CO 14th Conference on Aviation, Range, and Aerospace Meteorology Atlanta, GA 18-21 January, 2010 ACKNOWLEDGMENTS This study is supported by NASA ROSES and NASA ASAP program and in collaboration with NRL and MIT LL
Oceanic Diagnosis and Nowcasting System CTop CClass GCD Convective Nowcasting Oceanic (CNO-Titan) makes 1-hr and 2-hr nowcasts of storm location using an object tracker (Titan) CNO- Titan Nowcast CNO- Gridded Nowcast CNO-Gridded produces gridded nowcasts that will more closely resemble storm structures CNO-RF utilizes environmental and model-based inputs to better predict storm initiation and decay [Cai et al. (2009)] CNO-RF Random Forest Nowcast Convective Diagnosis Oceanic (CDO) identifies convective cells With Growth/Decay CDO Interest Without Growth/Decay CDO Binary Product With Growth/Decay
CNO Based on TITAN (Dixon and Wiener, 1993) An Example of 1 Hr CNO-TITAN TITAN for Radar Data *1 hr nowcast of CDO valid at 1315 UTC on August 19, 2007 using TITAN technique is shown on the right; red lines on the right represent CDO = 2.5 verification. *Advantages of TITAN: computationally efficient; capability of addressing growth/decay. *Disadvantages of TITAN: polygons can only roughly represent storm shapes; tends to over-forecasting
TITAN Motion Vectors at t0 Gridded 0 hr TITAN Motion Vectors Gridded 2 hr TITAN Motion Vectors Gridded 1 hr TITAN Motion Vectors Merged with GFS Winds Closest in Time Merged with GFS Winds Closest in Time Merged with GFS Winds Closest in Time Temporal & Spatial Smoothing Temporal & Spatial Smoothing Temporal & Spatial Smoothing 15-60 min Motion Vectors 75-120 min Motion Vectors 135-180 min Motion Vectors 15-60 min Forecasts by Advecting Original Satellite Data at t0 75-120 min Forecasts by Advecting 60 min Nowcasts 135-180 min Forecasts by Advecting 120 min Nowcasts CNO Based on Modified TITAN---- Gridded Forecast 1-3 Hr CNO-Gridded Forecast Flow Chart An Example of 1 Hr CNO-Gridded Forecast *Advantages of CNO-Gridded: realistic looking storms; low bias. *Disadvantages of CNO-Gridded: could be computationally expensive; no explicit growth/decay capability
CNO Based on Random Forest Statistical Analysis and Data Fusion • The random forest technique produces an ensemble of decision trees from labeled training instances • during training, RF generates estimates of predictor importance • RF trees “vote” on classification of new data points, comprising a nonlinear empirical model that provides both deterministic predictions and probabilistic information Data pt. Data pt. Data pt. Data pt. Data pt. Tree 2 Tree 3 Tree 100 Tree 1 Tree 4 … Vote: 0 Vote: 0 Vote: 0 Vote: 1 Vote: 1 => 40 votes for “0”, 60 votes for “1”; consensus category “1” For details of RF technique in CoSPA R&D effort, referred to paper J10.4 by Ahijevych et al. on Thursday *Slide courtesy of John Williams and Dave Ahijevych
CNO-RF An Example of CNO-RF Forecast Compared with CNO-TITAN ( 1 hr) B Hurricane Dean A C *1 hr forecasts valid at 1315 UTC on August 19, 2007 for both techniques; Red lines represent CDO = 2.5 verification *Advantages of random forest technique: more realistic looking storms; taking into account of storm environment to address storm growth/decay. *As a relatively new, novel technique for nowcasting, its potential needs to be fully explored D CNO-TITAN B CNO Hurricane Dean A C D
Statistical Evaluation of the Three Nowcasting Techniques CSI BIAS • 5 days of data from Aug 19-23, 2007 over the Gulf of Mexico domain are used to calculate the statistics with a grid size of ~ 5 km and CDO threshold of 2.5 • All three techniques show skill over persistence • RF and gridded forecast perform best at 1 hr lead time • TITAN is the best at 2-3 hr lead time • Gridded forecast is the best for 4-6 hr lead time
Relative Skill Comparisons of Three Nowcasting Techniques versus Persistence • Gridded and RF nowcasts ~10 % better than persistence at 1 hr lead time • TITAN is the best for 2 and 3 hr lead time (~20-30% improvement) • Gridded nowcasts the best for 4,5 and 6 hr lead time (~ 15-25% improvement) • Overall, gridded technique seems to be the best performer
Examples of 1 hr Gridded Forecast over the Gulf of Mexico Domain 1 HR D Issue time: 1215 UTC 2009/09/05 Valid time: 1315 UTC 2009/09/05 C B A *White lines are CDO=2.5 verification, satellite data available every 30 min
Examples of 3 hr Gridded Forecast over the Gulf of Mexico Domain 3 HR Issue time: 1215 UTC 2009/09/05 Valid time: 1515 UTC 2009/09/05 D C B A *White lines are CDO=2.5 verification, satellite data available every 30 min
Examples of 6 hr Gridded Forecast over the Gulf of Mexico Domain 6 HR Issue time: 1215 UTC 2009/09/05 Valid time: 1815 UTC 2009/09/05 D C B A *White lines are CDO=2.5 verification, satellite data available every 30 min
Examples of 3 hr CDO Forecasts Based on CNO-Gridded Technique in the West Pacific Domain 3 HR Issue time: 2100 UTC 2009/12/28 Valid time: 0000 UTC 2009/12/29 A D C B *White lines are CDO=1.5 verification; Cloud class is not used in CDO *Satellite data are available every 3 hrs
Examples of 3 hr CDO Forecasts Based on CNO-Gridded Technique in the West Pacific Domain 3 HR Issue time: 0000 UTC 2009/12/29 Valid time: 0300 UTC 2009/12/29 A D C B *White lines are CDO=1.5 verification; Cloud class is not used in CDO *Satellite data are available every 3 hrs
Examples of 3 hr CDO Forecasts Based on CNO-Gridded Technique in the West Pacific Domain 3 HR Issue time: 0300 UTC 2009/12/29 Valid time: 0600 UTC 2009/12/29 A D C B *White lines are CDO=1.5 verification; Cloud class is not used in CDO *Satellite data are available every 3 hrs
Summary Statistics of CNO-Gridded Forecasts The black squares are statistics from Aug 19-22, 2007 What are the GFS model scores for oceanic convection??? • 30 days of data from Sep 1-30, 2009 over the Gulf of Mexico domain are used to calculate the statistics with a grid size of ~ 5 km and CDO threshold of 2.5 • The results showed here could serve as benchmark performance of extrapolation-based nowcasting techniques for oceanic convection • Similar verification for model forecasts need to be done so that a comparison of convective forecasting skills between model and extrapolation can be obtained
Summary and Future Work • Three nowcasting techniques (CNO-TITAN, CNO-Gridded and CNO-Random Forest) for oceanic convection forecasting in the 1-6 hr time frame are implemented, tested and compared in the Gulf of Mexico domain • At 1 hr lead time, CNO-Gridded and CNO-RF got the best performance scores • At 2-3 hr forecast lead time, CNO-TITAN outperforms the other techniques • After 3 hr, CNO-Gridded outperforms the other techniques • Based on the overall performance statistics, CNO-Gridded forecasts for 1-8 hr are implemented in the Gulf of Mexico and Pacific domain in the realtime Oceanic Diagnosis and Nowcasting System • The summary statistical performance of CNO-Gridded extrapolating technique could serve as benchmark for future blending work of GFS model and extrapolating for oceanic convection in 1-8 hr time frame