1 / 18

The Assessment of Seasonal Forecast Skills from the Canadian HFP

Outline. Introduction Model and Data Results ● Deterministic skills ● Probabilistic skills 4. Summary. The Assessment of Seasonal Forecast Skills from the Canadian HFP. Q. Teng 1 , S. Kharin 1 , F. Zwiers 1 and X. Zhang 2.

jfosdick
Download Presentation

The Assessment of Seasonal Forecast Skills from the Canadian HFP

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Outline • Introduction • Model and Data • Results • ● Deterministic skills • ● Probabilistic skills • 4. Summary The Assessment of Seasonal Forecast Skills from the Canadian HFP Q. Teng1, S. Kharin1, F. Zwiers1 and X. Zhang2 1Canadian Centre for Climate Modelling and Analysis, Meteorological Service of Canada 2CCRM, Climate Research Branch, Meteorological Service of Canada

  2. multi-model ensemble prediction ► initial conditions; ensemble prediction ► model error multi-model prediction ► deterministic measures: e.g., mean square error (MSE); root mean square error (RMSE); root mean square skill score (RMSSS); anomaly correlation coefficient (ACC) etc. ► probabilistic measures: e.g., Brier score (BS); Brier skill score (BSS); attributes (or reliability) diagram; relative operating characteristic (ROC) and its skill score etc. Introduction ●Basic premise: Slow variations in lower-boundary forcing (e.g., SST; sea-ice cover and temperature; land surface). ●Main sources of error: ●Forecast verification:

  3. ●Verification datasets: NCEP/NCAR (Kalnay et al. 1996) and ERA-40 (Simmons and Gibson 2000) reanalyses fields ●Variables: Z500 ,T700 & T2mfor MAM, JJA, SON, DJF; (1969-1995) Model and Data ●Model Output

  4. GCM2 SEF GEM GCM3 Bias -- Z500 (DJF)

  5. NAM NEX TR GL ERA-40 purple: GCM2 green: SEF yellow: GEM red: GCM3 RMSE -- Z500 NCEP North America (NAM): 20° - 80°N, 150° - 45°W; Northern Extra-tropics (NEX): 30° - 87.5°N, 180°E - 180°W; Tropics (TR): 30°S - 30°N, 180°E - 180°W; Globe (GL): 87.5°S - 87.5°N, 180°E - 180°W. Canada (CA): 40° - 87.5°N, 150° - 45°W; Pacific-North-America (PNA): 20° - 80°N, 180° - 60°W; Northern Hemisphere (NH): 0° - 87.5°N, 180°E - 180°W;

  6. NAM NEX TR GL Z500 GCM2; SEF; GEM; GCM3 T700 T2m RMSE

  7. is the MSE of probability forecast; where is the forecast probability; is the event variable: Brier Score (BS) and Brier Skill Score (BSS) ●BS ●BSS

  8. Where Brier Skill Score (BSS) -- Cont’d ●BSS ●Three methods to estimate P (Kharin and Zwiers 2003):

  9. BSS -- Z500 & T700

  10. BSS -- Z500 North America BNNNAN MAM JJA SON DJF

  11. BNNNAN MAM JJA SON DJF BSS -- Z500 Tropics

  12. BSS -- Time Series (DJF Tropics) Years The year refers to the Dec. of the corresponding winter.

  13. Where is the number of probability bins; denotes the total number of forecast/event pairs; represents the number of times each probability forecast is used; is the observed sample relative frequency; is the observed overall relative frequency or sample climatology. Decomposition of BS Following Murphy (1973), the BS can be expressed as: reliability resolution uncertainty

  14. Attributes Diagram -- T2m Tropics (DJF) Count Gaussian Improved

  15. ROC -- Z500 North America (DJF) Count Gaussian Improved

  16. ROCSS Z500T700 T2m

  17. Summary ●The identity of the best single model varies; ●The multi-model ensemble is superior to the single model ensembles; ●The raw Gaussian fit method is generally better than the count method, while the statistically improved technique may not always be beneficial.

  18. Acknowledgments Juan-Sebastian Fontecilla, Normand Gagnon, Fouad Majaess and Steve Lambert.

More Related