1 / 20

Verification tools at the Norwegian Meteorological Institute

Verification tools at the Norwegian Meteorological Institute. By Helen Korsmo EGOWS 2004. PRODUCTION AND VERIFICATION OF POINT FORECASTS AT met.no. Observations. Intranet verification portal. Model output. Quba databases. Verification by email. Quba Editor. Forecaster.

kimberly
Download Presentation

Verification tools at the Norwegian Meteorological Institute

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Verification tools at the Norwegian Meteorological Institute By Helen Korsmo EGOWS 2004

  2. PRODUCTION AND VERIFICATION OF POINT FORECASTS AT met.no Observations Intranet verification portal Model output Quba databases Verification by email Quba Editor Forecaster VePS Verification Presentation System Newspapers TV www.met.no

  3. Production of point forecasts - Quba • 3 regional offices produce forecasts for a total of about 140 locations with Quba editor. • One central production database for subjective forecasts, model output and observations. • Forecasters log on to the database, personal verification is possible. • All data copied to separate historical database for verification purposes.

  4. Quba editor Weather, temperature, and wind forecasts edited on the map or in tables. Bidirectional communication with the database.

  5. Why verify? The three most important reasons to verify forecasts are: • to improve forecast quality - the first step toward getting better is discovering what you're doing wrong. • to compare the quality of different forecast systems - to what extent does one forecast system give better forecasts than another, and in what ways is that system better? • to monitor forecast quality - how accurate are the forecasts and are they improving over time? (from http://www.bom.gov.au/bmrc/wefor/staff/eee/verif/verif_web_page.htm)

  6. Verification at met.no • Daily batch jobs producing • verification results for the intranet • personal verification – sent automatically by email • VePS user interface is under development • Verification of models and of subjective forecasts. • Meteorologists can learn how they perform compared to the models and which models are best to use as a starting point.

  7. The intranet verification portal Verification results for the following parameters are updated daily and are available on our intranet:Temperature, wind, cloud cover, precipitation, weather symbol and geopotensial height.Timeseries and tables of observed values versus NWP model forecasts and subjective forecasts, as well as computed MAE,RMS and BIAS values are available for most synop stations.

  8. Verification portal example(1)

  9. Verification portal example(2)

  10. Verification portal example(3)

  11. Verification portal example(4)

  12. Personal verification by email

  13. Personal verification by email Every day the forecaster that made the forecast receives an email comparing his or hers subjective temperature forecast with observations and with various NWP models. |∆T|≤ 1 ºC  1 point |∆T| ≤ 2 ºC  1/2 point |∆T|> 2ºC  0 points A grade is calculated from the ratio of total score to the maximum possible. The same is done for the NWP forecasts so the forecaster can compare how well he is doing compared to the models, where he could improve etc. The scores are only available to the forecaster that made the forecast and are not meant for the bosses…

  14. VePS –Verification Presentation System • Graphical user interface to produce verification results on demand. • Forecasts and observations read from the Quba historical database in real time. • Forecasters log in to check their own verification results. • Timeseries, contingency tables, scatterplot, geographical distribution produced according to user spesifications. • The system is connected to the meteorological workstation Diana,where the verification results are displayed on the map.

  15. Map dialog(1) Forecasted/observed weather symbol

  16. Map dialog(2) Temperature bias for a chosen period

  17. Diagram dialog(1)Observed/Hirlam/subjective temperture

  18. Diagram dialog(2)Hirlam/subjective temperature RMS

  19. Verification in Quba Editor Verification results for each station is produced twice a day. Show how the previous forecast performed, + statistics (RMS,bias,MAE). Info is shown while forecast for this station produced.

  20. Future plans • 2004 • Scatterplots and contingency tables will also be available in VePS. • 2005-2006 • Verification of text forecasts: Today one of our most important product is the text forecasts, which is not verified. A text forecast editor/generator will be made, which renders the text forecasts more verifiable.

More Related