1 / 37

A PERFORMANCE EVALUATION OF THE ETA - CMAQ AIR QUALITY FORECAST MODEL FOR THE SUMMER OF 2004

A PERFORMANCE EVALUATION OF THE ETA - CMAQ AIR QUALITY FORECAST MODEL FOR THE SUMMER OF 2004. CMAS Workshop Chapel Hill, NC 20 October, 2004. Contributors Brian Eder Daiwen Kang Tanya Otte Hsiu-mu Lin Jon Pleim Shaocai Yu George Pouliot STC Ken Schere Jeff Young ASMD

emele
Download Presentation

A PERFORMANCE EVALUATION OF THE ETA - CMAQ AIR QUALITY FORECAST MODEL FOR THE SUMMER OF 2004

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. A PERFORMANCE EVALUATION OF THE ETA - CMAQ AIR QUALITY FORECAST MODEL FOR THE SUMMER OF 2004 CMAS Workshop Chapel Hill, NC 20 October, 2004

  2. Contributors Brian Eder Daiwen Kang Tanya OtteHsiu-mu Lin Jon PleimShaocai Yu George PouliotSTC Ken Schere Jeff Young ASMD ARL, NOAA All: On assignment to NERL, U.S. Environmental Protection Agency Disclaimer: “The research presented here was performed under the Memorandum of Understanding between the U.S. Environmental Protection Agency (EPA) and the U.S. Department of Commerce's National Oceanic and Atmospheric Administration (NOAA) and under agreement number DW13921548. Although it has been reviewed by EPA and NOAA and approved for publication, it does not necessarily reflect their policies or views.

  3. Domain Lambert Conformal Projection Models-3 CMAQ 142 ForecastConfiguration - Eta Meteorology - CBIVMechanism - SMOKE Emissions (Offline) - 12 km grid resolution - 22 Vertical Layers - 48 Hr. Forecast (12Z Init.) Simulation Period - 1 May – 30 September 2004 - 1 June – 30 September 2004 (presented here) 166

  4. This performance evaluation used: Hourly O3 (ppb) from EPA’s AIRNOW network: - over 600 stations (mostly urban) - for a four month period (J, J, A, S) A suite of statistical metrics for: - discrete forecasts (MB, NMB, RMSE, NME) - categorical forecasts(A, B, POD, FAR, CSI) of hourly, max. 1-hr and max. 8-hr O3 (presented here).

  5. Discrete Forecast / Evaluation • [Observed] versus [Forecast] • Statistics • - Summary • - Biases MB • NMB • - Errors

  6. Category Forecast / Evaluation Observed Exceedances, Non-Exceedances • versus • Forecast Exceedances, Non-Exceedances Forecast Exceedance No Yes No Yes Observed Exceedance a b c d

  7. Forecast / Evaluation Monthly summaries: - June, July, August, September - Both Discrete and Categorical evaluation Daily summaries: - August 4 -12, Discrete evaluation - Examine performance over a full synoptic cycle - Illustrating both good and poor model performance

  8. Meteorological Conditions for the Summer (J, J, A) 2004

  9. Meteorological Conditions for the Summer (J, J, A) 2004 Temperature Precipitation

  10. Monthly Summaries

  11. June Summary a b c d

  12. June Summary CorrelationMean Bias (ppb) NMB (%) NME (%)

  13. June Summary 1 15 30

  14. June Summary Bias Error 1 15 30

  15. July Summary

  16. August Summary

  17. September Summary

  18. Daily Summaries

  19. .01 0.5 1.0 2.0 3.0 Synoptic Scale Meteorology 4 August 20:15

  20. 48 Hour Max. 8-Hour OzoneForecast Init: 3 Aug (12 Z) Valid: 4 Aug TP (04 Z to 03 Z) Model performance is poorer along the cold front where cloud cover and heavy rain dominate

  21. .01 0.5 1.0 2.0 3.0 Synoptic Scale Meteorology 5 August 20:15

  22. 48 Hour Max. 8-Hour OzoneForecast Init: 4 Aug (12 Z) Valid: 5 Aug TP (04 Z to 03 Z) Model performance is still poor along the cold front where cloud cover and heavy rain dominate

  23. .01 0.5 1.0 2.0 3.0 Synoptic Scale Meteorology 6 August 20:15

  24. 48 Hour Max. 8-Hour OzoneForecast Init: 5 Aug (12 Z) Valid: 6 Aug TP (04 Z to 03 Z) Model performance is very good throughout the domain, except for sections of New England and southeast Ontario, where cloud cover is greatest.

  25. .01 0.5 1.0 2.0 3.0 Synoptic Scale Meteorology 7 August 20:15

  26. 48 Hour Max. 8-Hour OzoneForecast Init: 6 Aug (12 Z) Valid: 7 Aug TP (04 Z to 03 Z) Model performance is again very good, except for sections of New England, southeast Ontario and Wisconsin, where cloud cover is greatest.

  27. .01 0.5 1.0 2.0 3.0 Synoptic Scale Meteorology 8 August 20:15

  28. 48 Hour Max. 8-Hour OzoneForecast Init: 7 Aug (12 Z) Valid: 8 Aug TP (04 Z to 03 Z) Model continues to perform well as the cP airmass undergoes modification. Warmer temperatures allow for higher ozone values (mean observed up to 48.7). New England still has more cloud cover.

  29. .01 0.5 1.0 2.0 3.0 Synoptic Scale Meteorology 9 August 20:15

  30. 48 Hour Max. 8-Hour OzoneForecast Init: 8 Aug (12 Z) Valid: 9 Aug TP (04 Z to 03 Z) Good model performance continues, as the cP airmass continues to warm. Highest ozone values (52.9) observed on this day. Cloud cover in New England dissipates resulting in better model performance there.

  31. .01 0.5 1.0 2.0 3.0 Synoptic Scale Meteorology 10 August 20:15

  32. 48 Hour Max. 8-Hour OzoneForecast Init: 9 Aug (12 Z) Valid: 10 Aug TP (04 Z to 03 Z) Model performance degrades somewhat as cloud cover and precipitation increases over the domain, most notably with a cold front approaching from the Great Lakes and a low forming over south

  33. .01 0.5 1.0 2.0 3.0 Synoptic Scale Meteorology 11 August 20:15

  34. 48 Hour Max. 8-Hour OzoneForecast Init: 10 Aug (12 Z) Valid: 11 Aug TP (04 Z to 03 Z) Model performance continues to suffer over the Great Lakes area as cloud cover, precipitation and very cool temperatures dominate this region.

  35. .01 0.5 1.0 2.0 3.0 Synoptic Scale Meteorology 12 August 20:15

  36. 48 Hour Max. 8-Hour OzoneForecast Init: 11 Aug (12 Z) Valid: 12 Aug TP (04 Z to 03 Z) Model performance at its worst as extensive cloud cover, precipitation and very cool temperatures dominate the entire domain.

  37. Summary Model performed reasonably well over the four month period, despite anomalously cool and wet conditions. Performance was closely tied to meteorology: M very good performance when skies were generally clear and void of precipitation, M poorer when cloud cover and precipitation occurred.

More Related