1 / 18

U.S. IOOS MODEL VALIDATION CAPABILITY SURA SUPER-REGIONAL TEST BED

U.S. IOOS MODEL VALIDATION CAPABILITY SURA SUPER-REGIONAL TEST BED. Jeff Hanson US Army Corps of Engineers, Field Research Facility, Duck, NC. USACE Field Research Facility. Working across agencies to bring observations and models together in a natural coastal laboratory….

manon
Download Presentation

U.S. IOOS MODEL VALIDATION CAPABILITY SURA SUPER-REGIONAL TEST BED

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. U.S. IOOS MODEL VALIDATION CAPABILITY SURA SUPER-REGIONAL TEST BED Jeff Hanson US Army Corps of Engineers, Field Research Facility, Duck, NC USACE Field Research Facility Working across agencies to bring observations and models together in a natural coastal laboratory…

  2. SURA SUPER-REGIONAL TEST BED Don Wright (SURA), Yesterday… Test Bed Goals Develop skill metrics and evaluate model performance… Year 1 Products Skill metrics and identification of key performance factors for test bed modeling regimes…

  3. Inundation Modeling Systems Atmosphere Research Storm Surge Waves Circulation SURA Server Inundation Modeling Test Bed Skill Assessment Concept Regional Observations Analysis Interactive Model Evaluation and Diagnostics System Performance Evaluation Model Diagnostics

  4. Graphical User Interface

  5. Features • Stand-alone desktop model validation toolkit • Based on published NOAA standards (Hess et. al., 2003; Zhang et.al., 2006). • Robust error metrics: Erms, bias, Scatter Index, Skill Score • Explore model errors as a function of time, space, event, etc. Performance Scores • Performance scores range from 0 to 1 (1 is a perfect match) • Synthesize error metrics across space and time • Normalized to mean observed quantities • A measure of error % relative to mean observed quantities

  6. Parameters Added To-Date Winds Waves(Windsea and swell) Storm Surge Speed, Direction Height, Period, Direction Water level, High water marks Error Metrics Statistical Analyses Coming Soon • RMS Error • Bias, Angular bias • Scatter Index • Circular correlation • Performance (Skill) Scores • Temporal correlation • Quantile-Quantile (distributions) • Peak event (peak over threshold) • Target Plots IMEDS Error Analyses

  7. IMEDS Error Metrics For n pairs of measurement (m) and hindcast (h) data… Bias RMS Error Scatter Index Reference: Hanson, Tracy, Tolman and Scott, 2001. J. Oce. Atms. Tech., 26, 1614-1633

  8. IMEDS Error Metrics And for directional data… Angular Bias Circular Correlation Reference: Hanson, Tracy, Tolman and Scott, 2001. J. Oce. Atms. Tech., 26, 1614-1633

  9. IMEDS Skill Scores Scores are computed relative to mean observed quantities Bias Skill Scores range from 0 to 1 1 = perfect agreement 0 = totally uncorrelated RMS Error Skill Scatter Index Skill Average the 3 scores Station Skill Combine station scores using sample size weights Total Skill

  10. Peak Event Analysis Peak Over Threshold Extraction Peak Event Statistics

  11. FEMA Region III Storm Surge Project Hurricane Isabel Max Water Levels

  12. FEMA Region III Storm Surge Study: Hurricane Isabel September 2003

  13. FEMA Region III Storm Surge Study: Nor’Ida November 2009

  14. Supported Data Formats Model Output Observed Data • NDBC buoys • NODC wind/wave stations • NOS – includes detide option • IMEDS Generic Format • WW3 (*spc) • SWAN (spec2d.out & TAB(opt)) • ADCIRC Water-Level (fort.61) • ADCIRC Wind (fort.72) • Extract from SURA OpenDAP Server (netCDF file) • IMEDS Generic Format

  15. IMEDS Generic Format Sample File % IMEDS generic format version 1.0 – water-elevation % year month day hour min watlev (m) NOS UTC NAVD 8635750 37.9950 76.4650 2009 11 9 0 0 0.2440 2009 11 9 1 0 0.1580 2009 11 9 2 0 0.0530 2009 11 9 3 0 -0.0310 2009 11 9 4 0 -0.1000 5461421 36.8432 73.5591 2009 11 9 6 0 -0.1520 2009 11 9 7 0 -0.0900 2009 11 9 8 0 0.0140 Station Data Station Data

  16. IMEDS Set Up GUI Sample File

  17. Accomplishments to Date • IMEDS posted on SURA Server with illustrated users guide • Develop data interface to SURA OpenDAP server • Implement generic text file interface • User-defined graphics export formats (jpeg, png, fig, etc…) • Prototype Target Plot

  18. Want to use IMEDS? • Download IMEDS from SURA Server • Review fully illustrated users guide • Ensure observation data are in native format (NOS, NODC, etc) or IMEDS Text format • Export model results in IMEDS generic text format • Seek help as needed from CI group and/or USACE • Put IMEDS to work for you!

More Related