80 likes | 97 Views
Verification, Post-Processing, and Product Generation Branch Update December 3 , 2018. Jason Levit Chief, Verification, Post-Processing, Product Generation Environmental Modeling Center. National Weather Service. VPPPG Branch Introduction. Established in May 2017 after EMC re-org.
E N D
Verification, Post-Processing, and Product Generation Branch Update December 3, 2018 Jason Levit Chief, Verification, Post-Processing, Product Generation Environmental Modeling Center National Weather Service
VPPPG Branch Introduction • Established in May 2017 after EMC re-org • Observation decoding • Quality Control • Archiving • Independent model evaluations • Model Evaluation Group (MEG) • Real-time verification • Unified Post Processor • Manages model output • WAFS aviation products
FY18 Main Accomplishments • FV3GFS Evaluation • Most comprehensive model evaluation in NWS history • RAP/HRRR Evaluation • Metrics and Test Plan workshop • METplus testing and validation • New observational data sets implemented • FV3GFS Support • Dozens of new variables to support user requests • Outreach visits • CCPA and WAFS implementations
FY19 Main Goals and Updates • Phase 1/Phase 2 -> Phase 3 WCOSS transition support • GEFS evaluation • GFS advanced physics testing evaluation • Coupled model validation • RAP/HRRR/FV3CAM evaluation • EMC Verification website refinement and updates • ObsProc/UPP re-engineering efforts • VSDB - > METplus transition • METViewer/METExpress on cloud pilot project
Unified Forecast System Integration • Major software re-engineering efforts to start in VPPPGB funded by Hurricane Supplemental • Supports acceleration of observational data sets and new post-processed variables -> current major roadblocks • Observation Processing – code dates back to 1980’s. Major overhaul and refresh • Unified Post Processor – code dates back to 1990’s. Overhaul and integrate the Weather Information Statistical Postprocessing System
Metrics and Test Plan Workshop • Community-based workshop to investigate common metrics and test plans for the Unified Forecast System • Strategic Implementation Plan working groups participated to outline community-vetted and peer-reviewed metrics to be used by NWP developers • Initial model development test plan created by participants in breakout sessions • Further workshops needed to refine metrics and test plan
METViewer/METExpress on cloud services pilot project • FY19 pilot project • Collaboration with MDL • METViewer and METExpress UI and database on cloud • Amazon Web Services • Funded by STI • Specs: • 5TB of disk for database • Medium-sized server • Perfect example of a cloud-based solution! • Significant cost savings over bare iron
Long Term Challenges • I/O engineering for Production Suite – Warn on Forecast is challenging • Accelerating new observation data sets into operations • Model Evaluation Group – increasing workload and field support, currently 2.5 FTEs • “Holy grail” of verification – single metrics to explain performance (choose wisely)