1 / 24

Status Report on NOAA’s NPOESS Data Exploitation (NDE) System

Status Report on NOAA’s NPOESS Data Exploitation (NDE) System. Presented by Jim Yoe 1 Contributions from Geof Goodrum 1 , Jim Silva 1 , and Tom Schott 1 1. NOAA/NESDIS Office of Systems Development. Agenda. Background Status Hot Topics and Next Steps Summary. Background. 3.

hamish
Download Presentation

Status Report on NOAA’s NPOESS Data Exploitation (NDE) System

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Status Report on NOAA’s NPOESS Data Exploitation (NDE) System Presented by Jim Yoe1 Contributions from Geof Goodrum1, Jim Silva1, and Tom Schott1 1. NOAA/NESDIS Office of Systems Development

  2. Agenda • Background • Status • Hot Topics and Next Steps • Summary NDE Update COPC 10-21-09 WWB

  3. Background 3 NDE Update COPC 10-21-09 WWB

  4. Mission & Objectives NDE MISSION: Assist NOAA and other civilian end users to realize the potential of NPOESS observations • Program Objectives: • Coordinate NPOESS-related activities across NOAA • Assist with planning for implementation of NPOESS data by user systems • Ensure end-user preparedness for NPOESS data • Make Operational use of NPP data NDE Update COPC 10-21-09 WWB

  5. Mission & Objectives Operational System Objectives: Disseminate NPOESS Data Records to end users Generate and disseminate tailored NPOESS Data Records Generate and disseminate NOAA-unique products (augmented environmental products constructed from NPOESS Data Records) Deliver NOAA-unique products, product processing elements, and associated metadata to CLASS for long-term archiving Provide services to customers, including NDE product training, product enhancement across NOAA Provide software for NPOESS Data Record format translation and other data manipulations NDE Update COPC 10-21-09 WWB

  6. Status 6 NDE Update COPC 10-21-09 WWB

  7. System Development • Completed Software for NPP Ingest Build • Initiated Product Generation Build for NPP • Tested IDPS-NDE Interface with live data • Integrated 3 NUP Algorithm Packages in NDE’s Science Algorithm Development and Integration Environment • Established NDE Integration Lab (NIL) in NSOF • Tailoring Tool Evaluation/Selection completed • xDR to netCDF4 Translator Prototype delivered • Hardware and COTS SW acquired/installed • Dell Blade servers and Dell workstations • IBM Blade Center • StorNext SAN Filesystem NDE Update COPC 10-21-09 WWB

  8. NDE SW Build Schedule CY08 CY09 CY10 CY11 CY12 2nd Qtr 3rd Qtr 4th Qtr 1st Qtr 2nd Qtr 3rd Qtr 4th Qtr 1st Qtr 2nd Qtr 3rd Qtr 4th Qtr 1st Qtr 2nd Qtr 3rd Qtr 4th Qtr 1st Qtr NPP Launch “Work To” 16 Jan 2011 Initial Distribution Capability Aug 2010 NPP Launch Readiness Review Oct 2010 Ingest Product Generation Distribution Customer Services Monitoring & Reporting NDE’s initial build cycle will support NPP launch 8 NDE Update COPC 10-21-09 WWB

  9. Product Development • FY09 NOAA Unique Product Developments • CrIS/ATMS (aka NUCAPS) • Multiple Delivered Algorithm Packages (DAPs) to NDE (Apr, Jul, Aug 2009) • Simulated CrIS data delivered to netCDF4 tailoring tool team • Sea Surface Temperature • Requirements gathered • Preliminary Design Review (PDR) slated for December 2009 • Microwave integrated Retrieval System (MIRS) • Successful Preliminary Design Review (PDR) for NPP MIRS Sep 24 • DAP successfully integrated into NDE SADIE • NESDIS/STAR daily processing ATMS proxy data • netCDF4 reformatting Toolkit • Draft BUFR tables (ATMS, CrIS, VIIRS) delivered to NCEP for review • Successful PDR in May 2009 • DAP delivered to NDE in August 2009 NDE Update COPC 10-21-09 WWB

  10. Product Development FY10 NUP Priorities VIIRS Polar Winds Benefit: Numerical weather prediction (NWP) Forecasts can be extended 2-6 hrs, depending on the location, when the MODIS winds are assimilated Hurricane track forecasts are also improved Joint Center for Satellite Data Assimilation (JCSDA) International NWP Centers Satellite product: Atmospheric winds for Arctic and Antarctic regions Green Vegetative Fraction NDE Update COPC 10-21-09 WWB

  11. Systems Integration • Internal Coordination • Completed primary ICDs with CLASS and ESPC • Established Transition Team to plan for NPP Production • Communicating w/ NOAA Programs • CoastWatch, AWIPS Tech Infusion, NextGen, HMT, etc. • Participating in NPOESS TIMs, User Conclaves, Customer Forums • COPC, CSAB, and JAG/ODAA • NDE Lessons Learned shared with AFWA for WDA • Requirements, Design, COTs analysis/selections • Anticipate sharing system code for evaluation, potential re-use • Public Outreach • AMS, AGU, COMET WS, etc. • Initial Stakeholder Integration Team (SIT) in FY10 NDE Update COPC 10-21-09 WWB

  12. NWP SIT Project Objective Operational NWP user of CrIS Cloud-Cleared Radiances w/in 1 year of NPP Data Availability Continuity/Expansion of Polar contribution to NWP capability Participants NDE, JCSDA, NCEP/EMC, STAR, OSDPD, and IPO Leverages NDE Phase 1 Products NDE Re-formatting Project JCSDA ATMS assimilation IPO support for post-launch assimilation of CrIS radiances Sunset this SIT after 2 years Approach Use cloud clearing to increase fraction – and impact – of IR radiances used in global model Use AIRS data as CrIS proxy Milestones for FY10 Q1 Experiment Design Q1 Experiment Set-up Q2 Single season impact Mid-lat diagnostics Q3 Two additional seasons Full diagnostics incl. tropics Q4 Extend to IASI data Q4 Prepare NCEP pre-op test NDE Update COPC 10-21-09 WWB

  13. Hot Topics and Next Steps NDE Update COPC 10-21-09 WWB

  14. Hot Topics and Next Steps • NDE Development Contract Transition in FY10 • Documenting details of system design and configuration • Documenting skills required for key positions • NPP Ground System Interface Testing (GSIT) • Begins November 17 2009 • Test Planning Summit currently underway in Suitland, MD • NDE will only be able to test ingest, not processing • NDE has only 1 FTE for testing • IPO and NESDIS (ESPC and SSD) providing additional support • NOAA Mandate to use NPP data as if operational • NDE to identify/secure resources to harden NDE IT environments • NDE to Identify/secure resources to accelerate product development and integration NDE Update COPC 10-21-09 WWB

  15. Hot Topics and Next Steps (2) • Distribution Network Solution • Current bandwith out of NSOF too low for complete NPP data load • Out of NDE Project Scope • NDE advocating for solutions • Long term (2013) – NOAA enterprise network capability – C1 • Near term – Interim solution to deliver NPP data • Upgrade existing link(s)? • Quality of EDRs and impact on products/applications • Some NPOESS EDR algorithms outdated or unproven • NDE Relying on IPO and NESDIS/STAR cal/val to assess impact and rectify • Backup Data Access and Processing for C1 • NDE wants to begin serious discussions with AFWA, CSAB NDE Update COPC 10-21-09 WWB

  16. Summary 16 NDE Update COPC 10-21-09 WWB

  17. Summary • NDE on schedule and within budget • Good progress in all phases • System Development, Product Development, and Integration • Significant challenges remain • Potential disruption due to contract transition • Additional stresses due to “operational production” of NPP data • Adequacy of network capability for data distribution • Good cooperation in the context of COPC • DoD centrals development may be able to re-use NDE elements • DoD centrals welcome to subscribe to NUPs • Need to move ahead with planning for Back Up capability for C1 NDE Update COPC 10-21-09 WWB

  18. Contact For more information: 18 NDE Update COPC 10-21-09 WWB SoS Work Shop October 6-7, 2009 NDE

  19. Back Up Slides NDE Update COPC 10-21-09 WWB

  20. NPOESS OverviewNational Polar-orbiting Operational Environmental Satellite System Interface Data Processing Segment (IDPS) Processing Centers Command, Control, Communications Segment (C3S) NESDIS State 1: 2 sites HDF5 HDF5 HDF5 APs APs HDF5 APs RF APs AFWA State 1: Single Receptor (Svalbard) State 2: Multiple Receptors State 3: 15 Receptors NAVOCEANO State 2,3: 4 sites FNMOC Space Segment State 1: NPP State 2: NPP & NPOESS C1 State 3: NPOESS C1 &C2 NPOESS delivers a common set of global products to four US processing centers 20 SoS Work Shop October 6-7, 2009 NDE NDE Update COPC 10-21-09 WWB

  21. NDE Architecture Distribution Ingest Product User StorageArea Network Customer Services Product Generation User System Products pushed from NPOESS IDPS Registration & Order Management File Detection Production Rule Trigger Order Profiles NDE chose a Service Oriented Architecture to meet data processing requirements 21 NDE Update COPC 10-21-09 WWB

  22. NPP Phase 1 Legacy mission continuityreplacement products comprised of currently funded NUPs and xDRs NDE Update COPC 10-21-09 WWB

  23. NPP Phase 2 Additional legacy products and enhanced products comprised of NUPs and xDRs not linked to mission continuity NDE Update COPC 10-21-09 WWB

  24. NPP Not In Phase 1 or 2 NDE Update COPC 10-21-09 WWB

More Related