NPOESS Data Exploitation (NDE) Status Update

1. NPOESS Data Exploitation (NDE) Status Update WG-CSAB Oct 2008 John Zapotocny Approved for Public Release Distribution Unlimited

2. Overview • Risk Reduction Strategy • Early centrals interface • Use current advanced sensor data • Collaboration via JCSDA • Infrastructure Enhancements • MetSat ingest and data storage redesign • Weather Data Analysis (WDA) program • Data Processing and Applications • Global high resolution cloud analysis • Regional high-res cloud forecasts

3. Risk Reduction Strategy Early Centrals Interface • IDPS Early Centrals Interface • Supports testing for AFWA internal applications • Improves the quality of the delivered IDPS by identifying issues early-on • IDPS development/test resources on-site to support AFWA’s software development process • IDPS software installed on AFWA equipment • AFWA staff training completed (Nov 07) • Independent testing by AFWA on-going • Canned test data (~2TB) transferred from replicated IDPS • Datasets are roughly 100x legacy volume

4. Risk Reduction Strategy Collaboration via JCSDA • JCSDA is AFWA’s primary vehicle for data assimilation capability development in preparation for NPOESS • 6 AFWA-funded projects directly related to NPP/NPOESS • Impact assessment of AIRS (CrIS proxy) in WRF • MODIS (VIIRS proxy) skin temperatures in Land Information System (LIS) • Integration of CRTM (will support NPP sensors) into LIS • Impacts of AMSU cloud-cleared, AMSU and AIRs cloudy radiances • Integrate MODIS/METOP cloud optical properties into WWMCA • Impact of VIIRS cloudy/precipitating radiances on WRF using GSI • AFWA migrating to GSI data assimilation engine for WRF • More effectively leverages community development • NCAR energized – provides transition path and synergy • More on-site presence at WWB through Visiting Scientist program • Currently 1 position increases to 3 for FY09

5. Risk Reduction Strategy Use of Current Advanced Sensor Data • MODIS • NPOESS data in HDF 5 format, MODIS data comes in HDF EOS format (precursor to HDF 5) and is a good proxy • Currently ingesting MODIS data via DREN (RDT&E only) • Continuing challenges with data feed from NESDIS - only partial data receipt via DATMS-U • METOP • MetOp on orbit and planned to fill third constellation requirement during NPOESS era • AFWA receiving 1km resolution AVHRR imagery data which is very valuable especially for snow cover products • Primary issues is 120+ min latency of MetOp data as this does not meet AFWA timeliness requirements for global cloud analysis

6. Infrastructure Enhancements Ingest and Data Storage • AFWA has redesigned ingest sub-system for NPOESS era • Data placed directly on SAN landing zone prior to processing to allow virus scanning before promoting to a trusted location for product generation and dissemination • Redesign enables ingest of MODIS and METOP data from DATMS-U network emulating NPOESS IDPS connection • Systems Engineering, Management, and Sustainment (SEMS) team worked with IDPS staff to design an efficient and secure connection between the IDPS and AFWA SAN • Initial connectivity pending Certification & Accreditation approval (ECD Dec 2008) • Connectivity required to support NPP system tests planned for Dec-Jan timeframe and early Spring 2009

7. Landing Shared Zone Data Environment Infrastructure Enhancements Ingest and Data Storage GOES-E/W POES, DMSP MTSAT Meteosat-7 Metop-A NOAA-18 “blind” Meteosat-8 MODIS data Satellite feeds KenCast Sun V40z Front end boxes MSG Dell front end boxes DATMS-U AFWA Central Storage WPMDS Emulates IDPS Emulates NPOESS Security Architecture Central APPS Server DMZ

8. Infrastructure Enhancements Weather Data Analysis Program • AFWA’s Weather Data Analysis (WDA) program will ingest, store, and disseminate NPOESS/NPP data • Technical challenges • Massive volume of time critical data, integration with existing WDA capabilities, relay of NPP data to Navy Centrals • Requirements to “slice & dice” incoming science data sets, sampling for spatial resolution, and AOI extraction to meet users requests • AFWA’s internal applications will migrate to HDF5 format usage and adjust to the granule based data of NPOESS/NPP • Vendor not yet on contract – becoming critical issue

9. Data Processing & Applications High Resolution Global Cloud Analysis • 6km global cloud analysis • MODIS polar orbiting satellite data coverage limits timeliness of cloud observations • DCF statistical model technique limits risk exposure to non-timely cloud observations • MODIS data latency is 2-5 hours from observation • Direct readout using Mark-Ivb offer possible faster delivery supporting near real-time regional cloud analyis • Land surface backgrounds (e.g. snow/ice and highly reflective desert conditions) negatively affect products • Need to continue updating AFWA land surface characterization capabilities

10. Data Processing & Applications High Resolution Global Cloud Analysis LINK: https://weather.afwa.af.mil/host_home/DNXM/SPECM/dcf.html

11. Data Processing & Applications High Resolution Regional Cloud Forecasts https://weather.afwa.af.mil/cgi-bin/aneph_data.cgi

12. Data Processing & Applications High Resolution Regional Cloud Forecasts LINK: https://weather.afwa.af.mil/host_home/DNXM/SPECM/dcf.html

13. Summary • AFWA working aggressively to prepare for NPP/NPOESS • Several Infrastructure, data processing, and application projects underway and planned • Leveraging collaborative development via JCSDA for NPOESS model data assimilation • AFWA will play important role in VIIRS Calibration & Validation (CalVal) • Goal: Achieve initial operational capability (IOC) for NPP-based processing by end of CalVal period

14. Questions?