320 likes | 336 Views
Operations and User Support. Presented by Jaime Daniels. STAR Operational and User Support Activities. Transition to Operations Processes Missions: Recent Research to Operations Transitions User Support and Interactions Science Maintenance. STAR’s Mission: Research to Operations.
E N D
Operations and User Support Presented by Jaime Daniels
STAR Operational and User Support Activities • Transition to Operations Processes • Missions: Recent Research to Operations Transitions • User Support and Interactions • Science Maintenance
STAR’s Mission: Research to Operations In-Situ Systems Product Validation To provide NOAA with scientific research and development that will accelerate the transition of state‑of‑the-art satellite data systems, products, and services to operations for use by land, atmosphere, ocean, and climate user communities Intersatellite Calibration Instrument Calibration
STAR’s Role Within NOAA STAR STAR STAR develops a diverse spectrum of complex environmental algorithms and software systems using data from a large number of orbiting operational satellites
The Product Lifecycle Spans Research to Operations R&D R&D products and applications via GIMPAP and GOES-R3 programs Applied Research & Development Exploratory Research Planning Design Development Code Development and Test Operations Planning Transitionto Operations Operations and Maintenance Retirement or Divestiture Smaller set of R&D products suitable for operations via PSDI program Transition from research to operations/ applications (via systematic transition steps per SPSRB process New products serve diverse and expanding user community Trusted delivery of products to diverse user community User Community Operations
Introducing the Satellite Product Services Review Board (SPSRB) • Representation from STAR, OSDPD, OSD • Provides oversight and guidance to manage the entire product life cycle process • From product development, transition into operations, enhancements, to retirement • Focuses on items ready to transition from research to operations • Repeatable processes and available tools in place that facilitate effective and timely transitions • STAR leverages the SPSRB process and tools to transition products into NESDIS operations CIOSS Research and Development CICS Research and Development CIMSS Research and Development CIRA Research and Development CREST Research and Development STAR Research and Development OSD Systems Planning SPSRB Research to Operations Transition EPA Operations AWC Operations OSDPD Operations NHC Operations NOS Operations NCEP Operations NWS Operations
SPSRB Process Key Process Steps Interfaces to Resources Program Interfaces
SPSRB Tools User Request Form SPSRB Decision Briefs Product Devel Proposals Project Plans Declaring Product Operational Request Tracking System SPSRB Web Site http://projects.osd.noaa.gov/spsrb/ STAR leverages the SPSRB process and tools in its efforts to transition new and enhanced products into NESDIS operations
STAR’s Enterprise Product Lifecycle (EPL) Process Extract Maturity Level 3 practices • STAR is developing a robust Systems Engineering Process (SEP) aimed at minimizing risks associated with the transfer of algorithms and software from research to operations • Adoption of Capability Maturity Model Integration (CMMI) Maturity Level 3 practices tailored for use in • The NESDIS research-to-operational environment • Large satellite acquisition programs • Extensive set of review and document guidelines, procedures, standards, and training documents have been prepared • EPL process is currently being used on a variety of STAR projects STAR Enterprise Product Lifecycle (STAR EPL) • STAR EPL Process Assets: • Document Guidelines • Review Guidelines • Review Checklists • Task Guidelines • Stakeholder Guidelines • Training Documents STAR projects currently utilizing the EPL process assets GOES-R Algorithm Working Group IASI Level-1 Products NDE/ NUCAPS
Application of STAR EPL to the GOES-R AWG Program Ocean Dynamics Team Soundings Team Winds Team Imagery Team Aerosol Air Quality Team Clouds Team Algorithm Integration Team Hydrology Team Aviation Team Land Team Radiation Budget Team SST Team Lightning Team Cryosphere Team • EPL Processes • Initial Requirements Analysis • Algorithm Design Review • Critical Design Review • Test Readiness Review • Code Unit Test Review • Algorithm Readiness Review • EVM Reporting (monthly) • Outcome • Algorithm Packages • Algorithm Theoretical Basis • Documents (ATBD) • Instrument proxy datasets • Product output datasets • Algorithm Interfaces and • Ancillary Data Description • (AIADD) document • Delivered on time and under budget: • September 2008 • - As-Is ATBDs • September 2009 • - 80% APs for Baseline • Products Execute & Follow • EPL Standards • Algorithm Theoretical Basis • Document • Metadata (FGDC guidelines) • Interface Control • System Description • Users Manual • Fortran Programming • C/C++ Programming • Test Plan • Algorithm Implementation • Instructions • Latency Reports AWG adherence to EPL processes and standards in its algorithm development activity has reduced the risk associated with the development and delivery of high quality Level-2 product algorithms to the GOES-R program
STAR’s EPL Process: The Way Forward • Keep CMMI Maturity Level 3 as the goal for STAR process improvement • Provides a defined goal, so maintains discipline • Encourages process visibility across a broader range of projects • Analysis and experience with STAR pilots indicates that this goal is reasonable and attainable • Version 3.0 of the STAR EPL Process Asset Library (in progress) will define a complete CMMI Maturity Level 3 process • Proceed with deployment on additional STAR pilots, at current level of expenditure • Collect data for a final decision on its institutionalization at STAR and integration within the SPSRB process • Benefits to projects • Benefits to STAR organization • Resource requirements and availability
Missions Recent Research to Operations Transition Examples…
Transition of Envisat MERIS Chlorophyll-aOcean Color Products to Operations • Declared operational by SPSRB in Jan 2009 • MERIS reduced resolution L2 swaths, with ESA calculated chlorophyll data, are downloaded daily from the ESA rolling archive for 7 CoastWatch US coastal regions. • Chlorophyll-a and chlorophyll-a anomaly products are generated • Composite image products are produced and distributed via Coastwatch web server • Coastwatch is presently working on making MERIS full-res data to U.S. waters available (coordinating with CSA, OSU et al.) • Coastwatch submitted request to become a “Champion User” for the ESA Coast Colour Project http://coastwatch.noaa.gov STAR’s ocean scientists’ efforts have resulted in the generation and flow of NOAA operational ocean color products to the Coastwatch user community.
Transition of ASCAT Ocean SurfaceWind Products to Operations • Declared operational by SPSRB in June 2008 • Advanced scatterometer is aboard EUMETSAT’s METOP-A satellite • ASCAT surface wind products generated at 25km and 50km resolution • Applications • Marine analysis and forecasting • Numerical Weather Prediction Available on AWIPS for NWS forecasters Positive impact on NCEP GFS forecast accuracy (Courtesy Jung et al; JCSDA) STAR’s ocean scientists’ efforts have resulted in the generation and flow of operational ASCAT ocean surface wind products to the user community
Transition of MODIS and AVHRR Polar Winds Products to Operations • SPSRB operational declaration • MODIS winds (2004) • NOAA-AVHRR winds (Nov 2008) • METOP-AVHRR winds (Jan 2009) • Cloud-track winds derived using the AVHRR window (10.8um) channel measurements from successive METOP orbits • METOP AVHRR wind products generated approximately every 2 hours over Arctic and Antarctica • AVHRR winds derived from 4 NOAA satellites and 1 EUMETSAT satellite provide complete polar coverage and excellent temporal sampling. • Compliment operational MODIS polar wind products NOAA-18 AVHRR cloud-drift winds METOP-AVHRR cloud-drift winds Terra MODIS winds MODIS Winds Impact on GFS Forecast Skill STAR scientists’ efforts have resulted in operational AVHRR wind products that provide key wind information in the polar regions and serve as a vital data source for Numerical Weather Prediction.
Transition of IASI Sounding Products to Operations Retrieved Temperature Retrieved Moisture Retrieved CO IASI hyper-spectral measurements and products are used to improve knowledge of temperature, moisture, ozone, for both weather and climate applications. IASI radiances have been demonstrated to improve global weather prediction forecasts and trace gas products are useful to the climate community. • Declared operational by SPSRB in June 2008 • Infrared Atmospheric Sounding Interferometer (IASI), is a hyperspectral infrared sounder residing on the European Space Agencys (ESA) MetOp series of polar orbiting satellites. • Products include: • Thinned radiances • Principal component scores • Cloud cleared radiances • Trace gases (CO,CH4,CO2) • Carbon products • Temperature profiles • Moisture profiles • Ozone profiles • The STAR developed product processing system includes a continuous validation component
Virtual Institute for Satellite Integration Training (VISIT) • STAR scientists have contributed to the development of satellite-based training material for the VISIT program • The primary mission of VISIT is to accelerate the transfer of remote sensing research into NWS operations • VISITview, a distance learning tool, is used to train National Weather Service (NWS) forecasters on new operational satellite-based products User Training
NOAA CoastWatch / OceanWatch Ocean Color Products SST Ocean Surface Winds • STAR leads the NOAA CoastWatch Program which facilitates the development and transition of satellite ocean remote sensing products from research into operations • CoastWatch partnership • NESDIS OSDPD and NODC • NOAA line offices (NMFS, NOS, OAR, NWS) • Supports a number of national and regional coastal activities and applications • Integrated Ocean Observing System (IOOS) • Chesapeake Bay, Southern California
NOAA CoastWatch / OceanWatch Applications: • Fisheries Management • Vessel positioning (NMFS) • Climate • Ocean color CDR and reprocessing • Commercial utilization / redistribution / recreation • Environmental Quality • NOAA operational HAB Forecasts
NOAA CoastWatch / OceanWatch Coverage / Systems / Timeliness • Coverage • 12 regions (6 coastal, 6 open ocean) • Northern hemisphere • Timeliness • 12 regions (6 coastal, 6 open ocean • Northern hemisphere • Systems • Polar (NOAA, MODIS, Envisat, SeaWifs, ASCAT, QuickScat, DMSP) • Geostationary (NOAA, MTSAT, MSG) • Users • 8000 registered users in 2001. • Registration discontinued 2003 • Today 4000 unique IP hits per month • IOOS: via THREDDS Data Server (http://coastwatch.noaa.gov/thredds) CoastWatch Ocean color are made available in near real time for all CoastWatch regional areas.
NOAA Coral Reef Watch Ocean Color Products SST Ocean Surface Winds • STAR’s satellite-based product suite is a key aspect to NOAA's monitoring system for coral reef ecosystems, the Coral Reef Ecosystem Integrated Observing System (CREIOS) • NOAA's Coral Reef Watch Program's satellite products received from STAR provide current reef environmental conditions to quickly identify areas at risk for coral bleaching
NOAA Coral Reef Watch Products Operational 2002 2002 2002 2003 50km Nighttime Sea Surface Temperature (SST) 2009 SST Anomaly Coral – specific HotSpot Degree Heating Week Bleaching Alert Areas http://coralreefwatch.noaa.gov 24
====================================================================================================================================== ** [CRW Alert 20070711] Sombrero Reef: Bleaching Warning =================================================================== Satellite observations: 9 July 2007 - 11 July 2007 -- Bleaching Degree Heating Weeks : 0.5 Deg C-week -- Historical Maximum Degree Heating Weeks : 9.2 Deg C-week (2005) -- Coral bleaching HotSpot : 1.0 Deg C -- Sea surface temperature : 30.3 Deg C -- Maximum Monthly Mean SST at site : 29.3 Deg C Previous Three Alerts for Sombrero Reef: --06/25/2007 Bleaching Watch --10/07/2006 No Stress --09/11/2006 Bleaching Watch Reef site name: Sombrero Reef SST Pixel latitude: 25.0 SST Pixel longitude: -81.5 Current Status: Bleaching Warning =================================================================== Automatic Satellite Bleaching Alerts NOAA Coral Reef Watch ProductsData Delivery Virtual Stations Currently available for 190 sites > 370 subscribers
Climate Change Workshops NOAA Coral Reef Watch ProductsUser Training • Six “Responding to Climate Change” workshops conducted: • Australia, American Samoa (2007) • Florida Keys, Hawaii (2008) • Bonaire, Guam (2009) • Based on “A Reef Manager’s Guide to Coral Bleaching” • Trained over 120 coral reef scientists and managers on: • Climate change issues and impacts on coral reefs • Predicting mass coral bleaching • Assessing bleaching, resilience, and socio-economic impacts • Building resilience via MPAs and Response Plans • Communicating about bleaching event • FY10 workshop to be conducted in USVI 26 26
STAR Capabilities Support Operations and User Community Interactions Integrated Satellite Calibration/Validation System STAR Collaborative Processing Environment • Extensive visualization and Cal/Val Tool Suite is the foundation for • Monitoring the quality of instrument and products data in NOAA’s satellite operations • Providing users with quantitative assessments of instrument and product data • Development of new and enhanced products • Experimental parallel product processing systems enable the • Development of new and enhanced products for operations • Resolution and testing of problems associated with operational instrument and/or product data • Distribution mechanisms that enable user exploration of STAR products • Web pages; FTP sites Core STAR capabilities enable the development and effective monitoring of NOAA’s satellite products and an informed user community.
Science MaintenanceLaunch Support • Assess the quality of instrument radiance data. • Compare to other satellite measurements • Calculate the signal-to-noise ratio and compare to specifications • Assess the striping in the imagery due to multiple detectors • Update and tune Level-2 product algorithms for new instruments • Generate Level-2 products and assess their performance against • Same products from other satellites • In-situ and/or analysis data • Collect imagery and data of interesting weather cases for future studies First GOES-14 Full Disk Visible Image NOAA-N’ prelaunch analysis of instrument noise performance GOES-14 Clear-sky BT Product Launch support provided by STAR scientists enables characterization of instrument and Level-2 product performance that ensures operational readiness when new satellite is called into operational service.
Science MaintenanceReactive Science Support GOES-12 Sounder Band 14 At 17 UTC 25 Nov 09 GOES-12 Sounder Retrieved TPW At 17 UTC 25 Nov 09 STAR scientists determine detector 2 is noisy GOES-12 Sounder Band 14 At 18 UTC 25 Nov 09 GOES-12 Sounder Retrieved TPW At 18 UTC 25 Nov 09 STAR scientists assessed impact of shortwave noise on retrieved products and formulated algorithm alternatives Increased shortwave band noise levels first observed by STAR scientists • STAR provides science maintenance support to NESDIS operation • STAR achieves this by leveraging its Visualization AND Cal/Val tool suite and its product processing infrastructure • STAR identifies issues and develops corrective actions to operational product systems for anomalous instrument and/or science related conditions • STAR coordinates its activities with OSO, OSPPD, and the user community Reactive science maintenance support provided by STAR scientists to NESDIS operations helps ensure the integrity and flow of operational products to the user community.
Science MaintenanceReactive Science Support • STAR provides science maintenance support to NESDIS operations • STAR achieves this by leveraging its Visualization AND Cal/Val tool suite and its product processing infrastructure • STAR identifies issues and develops corrective actions to operational product systems for anomalous instrument and/or science related conditions • STAR coordinates its activities with OSO, OSPPD, and the user community Nighttime AVHRR – Reynolds SST STAR scientists observe NOAA-16 SST anomalies reach up to 1 K STD of Cal slope in AVHRR Ch4 Analysis confirms that SST anomalies are correlated to calibration anomalies in thermal IR bands. STAR SST and calibration teams work together with OSO to resolve the problem Reactive science maintenance support provided by STAR scientists to NESDIS operations helps ensure the integrity and flow of operational products to the user community.
SUMMARY • The development and transition of state‑of‑the-art satellite data systems, products, and services to operations is a key mission of STAR • Defined and repeatable research to operations transition processes are vital to successfully transfer new and enhanced products to operations • Existing SPSRB process • STAR-led Enterprise Product Lifecycle process improvements • STAR scientists’ efforts contribute to a significant number of successful product transitions from research to NESDIS operations • Core STAR capabilities enable the development and effective monitoring of NOAA’s satellite products and an informed user community • Cal/Val tool suite • Processing environment • Science maintenance support provided by STAR scientists to NESDIS operations helps ensure the integrity and flow of operational products to the user community • Launch support • Reactive science support