Building the SST Climate Data Record

1. Building the SST Climate Data Record • Kenneth S. Casey • NOAA National Oceanographic Data Center • Seattle, November 2010 1

2. The National Oceanographic Data Center (NODC) opened its doors on November 1, 1960 with only 29 employees who were tasked with compiling the large, disparate collections of oceanographic data into a single system. A few months later in January of 1961, NODC was formally dedicated by the Asst. Secretary of the Navy for Research and Development, James H. Wakelin, Jr. (pictured) In 1970, NODC was formally transferred from the U.S. Hydrographic Office to the newly formed National Oceanic and Atmospheric Administration (NOAA), under the U.S. Department of Commerce.

3. Building the SST CDR

4. The Way It’s Been NOAA SDS (A)RC GHRSST RAN-TAG GCOS SST/SI WG Acronym Soup + winds and ice

5. The Way It’s Been • Unorganized • Uncoordinated • Ad hoc • Piecemeal … Yet still productive! Progress on many fronts…

6. GCOS SST Intercomparison Connecting historical in situ and satellite records

7. GCOS SST Intercomparison Example: Linear trend comparisons – http://ghrsst.nodc.noaa.gov

8. SQUAM • http://www.star.nesdis.noaa.gov/sod/sst/squam/index.html

9. 2009 GHRSST Data Availability Still no progress Still no progress Getting closer for both GAC and HRPT

10. 2010 GHRSST Data Availability Complete, but not at LTSRF yet Plans now in place for reprocessing during 2013-14 Proposed to NASA ROSES (Vazquez) Getting closer for both GAC and HRPT

11. 2011 (?) GHRSST Data Availability Chris Metchant Andy Harris and Eileen Maturi Pierre LeBorgne Pierre LeBorgne Andy Harris and Eileen Maturi ChelleGentemann Jorge Vazquez Ken Casey and Bob Evans Peter Cornillon, Helen Beggs ChelleGentemann Anne O'Carroll

12. Now and Into the Future Now… • More Coordination • Clearer understanding of the interrelated pieces National programs: NOAA Climate Data Record Program (CDRP) and the ESA Climate Change Initiative (CCI). GHRSST RAN-TAG Coordination leading to…

13. The SST ECV Product Framework

14. The SST ECV Product Framework 1 km, sub-daily >= 25km, monthly

15. The SST ECV Product Framework MW Note that not all combinations are possible

16. The SST ECV Product Framework L0 layer is about data access!

17. The SST ECV Product Framework Thematic CDRs Fundamental CDRs

18. The SST ECV Product Framework User application requirements are fed into the framework

19. The SST ECV Product Framework From the framework emanate many user applications

20. The SST ECV Product Framework Special emphasis here at the skin

21. Clarifying the Connections This model is clarifying the connections and providing the basis for a systematic, sustained, coordinated global effort. Using the SST ECV Framework, the GHRSTS RAN-TAG established a list of prioritized actions necessary to begin piecing together the framework.

22. Piecing it Together • GHRST Prioritized List: • Begin production of Pathfinder V6, 1981-near present, in GHRSST L2 and L3 format, for GAC and available LAC/HRPT • Fix the calibration of AVHRR and AMSR-E to remove latitudinal and other biases before reprocessing of data sets  • Create MODIS retrospective data in GHRSST format • Complete ARC science for ATSR-1 to AATSR

23. Piecing it Together • GHRSST Prioritized List: • Assign proposed HadSST3 in situ bias adjustments on a per-observation basis to allow incorporation into GHRSST reanalysis products • Test and possibly integrate improved AVHRR BTs and/or physical retrieval methods into Pathfinder • Create GOES retrospective data in GHRSST format • Improve data discovery and access mechanisms at GDAC and LTSRF – Live Access Server and THREDDS Catalog

24. AVHRR Pathfinder

25. Pathfinder “Phases”

26. Current Status of PFV5 • 1981 through 2009, 4.6 km • Twice-daily, 5-day, 7-day, 8-day, and monthly • http://pathfinder.nodc.noaa.gov • FTP • HTTP • OPeNDAP • WCS and WMS via TDS, LAS soon • ttp://ghrsst.nodc.noaa.gov Casey, K.S., T.B. Brandon, P. Cornillon, and R. Evans (2010, in press). “The Past, Present, and Future of the AVHRR Pathfinder SST Program”, in Oceanography From Space, Revisited, eds. V. Barale, J.F.R. Gower and L. Alberotanza, Springer.

27. 1981-1984/85 Specially-Handled • Insufficient buoys, so quality-controlled ICOADS ship observations are used • Bias-corrected by subtracting 0.14 K (empirically determined) • Extreme values eliminated • Noise reduced through smoothing • Resulted in a five-fold increase in number of matchups and coverage similar to NOAA-14 period • Matchups then used in the standard PFV5 coefficient estimation routines (5-month sliding windows) • The large cool bias seen in March 1982 - late 1983 was largely removed

28. Pathfinder Improves Over Operational Operational – HadSST2 (Daytime) PFV5 – HadSST2 (Daytime) Satellite – In Situ (ºC) Operational – HadSST2 (Nighttime) PFV5 – HadSST2 (Nighttime)

29. Pathfinder Improves Over Operational Operational – HadSST2 (Daytime) Satellite – In Situ (ºC) PFV5 – HadSST2 (Daytime)

30. Pathfinder Improves Over Operational Operational – HadSST2 (Nighttime) Satellite – In Situ (ºC) PFV5 – HadSST2 (Nighttime)

31. Pathfinder During 1982-1983 El Niño SST Anomaly (ºC) December 27-31, 1982

32. Harmonic Climatology is More Robust • PFV5 quality=7, day and night, 1982-2008 • 5-day averages SSTclim=Acos(2πt + B) + Ccos(4πt + D) + E • Reject where n < 100 • Median-fill • Fill remaining gaps with “classic” climatology (typically ice prone regions)

33. Harmonic Climatology is More Robust Harmonic Succeeds Classic Fails • PFV5 quality=7, day and night, 1982-2008 • 5-day averages SSTclim=Acos(2πt + B) + Ccos(4πt + D) + E • Reject where n < 100 • Median-fill • Fill remaining gaps with “classic” climatology (typically ice prone regions)

34. Climatology Benefits from Added Years Good Failed to converge Less than 100 No Data Land 1985-2006 1982-2008

35. Pathfinder Still Being Improved! Seasonal and latitudinal patterns being addressed with “LATBAND” coefficients Operational – HadSST2 (Daytime) PFV5 – HadSST2 (Daytime) Satellite – In Situ (ºC) Plus improvements to reference field, land masks, spatial binning, and GHRSST-compliance Operational – HadSST2 (Nighttime) PFV5 – HadSST2 (Nighttime)

36. PFV6 Workflow Overview Coefficient Generator Archive, Data Access and User Services PFV6 L2P L3U L3C netCDF Quality Assurance GHRSST Generator L1B AVHRR SeaDAS code base Winds, sea ice, aerosols Climatologies + Products

37. Detailed PFV6 Workflow aciseg.sh (whole date day) Radiance Files segRevise.pl mkctrlfiles.pl Order and download GAC file list & aci.sh GAC files in CLASS L1B aci.sh aci GAC files on local server GAC, seg files Updated seg files with merging info aciseg Geolocation Files mkl2bin_both.parfile.pl l2bin_both.sh l2bin_both L2 HDF products par files & l2bin_both.sh l2gen_both.sh l2gen_both mkl2gen_both.parfile.pl L3 HDF products par files & l2gen_both.sh l2p_proc.pl conv_hdf_nc_L2P L2P Ascending netCDF (merged) L2 P Descending netCDF(merged) Ancillary data: Reference SST 10m winds Sea ice Aerosol createl3bin.pl file list descending L3 binned Descending HDF L3C smi Descending HDF l3c_proc.pl L3C Descending netCDF l3bin_both.sh l3bin_both L3U Ascending netCDF smigen _both conv_hdf_nc_L3C L3U smi HDF l3u_proc.pl L3 binned Ascending HDF L3C smi Ascending HDF file list ascending l3c_proc.pl L3 C Ascending netCDF conv_hdf_nc_L3U L3U Descending netCDF l3bin_both.sh l3bin_both smigen_both conv_hdf_nc_L3C smigen_both

38. Coming up… Details on the algorithm improvements in PFV6 in the presentation by Bob Evans Questions?