190 likes | 213 Views
ISCCP Central Archive: NCDC Update. Ken Knapp, John Bates and Hilawe Semunegus NOAA/NCDC, Asheville, NC. Archive Data B1 Inventory B1 Backfilling Products interoperability November follow up. B1 stewardship Overview Rescue Data QA/QC Calibration Expansion. Overview. Global
E N D
ISCCP Central Archive:NCDC Update Ken Knapp, John Bates and Hilawe Semunegus NOAA/NCDC, Asheville, NC
Archive Data B1 Inventory B1 Backfilling Products interoperability November follow up B1 stewardship Overview Rescue Data QA/QC Calibration Expansion Overview
Global Processing Center GISS GOES-5,6,7,8,9,10,11,12 Meteosat-2,3,4,5,6,7,8,9 GMS-1,2,3,4,5 MTSAT-1R FY-2C B2 B2 Satellite Processing Centers NOAA-7,8,9,10,11, 12,14,15,16,17,18 B2,B3 (All satellites) Products (C,D Data) B1 JMA CIRA EUMETSAT AES UWS NOAA ISCCP Central Archive (NCDC) GOES-5,6,7,8,9,10,11,12 Meteosat-2,3,4,5,6,7,8,9 GMS-1,2,3,4,5 MTSAT-1R, 2 FY-2C ISCCP data at NCDC
ICA Status • Automated scripts monitor incoming data files • Files are counted and feedback provided in form of email • Log files are available to SPC • Instructions provided within the email • Performed for current and previous month
B1 Status - 2008 29 satellites B1 Inventory • NCDC received B1 data for… • GOES 11/12 • MET 7/8/9 • MTSAT 1R/2 • FY2 C • Changes in 2007 • None • Polar changes • none
New access … User’s Site Personal copy NCDC ISCCP Data T D S http ftp I/O NetCDF-Java library Data analysis ASCII Raw NetCDF ISCCP Data Raw format • Data in fewer locations • Simplified I/O • User downloads only requested data ftp For archive GISS ISCCP Data Raw format
Product archive and access • Online archive with access to • Raw data (standard FTP) • Many formats through Unidata’s Thredds Data Server (TDS)
Incomplete tasks (from November 2006)… • Fill ISCCP B1 GOES gaps of 5 days or more from CLASS • Complete navigation study • AVHRR data for GPCP • EUMETSAT reprocessed entire B1 record?
Future work (from Sept. 2007) • ICA • Redesign B1U format • netCDF4 • Fill GOES B1 gaps where possible • Continued development of TDS for GEWEX products • Stewardship • Complete ISCCP Cloud mask algorithm for B1 files. • Test navigation correction algorithm • Water vapor recalibration • new reference source … AIRS?? • Visible calibration analysis
Rescue • Format • Reading the data • New EUMETSAT data • Navigation • Figuring out where a pixel is • Calibration • Determining the temperature or reflectance
ISCCP B1 PublicationSubmitted to JARS SPIE’s Journal of Applied Remote Sensing
Overview: ISCCP B1 Data • Data • Spectral radiances at Visible and Infrared wavelengths • Raw data … not products • Temporal Data Coverage • 1978 to present • Spatial Data Coverage • Global at ~10 km resolution • Satellites • GOES, GMS, Meteosat, MTSAT-1R, FY2-C • Total Volume ~1.5 TB
Calibration: Water vapor • Reference satellite … • HIRS Pathfinder All Sky data • 1983-2005 • Footprint match-ups • Use Lei Shi’s correction to map new HIRS Tb to old wavelength
Summary of work • Promoting scientific use of B1 data • Supporting GEWEX projects • Providing support for new formats as needed • New EUMETSAT format for replacement files
Summary of remaining issues • Sporadic data from: • FY2-C • GOES-11 • MET-9 • Reprocess entire GOES B1 archive from CLASS? • [See future work]
Future work • Redesign B1U format • netCDF4 • Fill GOES B1 gaps where possible • Test navigation correction algorithm • Water vapor recalibration • new reference source … AIRS?? • Visible calibration analysis • Continued development of TDS for GEWEX products