110 likes | 364 Views
Evolution of NOAA's Satellite Archive: Transition of CLASS Development to Operations at NOAA's Data Centers and Future Plans. John J. Bates, NOAA’s National Climatic Data Center Drew Saunders, STG, Inc. at NCDC Ken Casey, NOAA’s National Oceanographic Data Center
E N D
Evolution of NOAA's Satellite Archive: Transition of CLASS Development to Operations at NOAA's Data Centers and Future Plans John J. Bates, NOAA’s National Climatic Data Center Drew Saunders, STG, Inc. at NCDC Ken Casey, NOAA’s National Oceanographic Data Center Eric Kihn, NOAA’s National Geophysical Data Center
Outline What is an Archive Current State of NOAA’s Archive Archive Plans for NPOESS Challenges and New Opportunities
What is an Archive?Archive Responsibilities • Negotiates and accepts informationfrom Producers • Obtains sufficient control to ensure long-term preservation • Ensures the information to be preserved is independently understandableto identified Designated Communities • Follows documented policies and procedures that ensure the information is preserved against all reasonable contingencies • Makes the preserved information available to the Designated Communities in forms understandable to those communities NOAA’s Data Centers = NOAA’s Archive; CLASS is IT
The Archive Environment • Producer provides information to be preserved • Management sets overall policy • Consumer seeks and acquires preserved information OAIS (Archive) Consumer Producer Management CLASS Operations and Planning Board (COPB) The Archive Environment from 30,000 ft
Descriptive Info. AIP Archive Functional Entities Preservation Planning CONSUMER PRODUCER P R O D U C E R C O N S U M E R Data Management queries result sets SIP Ingest Access orders Archival Storage DIP Administration MANAGEMENT MANAGEMENT The Archive Environment from 10,000 ft SIP = Submission Information Package AIP = Archival Information Package DIP = Dissemination Information Package
Current State – NOAA Archives Users Users Users Web Interface Web Interfaces Web Interfaces Centers of Data FGDC Metadata NOAA’s Data Centers FGDC Metadata Metadata? CLASS ? Tape Warehouses Mirror CLASS Data Providers Data Providers Courtesy NGDC
Transitional State – NOAA Archives Users Users Users Web Interface Direct Access Interfaces Application Interface (NOAA Server) Centers of Data Metadata? NOAA’s Data Centers APIs APIs NOAA Metadata Manager and Repository CLASS ? Warehouse Mirror Services Mirror Courtesy NGDC CLASS Data Providers Data Providers
Final State – NOAA Archives Users Users Users Web Interface Direct Access Data Discovery NOAA Web Services NOAA’s Data Centers Centers of Data APIs APIs APIs NOAA Metadata Manager and Repository CLASS Mirror Services Mirror Mirror CLASS Data Providers Data Providers Centers of Data Providers
Archive Plans for NPOESS • Interface Data Processing Segment (IDPS) • Data Delivery Subsystem (DDS) - request for & receipt of: • NPP Data Products (RDRs, SDRs/TDRs, IPs, EDR/ARPs, geolocation) • Two-line Elements (TLEs) and Mission Schedules • Official Dynamic Ancillary Data • Data Delivery Reports (DDR) • Consolidated Data Delivery Reports (CDDR) • Data Quality Monitoring (DQM) - receipt of: • DQM Reports • NOAA’s Climate Data Record Project • Long-term Climate data and metadata • Ground Integrated Support Facility (GISF) - receipt of: • Software Release Packages that include source code and Look Up Tables • Documentation Release Packages that include External Interface Control Documents, the CDFCB-X Volumes, Product Profiles, OADs, and ATBDs. • Supporting Data Release Packages that include Processing Coefficient Tables, Sensor Calibration Table Updates, DQTTs, QST IPs, and Official Static Ancillary Data. • Test Data Release Packages • Command, Control and Communications Segment (C3S) - request for: • request via the WRS for DQM Reports
Challenges and New Opportunities • Archive must validate the data are independently understandable • Work with IPO, NASA SDS, NOAA STAR NDE and Cooperative Insititues to use archived data • Archive will receive different and more data than centrals • Build ISO 19115 metadata catalog for easy customer access • Volume of data is daunting • Explore compression and use of RDRs