1 / 71

February 08-10, 2010 Falda del Carmen, Córdoba, ARGENTINA

February 08-10, 2010 Falda del Carmen, Córdoba, ARGENTINA. Mission Operations Review. DAY 2 SECTION 08 Aquarius Data Processing System (ADPS) Gene Carl Feldman Fred Patt. MOR Agenda – Page 2 of 3. Overview and Status Key Requirements Previous Reviews System Interfaces Key Processes

stevie
Download Presentation

February 08-10, 2010 Falda del Carmen, Córdoba, ARGENTINA

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. February 08-10, 2010 Falda del Carmen, Córdoba, ARGENTINA Mission Operations Review DAY 2 SECTION 08 Aquarius Data Processing System (ADPS) Gene Carl Feldman Fred Patt

  2. MOR Agenda – Page 2 of 3

  3. Overview and Status Key Requirements Previous Reviews System Interfaces Key Processes Data Acquisition and Ingest Science Data Processing Algorithm Integration, Testing and Evaluation Data Archive and Distribution Data Quality Control Validation Support Periodic Reprocessing Facilities/System Configuration/Backup Strategy/ IT Security Integration and Testing Staffing, Roles and Responsibilities Documentation Risks and Issues Agenda

  4. The Aquarius Ground System at NASA/GSFC consists of the Aquarius Data Processing System (ADPS) and the Aquarius Command and Control System (ACCS - next presentation) The ADPS will support: Acquisition and ingest of Aquarius/SAC-D data from CONAE. Acquisition of dynamic ancillary required to support the science processing. Processing of Aquarius data to standard product levels using algorithms provided by the Science Team. Quality control of data products using methods specified by the Science Team. Match-up of Aquarius data with in situ salinity measurements. Archive and distribution of all data products during the active life of the mission to the science team and general science community. Delivery of source data (Level-1a) and “validated” Level-2 and Level-3 derived data products to the PO.DAAC. The ADPS will be supported within the existing infrastructure of the Ocean Biology Processing Group (OBPG). Aquarius Data Processing System Overview

  5. Ocean Biology Processing Group • Located: Goddard Space Flight Center • Current Archive size: > 900 TBytes • Distribution (> 2/04): 53 million files • All missions are supported within the framework and facilities of the current NASA Ocean Data Processing System (ODPS) which has been successfully supporting operational, satellite-based remote-sensing missions since 1996, and its capabilities continue to evolve and expand to meet the demands and challenges of future missions • MISSIONS Currently SUPPORTED • SeaWiFS : 1997 - present • MODIS (Terra and Aqua) : 2000 - present • MERIS (US Coastal Waters) Feb 2009 - present • CZCS / Nimbus-7 : 1978 - 1986 • OCTS / ADEOS-I : 1996 - 1997 • Glory data system prototype : 2010 launch • Aquarius / SAC-D : 2010 launch • VIIRS / NPP : 2011 launch • Community Processing & Analysis Software SeaDAS (1991- present) http://oceancolor.gsfc.nasa.gov

  6. If Aquarius were launched today and downlink files in the format expected showed up on the CONAE data server, we could Operationally : Detect, transfer and ingest the files Reformat the files eliminating duplicate records Create temporary Level-1A data files and perform telemetry monitoring When subsequent downlinks are received, complete Level-1A orbit files produced Ingest and preprocess current set of required ancillary data Process to Level-2 salinity products and make products (Level-1A & 2) available via the existing web browse, download and order tool Process Level-2 files to Level-3 maps and make products available via web browse/download tool. However Status - Science Code only

  7. From now until launch we need to: Obtain and incorporate sample SAC-D telemetry files from CONAE into the Level-1A file structure (TBD) Receive updated Level-1b and Level-2 processing code from Frank Wentz (November 2009) Receive Scatterometer processing code from JPL (November 2009) Review and verify delivered code and merge simulated data sets (December 2009) Integrate Radiometer and Scatterometer code into data processing system (Jan/Feb 2010) Develop ingest procedures for additional ancillary data required by new code (Jan/Feb 2010) Verify output products with algorithm providers (February 2010) Process one year simulated data set and make available to science community (March 2010) Begin real-time mission simulation (March/April 2010 --> Launch) Verify Downlink file and SAC-D Housekeeping telemetry format/content (TBD) Participate in mission rehearsals as scheduled Status - Science Code TBD

  8. Overview and Status Key Requirements Previous Reviews System Interfaces Key Processes Data Acquisition and Ingest Science Data Processing Algorithm Integration, Testing and Evaluation Data Archive and Distribution Data Quality Control Validation Support Periodic Reprocessing Facilities/System Configuration/Backup Strategy/ IT Security Integration and Testing Staffing, Roles and Responsibilities Documentation Risks and Issues Agenda

  9. The ADPS shall receive, log, process and archive: Level 0 raw science data Aquarius HKT Service platform HKT (including attitude data) Ephemeris data The ADPS shall acquire and utilize ancillary data products to process Aquarius science data. The ADPS shall process science data to Level 1, 2 and 3 products. The ADPS shall deliver Aquarius data products to the Science Team and other users. The ADPS shall deliver data products to the JPL PO.DAAC. The ADPS shall support Aquarius data product validation by the Aquarius Validation Data System (AVDS). The Aquarius Ground System shall utilize and expand upon the GSFC OBPG facilities as required. The ADPS shall support reprocessing of the full Aquarius mission in six months or less. The ADPS shall support the archive of the full Aquarius mission data set. ADPS Key Requirements

  10. Aquarius Preliminary Design Review – June 2005 Aquarius Science/Ground System Pre-CDR – July 2006 Aquarius 1st Science Algorithm Workshop – March 2007 Aquarius 2nd Science Algorithm Workshop – March 2008 ACCS/ADPS Peer Review – March 2008 Aquarius/SAC-D Ground Segment CDR – July 2008 Aquarius Data Processing System Readiness Review – July 2009 Joint CONAE/NASA Mission Operations Working Group – Sept, Dec 2009 ACCS/ADPS Peer Review – January 2010 All RFAs from previous reviews have been closed. Previous Reviews

  11. Overview and Status Key Requirements Previous Reviews System Interfaces Key Processes Data Acquisition and Ingest Science Data Processing Algorithm Integration, Testing and Evaluation Data Archive and Distribution Data Quality Control Validation Support Periodic Reprocessing Facilities/System Configuration/Backup Strategy/ IT Security Integration and Testing Staffing, Roles and Responsibilities Documentation Risks and Issues Agenda

  12. Ground System Interfaces AQUARIUS Ground System

  13. Ground System Interfaces ADPS ACCS Aquarius Aquarius Data Command & Processing Control System System

  14. Ground System Interfaces CONAE Data Mission RF Archive Operations Services Command Center CUSS CODS Aquarius Data, SAC-D Telemetry and Orbit Products ADPS ACCS Aquarius Aquarius Data Command & Processing Control System System 1- SAC-D Ground System to Aquarius Ground System ICD

  15. Ground System Interfaces CONAE Data Mission RF Archive Operations Services Command Center CUSS CODS Aquarius Data, SAC-D Telemetry and Orbit Products Aquarius Command Schedules And Reports Schedule Confirmation And Reports ADPS ACCS Aquarius Aquarius Data Command & Processing Control System System 1- SAC-D Ground System to Aquarius Ground System ICD

  16. Ground System Interfaces S-Band S-Band ASI Malindi X-Band CONAE X-Band Commands Real-Time Telemetry & Coordination Data Mission RF Archive Operations Services Command Center Wallops Svalbard Alaska McMurdo CUSS CODS NASA Ground Network Aquarius Data, SAC-D Telemetry and Orbit Products Cordoba Aquarius Command Schedules And Reports Schedule Confirmation And Reports ASI Matera ADPS ACCS Aquarius Aquarius Data Command & Processing Control System System 1- SAC-D Ground System to Aquarius Ground System ICD 2- SAC-D / NASA PSLA, Network Requirements Document & Scheduling Interface 3- SD - Observatory Ground IF Specification Document

  17. Ground System Interfaces S-Band S-Band ASI Malindi X-Band CONAE X-Band Commands Real-Time Telemetry & Coordination Data Mission RF Archive Operations Services Command Center Wallops Svalbard Alaska McMurdo CUSS CODS NASA Ground Network Aquarius Data, SAC-D Telemetry and Orbit Products Cordoba Aquarius Command Schedules And Reports Schedule Confirmation And Reports ASI Matera Calibration & Instrument Configuration Change Requests Principal Investigator and Science Planning Team ADPS ACCS Aquarius Aquarius Data Command & Processing Control System System Instrument Engineering Team Aquarius Instrument Testbed Flight Software Updates 1- SAC-D Ground System to Aquarius Ground System ICD 2- SAC-D / NASA PSLA, Network Requirements Document & Scheduling Interface 3- SD - Observatory Ground IF Specification Document 4- Aquarius Science Team to Aquarius Ground System ICD 5- AQ - Aquarius Ground System – Aquarius Instrument Team Anomaly ICD and Aquarius Test bed User Manual

  18. Ground System Interfaces S-Band S-Band ASI Malindi X-Band CONAE X-Band Commands Real-Time Telemetry & Coordination Data Mission RF Archive Operations Services Command Center Wallops Svalbard Alaska McMurdo CUSS CODS NASA Ground Network Aquarius Data, SAC-D Telemetry and Orbit Products Cordoba Aquarius Command Schedules And Reports Schedule Confirmation And Reports ASI Matera Ancillary Data Sources Calibration & Instrument Configuration Change Requests Principal Investigator and Science Planning Team ADPS ACCS Aquarius Aquarius Data Command & Processing Control System System Algorithms & Science Code Evaluation Products Instrument Engineering Team Science Team and Algorithm Providers Aquarius Instrument Testbed Flight Software Updates 1- SAC-D Ground System to Aquarius Ground System ICD 2- SAC-D / NASA PSLA, Network Requirements Document & Scheduling Interface 3- SD - Observatory Ground IF Specification Document 4- Aquarius Science Team to Aquarius Ground System ICD 5- AQ - Aquarius Ground System – Aquarius Instrument Team Anomaly ICD and Aquarius Test bed User Manual 6- Aquarius Data Product User Guide (PO.DAAC) & Format Specification (ADPS) 7- Ocean Data Processing System Data and Software Management Plan, ATBD’s and Software User’s Guides

  19. Ground System Interfaces S-Band S-Band ASI Malindi X-Band CONAE X-Band Commands Real-Time Telemetry & Coordination Data Mission RF Archive Operations Services Command Center Wallops Svalbard Alaska McMurdo CUSS CODS NASA Ground Network Aquarius Data, SAC-D Telemetry and Orbit Products Cordoba Aquarius Command Schedules And Reports Schedule Confirmation And Reports ASI Matera Ancillary Data Sources Calibration & Instrument Configuration Change Requests Principal Investigator and Science Planning Team ADPS ACCS Aquarius Aquarius Data Command & Processing Control System System Algorithms & Science Code Evaluation Products Instrument Engineering Team Science Team and Algorithm Providers Aquarius Instrument Testbed Flight Software Updates Insitu Data Bias Adjustments Aquarius Match-up Data AVDS Aquarius Validation Data System 1- SAC-D Ground System to Aquarius Ground System ICD 2- SAC-D / NASA PSLA, Network Requirements Document & Scheduling Interface 3- SD - Observatory Ground IF Specification Document 4- Aquarius Science Team to Aquarius Ground System ICD 5- AQ - Aquarius Ground System – Aquarius Instrument Team Anomaly ICD and Aquarius Test bed User Manual 6- Aquarius Data Product User Guide (PO.DAAC) & Format Specification (ADPS) 7- Ocean Data Processing System Data and Software Management Plan, ATBD’s and Software User’s Guides 8- A V D S to A D P S ICD

  20. Ground System Interfaces S-Band S-Band ASI Malindi X-Band CONAE X-Band Commands Real-Time Telemetry & Coordination Data Mission RF Archive Operations Services Command Center Wallops Svalbard Alaska McMurdo CUSS CODS NASA Ground Network Aquarius Data, SAC-D Telemetry and Orbit Products Cordoba Aquarius Command Schedules And Reports Schedule Confirmation And Reports ASI Matera Ancillary Data Sources Calibration & Instrument Configuration Change Requests Principal Investigator and Science Planning Team ADPS ACCS Aquarius Aquarius Data Command & Processing Control System System Algorithms & Science Code Evaluation Products Instrument Engineering Team Science Team and Algorithm Providers Aquarius Instrument Testbed Flight Software Updates Insitu Data Bias Adjustments Aquarius Match-up Data Level 1, 2, 3 Aquarius Data AVDS Aquarius Validation Data System PO.DAAC Aquarius L1, 2, 3 Data Ancillary Data Feedback 1- SAC-D Ground System to Aquarius Ground System ICD 2- SAC-D / NASA PSLA, Network Requirements Document & Scheduling Interface 3- SD - Observatory Ground IF Specification Document 4- Aquarius Science Team to Aquarius Ground System ICD 5- AQ - Aquarius Ground System – Aquarius Instrument Team Anomaly ICD and Aquarius Test bed User Manual 6- Aquarius Data Product User Guide (PO.DAAC) & Format Specification (ADPS) 7- Ocean Data Processing System Data and Software Management Plan, ATBD’s and Software User’s Guides 8- A V D S to A D P S ICD 9- Aquarius Ground System to PO.DAAC ICD Data Users and Science Team Software SeaDAS

  21. Overview and Status Key Requirements Previous Reviews System Interfaces Key Processes Data Acquisition and Ingest Science Data Processing Algorithm Integration, Testing and Evaluation Data Archive and Distribution Data Quality Control Validation Support Periodic Reprocessing Facilities/System Configuration/Backup Strategy/ IT Security Integration and Testing Staffing, Roles and Responsibilities Documentation Risks and Issues Agenda

  22. Aquarius/SAC-D data downlink strategy comprises multiple, overlapping downlinks each day of Aquarius science high-rate data (HRD) and Aquarius and SAC-D housekeeping telemetry (HKT). 3 to 5 passes per 24 hours over the Cordoba ground station. 1 pass per week over Matera ground station, which is transferred to Cordoba after pass. 6 - 11 minutes per pass. Downlink full science memory of 110 MB at 4Mbps (just under 4 minutes), repeating throughout pass. ADPS automatically acquires downlinks from the CUSS (separate files for Science, SAC-D/HKT) after each pass. Orbit Products including Ephemeris files are generated daily by the CODS and acquired (Two-line Elements, Predicted Ephemeris and Orbit Ephemeris, Ground Station Contacts, Ground Station Contacts Details, SAA Passes, Eclipses, Events, Maneuvers List) All files are ingested and cataloged automatically after acquisition, and made available for processing. Data Acquisition and Ingest

  23. Overview and Status Key Requirements Previous Reviews System Interfaces Key Processes Data Acquisition and Ingest Science Data Processing Algorithm Integration, Testing and Evaluation Data Archive and Distribution Data Quality Control Validation Support Periodic Reprocessing Facilities/System Configuration/Backup Strategy/ IT Security Integration and Testing Staffing, Roles and Responsibilities Documentation Risks and Issues Agenda

  24. Aquarius Data Processing Development Philosophy: 1- Maintain Flexibility - things WILL change 2- Strive for maintainability of code and documentation 3- Testing, Testing and more Testing: Get the mechanics right so that when data starts to flow, you can focus on the science Approach: 1- Use of rapid prototypes evolving into ever more realistic full-mission simulations 2- Verify that all requirements are being met 3- All components of the system are being thoroughly exercised 4- use of "real-world" testing of the end-to-end system on a routine basis - don’t just test for success Implementation: 1- Start with a full end-to-end data flow description 2- Break into the component parts 3- Use as close to real data and operational software as possible 4- Continuously evolve the simulation to add more credible data, software and interfaces as they become available Result: 1- All the supporting infrastructure, tools and procedures can be developed, tested and refined as the process continues 2- Through this modular, flexible approach, the entire system can gradually evolve to a higher and higher level of fidelity until you have as close to a fully tested and functional launch-ready system as possible prior to launch

  25. Algorithm Integration, Testing and Evaluation Aquarius Team ADPS Team algorithms Science Software Development and Algorithm Integration working code (C, Fortran) issues and test results prototype code (IDL, MATLAB?) software updates written specifications (memos, emails) Software Repository Version Controlled Code and Tables Including ACCS published algorithms in-house development SeaDAS Software Package

  26. The Aquarius science data processing consists of the following steps: Level-0 Preprocessor – process each HRD downlink file to produce a single time-ordered set of Aquarius science blocks and removes duplicates– developed by Joel Gales - ADPS. Level-0-to-1A – separate Level-0 files into orbits, unpack science data, incorporate overlapping ephemeris and SAC-D HKT and convert Aquarius HKT – developed by Joel Gales - ADPS. Telemetry Analysis – HKT data from Level-1A files analyzed for web display on the Aquarius web site – developed by Susie Kennison, Norman Kuring and Liang Hong - ADPS/ACCS. Interactive Telemetry Analysis - HKT files analyze using CONAE-provided telemetry viewer. Level-1A Merge – consolidate Level-1A files from overlapping downlinks into a single, best-quality full orbit product – Joel Gales - ADPS. Level-1A-to-2 – perform calibration, atmospheric correction and salinity retrieval for Aquarius science data – radiometer and scatterometer code delivered by RSS and JPL, respectively; integration and input/output code developed by Joel Gales and Liang Hong - ADPS. Level-2-to-3 Binning – Level-2 salinity retrievals for one day geographically projected and collected into equal-area bins – existing OBPG software modified by Joel Gales- ADPS. Level-2-to-3 Smoothing – Level-2 salinity retrievals for one day optimally interpolated into equal-area bins – algorithm by Jonathan Lilly/ESR implemented by Joel Gales - ADPS. Level-3 Binning and Mapping – Level-3 binned files aggregated to longer time periods (weekly, monthly, etc.) and projected onto map grid – existing OBPG software. All processing steps are run automatically when all input data sets are available. All software exists in at least preliminary prelaunch form at this time. Science Data Processing

  27. Aquarius Data Processing Overview Standard Data Processing Web-Based Telemetry Monitoring Tools Raw Level-0 Downlink File Level-0 Report Level-0 Preprocessor Level-0 Level-1a Report SAC-D HKT Data Level-0 to 1A Level-1A temp Automated Telemetry Analysis Tool Level-1A Merge Level-1A orbit Dynamic Ancillary Data Telemetry Report Level-2 Level-1A to 2 In-Situ Match-up Process Static Ancillary Data Predicted Downlink Times AVDS Level-2 Match-up Bias Adjustment Level-2 to 3 Smoothing Level-2 to 3 Binning SAC-D HKT Data CONAE-provided Interactive Telemetry Analysis Tool Level-3 Bin Level-3 Mapping Web-Based Browse, Download and Order Tools Level-3 Binning Level-3 Map

  28. Overview and Status Key Requirements Previous Reviews System Interfaces Key Processes Data Acquisition and Ingest Science Data Processing Algorithm Integration, Testing and Evaluation Data Archive and Distribution Data Quality Control Validation Support Periodic Reprocessing Facilities/System Configuration/Backup Strategy/ IT Security Integration and Testing Staffing, Roles and Responsibilities Documentation Risks and Issues Agenda

  29. Aquarius data product archiving at ADPS will be performed using the existing ODPS archive catalog database and RAID-based data storage system (> 1 PetaByte of current storage for SeaWiFS, MODIS, MERIS, OCTS, CZCS, etc.) Aquarius data distribution during the active life of the mission will be performed using the existing ODPS browse and order system (examples to follow). All source data and “validated” data products will be delivered to the JPL PO.DAAC for permanent archive, value-added services and long-term distribution (next slides). Data Archive and Distribution

  30. PO.DAAC (Physical Oceanography Distributed Active Archive Center) responsibilities: Long-term (Life of Mission and Beyond) data management, distribution & archive of the Aquarius mission data. Ensure data maintenance, usability, access, provenance and security. Ensure integrity of Aquarius data through quality, quantity, continuity and latency audits. Ensure all Aquarius products conform to NASA’s file and metadata standards. Ensure all Aquarius metadata are delivered to the NASA metadata registry (ECHO). Implement and maintain PO.DAAC Aquarius ftp site and web pages. Maintain data Aquarius data access tools including product/granule search, OpenDAP, L2 and L3 subsetters. Develop and maintain Aquarius product user guides and read software. Answer user questions concerning Aquarius data. Configure and implement the PO.DAAC Data Management & Archive System (DMAS) to conform to the interface specification and product ingest requirements. Report data access metrics. PO.DAAC Support for Aquarius

  31. Draft Interface Control Document (Completed September 19, 2008) Draft Data Management Plan (Completed October 18, 2008) Final Interface Control Document (February 2010) Draft User Guide (February 2010) Final Data Management Plan (May, 2010 ­ 2 months prior to Operational Readiness Review) Final User Guide (May, 2010) DMAS adaptation (Ingest, Archive and Distribution tools) (March 2010 ­ for Operations Readiness Test) Aquarius FTP and web site (including read software) (June 2010 ­ for Operations Readiness Test) Data Access tools (July 2010) PO.DAAC Delivery Status

  32. Overview of the currently operational web-based browse, order and distribution tool that is available to support the distribution of Aquarius data within the Aquarius Data Processing System that also serves as a data quality monitoring tool for both internal and external use. Data Archive and Distribution

  33. Aquarius Level-1-2 Data Browser http://oceancolor.gsfc.nasa.gov/cgi/aquarius

  34. Aquarius Level-1-2 Data Browser http://oceancolor.gsfc.nasa.gov/cgi/aquarius

  35. Aquarius Level-1-2 Data Browser http://oceancolor.gsfc.nasa.gov/cgi/aquarius

  36. Aquarius Level-3 Data Browser http://oceancolor.gsfc.nasa.gov/cgi/l3

  37. Aquarius Level-3 Data Browser http://oceancolor.gsfc.nasa.gov/cgi/l3 Beam 1 - daily

  38. Aquarius Level-3 Data Browser http://oceancolor.gsfc.nasa.gov/cgi/l3 All Beams - daily

  39. Aquarius Level-3 Data Browser http://oceancolor.gsfc.nasa.gov/cgi/l3 all beams-weekly all beams-monthly

  40. Overview and Status Key Requirements Previous Reviews System Interfaces Key Processes Data Acquisition and Ingest Science Data Processing Algorithm Integration, Testing and Evaluation Data Archive and Distribution Data Quality Control Validation Support Periodic Reprocessing Facilities/System Configuration/Backup Strategy/ IT Security Integration and Testing Staffing, Roles and Responsibilities Documentation Risks and Issues Agenda

  41. Automated telemetry monitoring, alarm notification and web tools updated on every downlink Interactive telemetry monitoring tools Automated format and science data quality checks performed on each file as defined by science team Visual inspection via web tools for Level-2 and Level-3 data products Level-3 Long-term statistics monitoring tool AVDS data analysis by Science Team Data Quality Control

  42. Overview and Status Key Requirements Previous Reviews System Interfaces Key Processes Data Acquisition and Ingest Science Data Processing Algorithm Integration, Testing and Evaluation Data Archive and Distribution Data Quality Control Validation Support Periodic Reprocessing Facilities/System Configuration/Backup Strategy/ IT Security Integration and Testing Staffing, Roles and Responsibilities Documentation Risks and Issues Agenda

  43. The Aquarius Validation Data System (AVDS) will statistically evaluate the Aquarius SSS data product using a global set of in situ salinity measurements (e.g., Argos buoys) The ADPS will support the validation activity by acquiring the in situ data from AVDS, performing matchups with the Aquarius Level-2 data products, and uploading the matchup files to AVDS. The rationale for the data exchange is to streamline this activity by using preexisting ADPS hardware, software, and satellite data processing facilities, thereby eliminating the redundant effort of developing parallel facilities. A successful data exchange simulation was accomplished using in situ water temperature measurements and the MODIS-Aqua 11-micron SST data product. The AVDS support testing will be included in the mission simulation described under Integration and Testing. Validation Support

  44. ftp://ftp.esr.org/pub/datasets/avds ftp://samoa.gsfc.nasa.gov/aquarius FTP SITES seabass:/data3/adps DATA STORAGE http://seabass.gsfc.nasa.gov/eval/adps.cgi WEB SITE AVDS-ADPS Data Exchange AVDS RESPONSIBILITY in situ data uploaded (daily) in situ data downloaded daily limited to new files satellite files located & extracted level-2 hdf files generated browse images & maps generated in situ data ingested into database satellite data uploaded & posted online satellite data removed after 1-week

  45. Overview and Status Key Requirements Previous Reviews System Interfaces Key Processes Data Acquisition and Ingest Science Data Processing Algorithm Integration, Testing and Evaluation Data Archive and Distribution Data Quality Control Validation Support Periodic Reprocessing Facilities/System Configuration/Backup Strategy/ IT Security Integration and Testing Staffing, Roles and Responsibilities Documentation Risks and Issues Agenda

  46. Level-1 Requirement: No later than twelve (12) months after the end of the IOC period, the Aquarius Project shall record, process, archive, and deliver the first release of Level 1A and Level 3 data products to a NASA Distributed Active Archive Center (DAAC), Level-1 Requirement: After the first release of Aquarius data, the Aquarius Level 1A and Level 3 data products shall be delivered to the DAAC no later than six months after measurements are taken in orbit. Level-1 Requirement: During the mission life, all products shall be available to the science community from the Aquarius Data Processing Segment (ADPS) and the final data products produced by the Aquarius Project shall be delivered to the DAAC within six (6) months after the end of the prime mission Periodic Reprocessing

  47. Development and test environments allow for multiple algorithm versions to be run on the entire mission data set to test the impacts of calibration and algorithm improvements. The results of these “reprocessings” are made immediately available to the science team members via web and ftp mechanisms Using SeaWiFS as a benchmark, the most recent reprocessing of the entire mission-long (ten year) data set required 10 hours or 1 year/hour. Aquarius is ½ the data volume of SeaWiFS so data storage and system throughput are NOT a concern. A better estimate of the actual processing throughput will be derived once we process the year-long Aquarius simulated data set later this month Once the calibration/algorithm changes have been validated and approved by the Science Team, a mission-long reprocessing will be initiated and the new products and documentation will be made available to the science community and PO.DAAC. Periodic Reprocessing

  48. Overview and Status Key Requirements Previous Reviews System Interfaces Key Processes Data Acquisition and Ingest Science Data Processing Algorithm Integration, Testing and Evaluation Data Archive and Distribution Data Quality Control Validation Support Periodic Reprocessing Facilities/System Configuration/Backup Strategy/ IT Security Integration and Testing Staffing, Roles and Responsibilities Documentation Risks and Issues Agenda

  49. NASA Goddard Space Flight Center Greenbelt, Maryland Server location: Building 28 Room W220 - 900 square feet dedicated to the project - Raised computer floor with under-floor A/C - Primary and backup A/C units - 80 KVA Powerware UPS unit with dual 50 KVA PDUs, additional 5 KVA rack-mounted UPS units - Connections to GSFC high speed networks: SEN OBPG Computing Facility

  50. Distribution Servers (ftp) 8 storage nodes 49.3 TB 1 server 250GB Distribution and Storage Servers (web) Production: 3 processing nodes 75 storage nodes 1.03 PB AQOPS Servers (web) Production: 2 processing nodes Forum Servers (web) Production: 2 processing nodes Ingest Servers 2 SeaSpace workstations 78 GB 1 storage node 5.1 TB Cal/Val & QC Systems Processing Cluster 46 processing nodes 15 TB 4 storage nodes 10.9 TB Extreme Networks Black Diamond 8810 Gigabit Ethernet switch 480 ports Aquarius Telemetry Viewer 2 Windows PC Mission Operations Systems Aquarius Command Planning Tool Servers 2 processing nodes 586 GB Development Servers 2 superstore nodes 10 TB Subversion CM Servers 2 superstore nodes 586 GB Testing Cluster User Desktops Backup Servers 2 storage nodes 19.2 TB Database Servers 2 superstore nodes 16.4 TB Network Support Servers OBPG System Hardware

More Related