Philosophy of Calibration/Validation

1. Calibration/Validation of the NPOESS NPP Instruments: Plan OverviewNational Polar-Orbiting Operational Environmental Satellite SystemKaren St.Germain, NPOESS Integrated Program OfficeDirect Readout Meeting, October 3-6, 2005

3. Philosophy of Calibration/Validation Cal/Val • Centrals • NWP • Real-time tactical • Non-tactical • JTWC • NHC • JIC • Science • Others Calibration Validation Users Mission Success • Absolute Accuracy • Polarization Purity • Geolocation Accuracy • Instrument Stability • Signal-to-Noise • Antenna Pattern Correction • Environmental Data Products (EDRs) • Atmosphere • Ocean • Land • Ice • Space Ensures • Meet Specification • Operational production of synoptic maps and profiles of critical atmospheric, oceanographic, land and space parameters • Known Accuracy • Quality Control Calibration ensures that the Sensor Data (SDRs) are usable Validation ensures that the Environmental Data (EDRs) are usable

4. The Stakeholders NGST Driver: Meet Spec Resources: Cal/Val infrastructure, Payload subcontractors Manpower IPO NASA Driver:Science Quality Driver: Meet IORD Success Resources: Cal/Val Heritage, BAA Correlative Data Assets, MOUs Resources: Cal/Val Heritage, Manpower Science Data Segment Centrals Driver: Mission Resources: Real time Quality Assessment

5. NPOESS Calibration Verification Validation Program- System Perspective Planning Underway Intensive Planning and Tool Development Effort Underway Hotbed of Activity Prelaunch Post-Launch Long-Term Monitoring Sensor Characterization and Calibration Operations, Maintenance, and Upgrades Calibration and characterization on-orbit Heritage sensor data, design analysis Calibration and characterization ground tests Sustaining calibration and validation Algorithm tuning and upgrades RDR/SDR validation Verification of science algorithm quality and latency Verification of operational algorithm quality and latency Validation of operational EDR quality and latency Operational EDRs RDR/SDR/EDR Validation RDR/SDR/EDR Verification

6. Cal/Val Complexity • 26 EDRs • 4 New Instruments • 3 Resource Management Centers • Pre-launch tests occurring at 4 different sensor vendors • How are we managing this? • How do we know our plans are comprehensive?

7. Coordinated NPP Cal/Val Plan Baseline and Changes • Coordinated NPP Cal/Val Plan Baseline • The SSPR Prime contractor, the Integrated Program Office, and the NAS NPP Science team have a (mostly) common interest in executing a successful Cal/Val • SDR/EDR Compliance-to-Cal/Val Requirement system engineering (with Science and Technical Advisors involvement) will identify tasks that are must, specific, realistic, and measurable. A Tasks Network will be used to explore schedule constraints and clearly define task responsibilities • The CVMT and Science/Technical Advisors are responsible for constraint management • Looking for synergistic tasks. Exploring parallel task execution options • Identifying discrepancies in bottom-up schedule, budget and Goals • Using priorities to explore trade-offs • Using NPOESS SCB and NETS to resolve schedule and budget gaps • From the Task Network the CVMT will establish roles and responsibilities among performing organizations • The CVMT will manage execution of the Joint NPP Cal/Val Plan baseline • Joint NPP Cal/Val Plan Baseline changes • The CVCCB will manage baseline changes employing traditional CCB processes and documentation

8. NPOESS NPP Cal/Val “Big Picture” Pre-Launch Post-Launch Sensor Dgn Parts Subsys Sys I&T SDR/EDR Ingest - Performance Parameters & LUT - Geolocation - Cal Xfer - Radiometry/Photometry Long-Term Monitoring Perf. Budget Compliance Review Board Point Budget Anomaly Resolution Op Algorithm Change Cal Budget Performance & Calibration Verification RDR Quality & Selection SDR Validation EDR Validation Cal/Val Infrastructure Design Manufacturing, I&T Readiness Demo Infrastructure – RDR Storage, Match-up Data, Ground Truth, ICVS, LTA,, Quality Flags, Tools, Op/Sci Algorithms Infrastructure Req. Data Storage, Sci/Op Algorithms, Tools, Ground Truth, Match-upData RDR Quality Task Lead Task Lead Geo-location Task Lead Cal Scenes Solar/Lunar Ground Task Lead EDR Match-up Data X-Cal (Space Assets) Task Lead Task Lead Airborne Campaign Ground Campaign Task Lead Etc. Task Lead Task Planning & Execution BaselineChange Task Planning Intensive Cal/Val Sustaining Cal/Val Cal/Val Plan Baseline (Task Network, Data Req., Algorithm Need, Infrastructure Req.) L + 7 mos Baseline Coordinated IPO-NASA-NGST SSPR Activity Heritage Validation & New Approaches (Doc, Data Req, Implementation Support, Lessons Learned)

9. “Bottom Up” approach to defining Cal/Val • Driven by diagnostic work that has to be done in the intensive post-launch phase

10. Tasks are captured in a web-based relational database • Attributes include Data, metadata, tools, entry and exit criteria, etc.

11. Once described, tasks are linked logically and scheduled Technical threads are rigorously developed and reviewed by joint teams with individuals from NGST, sensor vendors, Academia, Gov’t Labs, and FFRDCs. ATMS Thread

12. A technical library supports the distributed Cal/Val Team • Sensor data, analyses, algorithms, formats, tools, reports

13. The technical library includes the algorithms and their supporting documentation: • ATBDs, code, test data, formats, results, etc.

14. All code, including algorithms and tools is under configuration control for Cal/Val

15. Cal/Val Anomaly Resolution & Ops Change • The IPO/NASA/NGST SSPR Cal/Val Team will perform analysis and validation of calibration and SDR/EDR performances • Cal/Val anomalies will be investigated by expert SSPR CV Anomaly Resolution Teams • Anomaly findings and resolutions will be submitted to the CVCCB for consideration and subsequent recommendation to the ACCB and the O&S CCB for operational implementation

16. Algorithms and Validation Infrastructure Validation Data Sources Data Quality Subsystem Validation Data Tools Cal/Val Database Cal/Val Activities Today Internal Gov’t Studies Quality Flags/ Intermediate Products NPP Science Team OATs Interface Analysis Tools MOUs/MOAs Long Term Monitoring: Requirements and Tools Pre-launch Testing S/C Attitude Maneuvers Sensor Algorithms (SDRs) Transition to O&S Cal Coefficients/Look-up Tables OPSCON Scenarios NPP Cal/Val Plan Sensor Calibration Operational Issues

17. Two Questions and an Opportunity: • Are there Cal/Val concerns specific to the Direct Readout community? • Global look-up tables • Radiometric calibration consistency • Cross-instrument geolocation • What can the direct readout community bring to the Cal/Val program? • Validation concepts • http://ipo.noaa.gov • Internal Government Studies Program Announcement

18. IPO & NASA NGST Joint NPOESS Calibration Verification Validation Program Participants Development Activities Performance Advisory Activities Exploration & Exploitation Activities • Integrated Product Teams (IPTs) • Systems Engineering • (SE, SI, ST&E) • Payloads • IDPS • Operations and Support • IPO Cal/Val Team • NPOESS Operational • Algorithm Team (NOAT) • Science • Algorithms • Sensors NPOESS Internal Government Studies NASA NPP Science Team • Integrated Product Teams (IPTs) • Systems Engineering • (SE, SI, ST&E, Cal/Val) • Payloads • IDPS • Operations & Support • NGST Cal/Val Team • NGST Science • Advisory Team (SAT) • Science NGST SE IPT Science Team NPOESS Customer Forum NOESS P3I Calibration/Validation Working Group (CVWG) Calibration/Validation Teams (Participation from Gov’t Labs, Universities, FFRDCs, Centrals)