290 likes | 479 Views
GES DISC Evolution Transition Readiness Review AIRS S4PM / S4PA Bruce Vollmer AIRS Evolution Lead Bruce.E.Vollmer@nasa.gov. Objectives L0 data DPREP/Ancillary data L1-L3 data Data Interfaces Data Metrics Current Status Conclusion. Agenda.
E N D
GES DISC Evolution Transition Readiness Review AIRS S4PM / S4PA Bruce Vollmer AIRS Evolution Lead Bruce.E.Vollmer@nasa.gov
Objectives L0 data DPREP/Ancillary data L1-L3 data Data Interfaces Data Metrics Current Status Conclusion Agenda
Convey overall status of progress on transition from ECS to S4PA for AIRS data support Illustrate that AIRS data support from S4PA is operational Conclude that GES DISC evolution is complete for AIRS data Objectives
airspro4 8 CPU L1-->L3 Level 1 System Configuration airsproc3 8 CPU L1-->L3 airsraw1 4 cpu L0->L1 airspar 4 CPU on-the-fly analysis acdisc 4 CPU Giovanni OpenDAP airscal 4 CPU on-the-fly susetting Level 3+ Level 2 Level 0
Datatypes: AIR10SCC, AIRAACAL, AIR10XNM, AIR10SCI, AIRASCAL,AIR20XNM, AIR20SCI, AIR20XSM AIRB0SCI, AIRB0CAL, AIRB0CAH, AIRB0CAP, AIRH1ENC, AITH1ENG, AIRH2ENC, AIRH2ENG, AIRH0SCI AIR10SCX, AIRAACAX, AIR10XNX, AIR10SIX, AIRASCAX,AIR20XNX, AIR20SCX, AIR20XSX AIRB0SCX, AIRB0CLX, AIRB0CAX, AIRB0CPX, AIRH1ECX, AITH1EGX, AIRH2ECX, AIRH2EGX, AIRH0ScX 12.5 GB/Day; ~4.4 TB/year Data Source: EDOS Level-0 migration is complete and S4PA reconciliation with ECS holdings has been done Cutover of L0 flow from EDOS completed March 2007 Archive Primary Archive Locations : airsraw1, airsraw2, airsraw3 Replicated Archive Location: rep1 (airsraw1), rep2 (airsraw2, airsraw3) Backups Incremental backups performed daily Backup tapes (full backup, primary archive) taken to B28 weekly Distribution L0 data unpublished, unadvertised in unlisted directory FTP; Subscriptions to AIRS TLSCF for EDS; AIRS TLSCF pulls L0 data for every 24th day (focus day); MRI is configured for AIRS TLSCF on airsraw1, airsraw2, airsraw3 AIRS L0 data
Aqua DPREP Data processing, archive and distribution takes place on airsraw3 PM1EPHD, PMCO_HK, PMCOGBAD, PM1EPHND, PM1ATTNR Radiosonde Observations (RAOBS) Data processing on airsraw3, archive and limited distribution takes place on airscal1 PREPQC, PREPQCH NCEP Aviation Model (AVN) Data format conversion on disc2, archive and limited distribution on airscal1 AVI3_ANH, AVI6_ANH, AVI9_ANH LeapSecT, UTCPoleT Archived on airstst, rsynced across all AIRS processors DPREP / Ancillary data
Data Source: S4PM @ GES DISC Current data stream from S4PM is V005 and only in S4PA V005 reprocessing complete, forward processing at the leading edge V004 data (9/2002 – 8/2007) not migrated from ECS to S4PA Data access (ECS) terminated 10/31/2007 AIRS L1A data produced but is not archived; L1A AMSU archived for QA information 7 L1B Datatypes AIRHBRAD (~ 500 MB total) AIRABRAD (~ 58 GB/year) AIRIBRAD (~ 5100 GB/year) AIRVBRAD (~ 550 GB/year) AIRIBQAP (~220 GB/year) AIRVBQAP (~57 GB/year) AIRXBCAL (~95 GB/year) Data released to public and available via FTP, WHOM, Mirador, WIST/ECHO Backups Incremental backups performed daily Backup tapes (full backup) taken to B28 weekly AIRS L1 data
AIRS L2 data • Data Source: S4PM @ GES DISC • Current data stream from S4PM is V005 and only in S4PA • V005 reprocessing in progress, target date for completion: January 2008 • V004 data (9/2002 – 8/2007) migrated from ECS to S4PA • L2 Datatypes • AIRI2CCF (~ 800 GB/yearl) • AIRX2RET (~ 220 GB/year) • AIRX2SUP (~ 1100 GB/year) • AIRG2SSD (~7.5 GB/year) • AIRX2MAT (~ 128 GB/year)* • AIRX2MTL (~ 193 GB/year)* • AIRXLOC (~ 0.1 GB/year)* *Non-public data used in production • Associated datatypes are available with HSB for the limited time it was functioning • V004 and V005 data released to public and available via FTP, WHOM, Mirador, WIST/ECHO • Backups • Incremental backups performed daily • Backup tapes (full backup) taken to B28 weekly
AIRS L3 data • Data Source: S4PM @ GES DISC • Current data stream from S4PM is V005 and only in S4PA • V005 reprocessing in progress, target date for completion: January 2008 • V004 data (9/2002 – 8/2007) migrated from ECS to S4PA • L3 Datatypes • AIRX3STD (~ 26 GB/yearl) • AIRX3ST8 (~ 5 GB/year) • AIRX3STM (~ 1.4 GB/year) • AIRX3QP5 (~ 3.2 GB/year) • AIRX3QPM (~ 0.5 GB/year) • Associated datatypes are available with HSB for the limited time it was functioning • V004 and V005 data released to public and available via FTP, WHOM, Mirador, WIST/ECHO • Backups • Incremental backups performed daily • Backup tapes (full backup) taken to B28 weekly • Data replicated on rep5
AIRS TLSCF LaRC MODAPS UMiami REMSS S4PA AIRS Data Interfaces
Primary Contacts: Quyen Nguyen, Evan Manning Inbound Data None Outbound Data AIRAASCI AIRAHRE, AIRXBCAL, AIRX2LOC, AIRX2MAT, AIRX2MTL, AIRH2MAT, AIRH2MTL, AIRABRAD, AIRIBRAD, AIRVBRAD, AIRHBRAD, AIRX2RET, AIRX2SUP, AIRI2CCF, AIRH2SUP, AIRH2RET, AVI3_ANH, AVI6_ANH, AVI9_ANH, PREPQC, PREPQCH, PM1EPHND, PM1ATTNR, PMCO_HK Data Transfer Mechanism: FTP Push + MRI AIRH0ScX, AIR10SCX, AIR10SIX, AIR10XNX, AIRAACAX, AIRASCAX, AIT20SCX, AIR20XNX, AIR20XSX, AIRB0CAX, AIRB0CLX, AIRB0CPX, AIRB0SCX, AIRH1EGX, AIRH1ECX, AIRH2ECS, AIRH2EGX, AIR10SCC, AIR10SCI, AIR10XNM, AIR20SCI, AIR20XNM, AIR20XSM, AIRAACAL, AIRASCAL, AIRB0CAH, AIRB0CAL, AIRB0CAP, AIRB0SCI, AITH0ScE, AIRH1ENC, AIRH1ENG, AITH2ENC, AIRH2ENG Data Transfer Mechanism: MRI only All data flows are operational from S4PA AIRS TLSCF
Primary Contact: Albert Bunnell Inbound Data None Outbound Data PM1EPHND, PM1ATTNR Data Transfer Mechanism: FTP Push + MRI All data flows are operational from S4PA LaRC
Primary Contact: Barbara Deshong Inbound Data None Outbound Data PM1EPHND, PM1ATTNR Data Transfer Mechanism: FTP Push All data flows are operational from S4PA MODAPS
Primary Contact: Warner Barringer Inbound Data None Outbound Data PM1EPHND, PM1ATTNR Data Transfer Mechanism: FTP Push All data flows are operational from S4PA UMiami
Primary Contact: Carl Mears (Remote Sensing Systems) Inbound Data None Outbound Data AIRABRAD Data Transfer Mechanism: FTP Pull All data flows are operational from S4PA REMSS
ESDIS Metrics System • AIRS archive, distribution and web log • information published to EMS • Metrics reports are available through EMS
2 AIRS evolution risks recently retired Data Access Performance 2+ TB/day distributed from L1 archive server Throughput Capacity L1 @ 25X, L2/3 @ 12X V005 Reprocessing Status 2002-2004 complete Target date for completion: January 2008 Current Status
All L2/L3 V004 data migrated from ECS to S4PA All V005 data flow into S4PA All data interfaces successfully transitioned from ECS to S4PA All public data in S4PA available through user interfaces ECS no longer needed or used for AIRS data Conclusion