300 likes | 436 Views
Agenda Item: 1.a.iv Statistical Review Since Last FTF – Products (NOAA). by: Bill Byerly / SSAI (OSPO/ESPC) Tel.: +1-301-817-3874 Mail: william.byerly@noaa.gov. IJPS BiLateral , Suitland, Maryland 04-06 June 2013 1.a.iv - Statistical Review Since Last FTF – Products (NOAA)
E N D
Agenda Item: 1.a.ivStatistical Review Since Last FTF – Products (NOAA) by: Bill Byerly / SSAI (OSPO/ESPC) Tel.: +1-301-817-3874 Mail: william.byerly@noaa.gov IJPS BiLateral, Suitland, Maryland 04-06 June 2013 • 1.a.iv - Statistical Review Since Last FTF – Products (NOAA) Presenter: Bill Byerly, Email: william.byerly@noaa.gov
Contents IJPS BiLateral, Suitland, Maryland 04-06 June 2013 • 1.a.iv - Statistical Review Since Last FTF – Products (NOAA) Presenter: Bill Byerly, Email: william.byerly@noaa.gov • Overview • Data Coverage Trends • Missing Data • Short Data • Unrecoverable Losses Due to Missing & Short Data Receipts • Internal Data Gaps • Data Coverage Summary • Presentation Summary
Overview IJPS BiLateral, Suitland, Maryland 04-06 June 2013 • 1.a.iv - Statistical Review Since Last FTF – Products (NOAA) Presenter: Bill Byerly, Email: william.byerly@noaa.gov • This report uses AVHRR data from NOAA GAC and Metop FRAC data that were received and processed at NOAA’s ESPC polar 1b production system as a proxy for assessing data coverage • The focus is data received during Dec 2012 through May 2013 • Historical perspective is provided using plots covering the past year • Definitions: • GAC refers to NOAA recorded data (4 km AVHRR) • FRAC refers to Metop recorded 1 km AVHRR data • Metop-A statistics are used prior to 24 Apr 2013 – Metop-B statistics are used thereafter Note: This report identifies data loss using the name of the ground station that was scheduled to acquire the data. Data loss may occur on the S/C or in any of the components in the data communication path leading to the NOAA 1b polar production computer and thus does not necessarily indicate a problem with the ground station.
Data Coverage Trends – Missing Data IJPS BiLateral, Suitland, Maryland 04-06 June 2013 • 1.a.iv - Statistical Review Since Last FTF – Products (NOAA) Presenter: Bill Byerly, Email: william.byerly@noaa.gov If no part of a GAC or FRAC is received for NOAA 1b processing then it is reported as missing If bad GAC or FRAC data are received that cannot be even partially processed then the loss is reported as missing data If a missed GAC is recovered at another CDA then it is reported as missed from the planned CDA - however the loss is not included in the overall Data Coverage Summary that is shown in a later slide If a GAC arrives late from the planned CDA then it is not reported as missing Note that McMurdo FRAC data always has ~½ orbit data coverage – Svalbard FRAC data may be ~½ orbit or full orbit
Missing GACs and FRACs Number of missed data receipts/month since last face-to-face IJPS BiLateral, Suitland, Maryland 04-06 June 2013 • 1.a.iv - Statistical Review Since Last FTF – Products (NOAA) Presenter: Bill Byerly, Email: william.byerly@noaa.gov
Missing GACs and FRACs Number of missed data receipts/month since Last Face-to-Face • Rev 21195 not acquired @ SVL – recovered @ WCDA • Rev 21221 not acquired due to EUM GS anomaly – recovered @ WCDA • Rev 32335 lost due to EUM GS anomaly • Rev 32585 not received @ NSOF or CIP OBF • Rev 33587 not received @ NSOF or CIP OBF • Rev 33274 lost due to EUM GS anomaly • Rev 3349 not received IJPS BiLateral, Suitland, Maryland 04-06 June 2013 • 1.a.iv - Statistical Review Since Last FTF – Products (NOAA) Presenter: Bill Byerly, Email: william.byerly@noaa.gov
Missing GACs and FRACs Number of missed data receipts/month during the past year Significantly less missed data receipts during past 6 months when compared to previous 6 months IJPS BiLateral, Suitland, Maryland 04-06 June 2013 • 1.a.iv - Statistical Review Since Last FTF – Products (NOAA) Presenter: Bill Byerly, Email: william.byerly@noaa.gov
Data Coverage Trends – Short Data IJPS BiLateral, Suitland, Maryland 04-06 June 2013 • 1.a.iv - Statistical Review Since Last FTF – Products (NOAA) Presenter: Bill Byerly, Email: william.byerly@noaa.gov • Short GACs or FRACs are identified whenever there is a gap between consecutive data streams or data files • A GAC or FRAC is not reported as short if either: • A data replay or reship recovers the missing data • A data loss is limited to the overlapping coverage between consecutive GACs or FRACs
Short GACs and FRACs Number of short data receipts/month since last face-to-face IJPS BiLateral, Suitland, Maryland 04-06 June 2013 • 1.a.iv - Statistical Review Since Last FTF – Products (NOAA) Presenter: Bill Byerly, Email: william.byerly@noaa.gov
Short GACs and FRACs Number of short data receipts/month since last face-to-face • SVL rev 32148 (EUM FEP prob.) • McM revs 31750, 31816, 31830, 32119 (losses in all except 31816 were recovered in SVL data – net loss = ~3.5 minutes) • SVL rev 32615 (rack move) • McM rev 32335 (loss recovered in SVL data) • FCDA rev 20090 (year crossover) Rev 3166 (loss recovered in SVL data) Rev 33274 (loss recovered in SVL data) IJPS BiLateral, Suitland, Maryland 04-06 June 2013 • 1.a.iv - Statistical Review Since Last FTF – Products (NOAA) Presenter: Bill Byerly, Email: william.byerly@noaa.gov
Short GACs and FRACs Number of short data receipts/month during the past year Significantly less short data receipts during past 6 months when compared to previous 6 months IJPS BiLateral, Suitland, Maryland 04-06 June 2013 • 1.a.iv - Statistical Review Since Last FTF – Products (NOAA) Presenter: Bill Byerly, Email: william.byerly@noaa.gov
Unrecoverable Data Losses Due to Missing & Short GACs/FRACs (since last face-to-face) IJPS BiLateral, Suitland, Maryland 04-06 June 2013 • 1.a.iv - Statistical Review Since Last FTF – Products (NOAA) Presenter: Bill Byerly, Email: william.byerly@noaa.gov
Unrecoverable Data Losses Due to Missing & Short GACs/FRACs (during the past year) Significantly less unrecoverable losses during past 6 months when compared to previous 6 months although losses would have been similar if there wasn’t the July 2012 comm problems IJPS BiLateral, Suitland, Maryland 04-06 June 2013 • 1.a.iv - Statistical Review Since Last FTF – Products (NOAA) Presenter: Bill Byerly, Email: william.byerly@noaa.gov
Data Coverage Trends – Internal Data Gaps IJPS BiLateral, Suitland, Maryland 04-06 June 2013 • 1.a.iv - Statistical Review Since Last FTF – Products (NOAA) Presenter: Bill Byerly, Email: william.byerly@noaa.gov Internal data gaps refer to when there are missing data within a data stream or file 2 NOAA GAC scans or 6 Metop FRAC scans are expected for each second of observation data Internal data gaps are often accompanied by other data quality problems If internal gap losses are recovered by a replay or reship then the original data loss is not reported
Internal Data Gaps Number of data receipts with gaps since last face-to-face IJPS BiLateral, Suitland, Maryland 04-06 June 2013 • 1.a.iv - Statistical Review Since Last FTF – Products (NOAA) Presenter: Bill Byerly, Email: william.byerly@noaa.gov
Fractionof GACs/FRACs with Internal Gaps Since Last Face-to-Face The percentage of NOAA-19 Svalbard GACs with internal gaps has decreased significantly in recent months. These gaps were typically only 1/2 second per GAC. The monthly data loss was minimal even though the percentage of affected GACs was high. IJPS BiLateral, Suitland, Maryland 04-06 June 2013 • 1.a.iv - Statistical Review Since Last FTF – Products (NOAA) Presenter: Bill Byerly, Email: william.byerly@noaa.gov
Fractionof GACs/FRACs with Internal Gaps During the Past Year Single internal data gaps that have been common in NOAA-19 GAC data streams from Svalbard are no longer occurring – these gaps usually resulted in the loss of only 1/2 second of observation data and were not accompanied by other data quality problems IJPS BiLateral, Suitland, Maryland 04-06 June 2013 • 1.a.iv - Statistical Review Since Last FTF – Products (NOAA) Presenter: Bill Byerly, Email: william.byerly@noaa.gov
Data Loss Due to Internal Gaps Since Last Face-to-Face IJPS BiLateral, Suitland, Maryland 04-06 June 2013 • 1.a.iv - Statistical Review Since Last FTF – Products (NOAA) Presenter: Bill Byerly, Email: william.byerly@noaa.gov
Data Loss Due to Internal Gaps Since Last Face-to-Face Number with Internal Gaps Minutes Lost Due to Internal Gaps • The monthly data loss due to internal gaps in NOAA-19 Svalbard GACs was minimal even though gaps were found in many of these data streams. • The data losses due to internal gaps in Fairbanks GACs are many times greater even though internal data gaps were present in much fewer GACs IJPS BiLateral, Suitland, Maryland 04-06 June 2013 • 1.a.iv - Statistical Review Since Last FTF – Products (NOAA) Presenter: Bill Byerly, Email: william.byerly@noaa.gov
Data Loss Due to Internal Gaps During the Past Year IJPS BiLateral, Suitland, Maryland 04-06 June 2013 • 1.a.iv - Statistical Review Since Last FTF – Products (NOAA) Presenter: Bill Byerly, Email: william.byerly@noaa.gov
Data Coverage Summary (Since Last Face-to-Face) NOTE: Coverage includes missing and short data that were recovered in a reasonable time 03 December 2012 02 June 2013 IJPS BiLateral, Suitland, Maryland 04-06 June 2013 • 1.a.iv - Statistical Review Since Last FTF – Products (NOAA) Presenter: Bill Byerly, Email: william.byerly@noaa.gov
Data Coverage Summary (Past 12 Months) NOTE: Coverage includes missing and short data that were recovered in a reasonable time Significantly better data coverage during the past 6 months when compared to previous 6 months 02 June 2013 04 June 2012 IJPS BiLateral, Suitland, Maryland 04-06 June 2013 • 1.a.iv - Statistical Review Since Last FTF – Products (NOAA) Presenter: Bill Byerly, Email: william.byerly@noaa.gov
Presentation Summary IJPS BiLateral, Suitland, Maryland 04-06 June 2013 • 1.a.iv - Statistical Review Since Last FTF – Products (NOAA) Presenter: Bill Byerly, Email: william.byerly@noaa.gov • Significantly better data coverage during the past 6 months when compared to previous 6 months • Significantly less missed data receipts • Significantly less short data receipts • Significantly less unrecoverable losses • The impact of internal gaps varies considerably • A small number of gaps can result in a relatively large loss of observation data • A large number of gaps can result in a relatively small loss of observation data • The percentage of NOAA-19 Svalbard GACs with internal gaps has decreased significantly in recent months
Backup IJPS BiLateral, Suitland, Maryland 04-06 June 2013 • 1.a.iv - Statistical Review Since Last FTF – Products (NOAA) Presenter: Bill Byerly, Email: william.byerly@noaa.gov
Data Coverage Summary NOTE: Coverage includes missing and short data that were recovered in a reasonable time 02 June 2013 17 September 2007 [NOTE: NOAA-18 plotted prior to June 2009; NOAA-19 plotted thereafter] IJPS BiLateral, Suitland, Maryland 04-06 June 2013 • 1.a.iv - Statistical Review Since Last FTF – Products (NOAA) Presenter: Bill Byerly, Email: william.byerly@noaa.gov
Missing GACs and FRACs Since September 2007 IJPS BiLateral, Suitland, Maryland 04-06 June 2013 • 1.a.iv - Statistical Review Since Last FTF – Products (NOAA) Presenter: Bill Byerly, Email: william.byerly@noaa.gov
Short GACs and FRACs Since September 2007 IJPS BiLateral, Suitland, Maryland 04-06 June 2013 • 1.a.iv - Statistical Review Since Last FTF – Products (NOAA) Presenter: Bill Byerly, Email: william.byerly@noaa.gov
Unrecoverable Losses Due to Missed and Short GACs/FRACs Since September 2007 IJPS BiLateral, Suitland, Maryland 04-06 June 2013 • 1.a.iv - Statistical Review Since Last FTF – Products (NOAA) Presenter: Bill Byerly, Email: william.byerly@noaa.gov
Number of Data Receipts with Gaps Since September 2007 IJPS BiLateral, Suitland, Maryland 04-06 June 2013 • 1.a.iv - Statistical Review Since Last FTF – Products (NOAA) Presenter: Bill Byerly, Email: william.byerly@noaa.gov
Data Loss Due to Gaps Since September 2007 IJPS BiLateral, Suitland, Maryland 04-06 June 2013 • 1.a.iv - Statistical Review Since Last FTF – Products (NOAA) Presenter: Bill Byerly, Email: william.byerly@noaa.gov