70 likes | 203 Views
WP3: ‘Rapid data delivery at 4 NDACC stations’. Partners: BIRA-IASB INTA Universitaet Bern Karlsruher Institut fuer Technologie CNRS Universitaet Bremen Université de Liège Science and Technology B.V.
E N D
WP3: ‘Rapid data delivery at 4 NDACC stations’ Partners: BIRA-IASB INTA Universitaet Bern Karlsruher Institut fuer Technologie CNRS Universitaet Bremen Université de Liège Science and Technology B.V. NORS/NDACC UV-VIS meeting, Brussels, 3-4 July 2012 1
WP3 objectives • To implement procedures for operational delivery of NDACC data to the NORS data server with a delay of maximum 1 month after data acquisition • Use of a common HDF format compliant with GEOMS (Generic Earth Observation Metadata Standard) guidelines • Data andstations: NORS/NDACC UV-VIS meeting, Brussels, 3-4 July 2012 2
WP3 tasks • For all WP3 participants: • Task 3.1: Development of software routines to save data in the defined HDF format compliant with GEOMS • Task 3.2: Implementation of automatic data processing systems generating the data products, including a QA/QC validation step • Task 3.3: Set up of data delivery systems providing the data products within 1 month to the NORS data center (MS3, Month 6: April 2012) • Task 3.4: Test runs and demonstration of operational data delivery system • Task 3.5: Optimisation of data delivery system • Task 3.6: Routine data delivery to the NORS data center (D3.1, Month 21: July 2013) NORS/NDACC UV-VIS meeting, Brussels, 3-4 July 2012 3
Rapid data delivery system IASB-BIRA rapid data delivery system (UV-VIS data): Vertical profile +information content +error budget QA/QC OEM profiling HDF files on NORS data server Absorption spectra on BIRA-IASB server Absorption spectra at station ftp QDOAS analysis HDF files ftp DSCDs column retrieval AMF LUTs Vertical columns +information content +error budget QA/QC AVK LUTs NORS/NDACC UV-VIS meeting, Brussels, 3-4 July 2012 4
HDF/GEOMS data format Format description and tools for HDF files creation are available on AVDC at: http://avdc.gsfc.nasa.gov/index.php?site=1876901039 Important for the NDACC UV-vis WG to move to this data format NORS/NDACC UV-VIS meeting, Brussels, 3-4 July 2012 5
Quality Assurance/Quality Control • Regarding the HDF files content and format, verifications are performed by the idlcr8hdf.savIDL program, e.g.: • Variable values outside the specified range • Uncorrect fill-in values • Inconsistencies in the time variable (DATETIME) • …. • Additional quality checks to implement (to be discussed): • Profile retrievals based on OEM: remove retrievals with low DOFS and/or large residuals • For stratospheric NO2 columns, remove data contaminated by tropospheric pollution (Langley-plot technique) • …. NORS/NDACC UV-VIS meeting, Brussels, 3-4 July 2012 6
Planning of rapid data delivery • Month 6 (April 2012): for each partner, set up and demonstration of their rapid data delivery system • Months 7-20 (May 2012-June 2013): Optimisation of data delivery systems • Month 21 (July 2013): Operational data delivery • Month 22 (August 2013): Preliminary documentation of data delivery systems • Month 33 (July 2014): Final documentation of data delivery systems After NORS, implementation of a similar data delivery system for all the NDACC UV-vis stations ? NORS/NDACC UV-VIS meeting, Brussels, 3-4 July 2012 7