300 likes | 449 Views
EoI 2003. EoI Report Upload process DEMv7. EoI 2003 : EoI report. Status Use of DEM Transmission. EoI Report : Status. 28 countries reported 2 more countries expected Oct.1st : 75 % received. EoI Report : Use of DEM. DEM reports: 85 % (EMEP: 4 MS). Problems using DEM:
E N D
EoI 2003 • EoI Report • Upload process • DEMv7 8th EIONET Workshop AQ,Oslo
EoI 2003 : EoI report • Status • Use of DEM • Transmission 8th EIONET Workshop AQ,Oslo
EoI Report : Status • 28 countries reported • 2 more countries expected • Oct.1st : 75 % received 8th EIONET Workshop AQ,Oslo
EoI Report : Use of DEM • DEM reports: 85 % (EMEP: 4 MS) • Problems using DEM: • adding/modifying meta information • adding results of new measurements • ... • Reasons not using DEM: • problems using DEM • lack of time 8th EIONET Workshop AQ,Oslo
EoI Report : Transmission • ETC ftp-site • CD • ReportNet/CDR 8th EIONET Workshop AQ,Oslo
EoI 2003 : Upload process • Procedure • Report checks • Communication • Time schedule 8th EIONET Workshop AQ,Oslo
Upload process: Procedure • Report/quality checks • Upload DEM into AirBase • Report results checks to Member States • Process reply Member States • Preparing for Report 8th EIONET Workshop AQ,Oslo
Upload process: Report checks • Re-submitted raw data • Deleted meta data • Missing essential meta data • Outliers 8th EIONET Workshop AQ,Oslo
Upload process: Report checks • Re-submitted data (general report) 8th EIONET Workshop AQ,Oslo
Upload process: Report checks • Re-submitted data (detail report) 8th EIONET Workshop AQ,Oslo
Upload process: Report checks • Deleted meta data (stations) 8th EIONET Workshop AQ,Oslo
Upload process: Report checks • Deleted meta data (measurements) 8th EIONET Workshop AQ,Oslo
Upload process: Report checks • Missing essential meta data 8th EIONET Workshop AQ,Oslo
Upload process: Report checks • Outliers (general report) 8th EIONET Workshop AQ,Oslo
Upload process: Report checks • Outliers (detail report) 8th EIONET Workshop AQ,Oslo
Upload process: Communication • Status upload EoI 2003 on website • reply results upload reports: • re-submission raw data -> confirmation • outliers -> re-submission • deleted meta data with data stored in AirBase -> confirmation • missing essential meta data -> updated DEM • Technical/AQ report 2002 8th EIONET Workshop AQ,Oslo
Upload process: Time schedule 8th EIONET Workshop AQ,Oslo
EoI 2003 : DEMv7 • Integration with New Ozone Directive (2002/3/EC) dataflow • Integration with Reportnet (Upload to CDR) • Solving bugs and other problems in DEMv6 8th EIONET Workshop AQ,Oslo
Data flows Ozone Directives 92/72/EEC and 2002/3/EC What Format old new monthly <1/n+2 ex1 ex1 summer 31/10 - ex 8, aot40, 1hmax annual 30/9 ex1/8/24 ex1/8, [stat], stat [prec], aot40 8th EIONET Workshop AQ,Oslo
Experiences with Directive 92/72/EEC data flows Major problems: • Station meta information not complete • Linking info between files (which data belongs to which station) 8th EIONET Workshop AQ,Oslo
Proposal • Spreadsheet based • Link between files based on EU station code • New stations: station sheet • Existing stations: meta info from AirBase • Annual data combining with EoI (DEM) 8th EIONET Workshop AQ,Oslo
Sheets: • Exceedance sheet (monthly, summer, year) • Summer statistics • Annual statistics (aot40, [mean, percentiles, max]) • Precursor sheet [ann mean, percentiles, max] • Station sheet (new stations) [station info] 8th EIONET Workshop AQ,Oslo
Sheets-import in DEM: • Only in the annual (30/9) delivery • Annual exceedance, statistics and precursor sheets can also be imported in DEMv7 • The annual statistics and precursor data can also be imported in DEM with standard DEM import formats • At the annual report new station information can be processed directly in the DEM. 8th EIONET Workshop AQ,Oslo
Dataflows Sheet monthly Exceedance (Station) summer Exceedance (Station) Statistics annual Exceedance [Statistics] [DEM] [Precursor] [DEM] 8th EIONET Workshop AQ,Oslo
AQ-DEM and ReportNet • Data Dictionary • AQ-DEM can support the development of a data dictionary format derived from the data model of Airbase according the requirements of the decisions and directives. • Indicator production • Air pollution indicators by using air quality data from Airbase • AQ-DEM • Supports dataflow from MS national database to European data warehouse's AirBase • QC on meta information (networks, stations, meas. Conf.) • QA/QC on measurement data • Legal basis • EoI decision • Ozone directive • EuroAirnet • EMEP/CCC • AQ reporting requirements, formats and guidances • Availability of data • Airbase (available via Internet (AirView)) • XML-dumps of complete AirBase on ETC/ACC-ftp • Factsheets • Meta-data in techn. report on national data reporting • Data flow • ETC-ACC receives AQ-DEM’s (MS Access mdb files) on CDrom or by FTP • The MS load the AQ-DEM also in the CDR 8th EIONET Workshop AQ,Oslo
Transmitting data from EU-countries to Commission, EEA, ETC/ACC and EMEP/CCC • EoI/EuroAirnet (+ EMEP) data • CDROM to EU-Commission (Inform ETC/ACC and EEA) or: • CDROM to ETC/ACC (Inform EU-Commission and EEA) or: • Upload to EEA’s CDR (Inform EU-Commission and ETC/ACC) if CDR failed then: • Upload to ETC/ACC FTP (Inform EU-Commission And EEA) • Only EMEP data in DEM: • Upload to ETC/ACC FTP (Inform EMEP/CCC) 8th EIONET Workshop AQ,Oslo
Transmitting data from non-EU-countries to EEA, ETC/ACC and EMEP/CCC • EoI/EuroAirnet (+ EMEP) data • CDROM to ETC/ACC (Inform EEA) or: • Upload to EEA’s CDR (Inform ETC/ACC) if CDR failed then: • Upload to ETC/ACC FTP (Inform EEA) • Only EMEP data in DEM: • Upload to ETC/ACC FTP (Inform EMEP/CCC) 8th EIONET Workshop AQ,Oslo
Bugs Demv6 • It is not possible to add new measurement configurations and to modify existing measurement configurations ( NL, GR, BU, RO, SE ) • The station identification in the mark-file should be not only the station name but also the station code (DE) 8th EIONET Workshop AQ,Oslo
Other problems (1) • The generation of the NASA Ames header file gives problems when importing EMEP-info by means of DEM-file (NL). When exporting the NASA Ames files the quality flags are not correct. • Comboboxes of the Station and Measurement configuration screens do not work properly. • The Meta Information, Measurement Configuration report does not work. • Visualisation of weekly and annual means is not ok. • Timing day samples can start at another time than 0:00 hour. (When importing the samples the time is default set at 0:00 hr) (NL) • Missing some components in the component list (iso-hexane, benzo(a)pyrene, nitrogen monoxide). Benzene in the main list. (UK, NL, AT). 8th EIONET Workshop AQ,Oslo
Other problems (2) • When on a station a component is measured with two measurement methods, only one method is in the Mark-file (NL). • When a station is shut down during a year, this is not identified in the Mark-file (NL). • Some small problems with QA/QC module (NL). • Unable to enter 2-week benzene means since some of the data is 13, 14 or 15-day samples. (UK) • In the MeteoPar. tab also the possibility: “no meteo measured”. (NL). • The .mdb DEM-file can be very big: > 1 Gb. Add a warning and the access option “compact database” (=standard access tool) (UK, NL). • Problems with decimal symbol in the coordinates (AT). • Changing the manager info changes automatically the data supplier info (NL). 8th EIONET Workshop AQ,Oslo