150 likes | 287 Views
Interoperability at work. GIS Workshop 17 June 2014. Jan Bliki Jan.Bliki@eea.europa.eu. The EEA framework to provide policy relevant information (Source EEA, 1999). R EPORTING. EEA data warehouse. explain & communicate. A SSESSMENT. analyse & understand. indicators. I NFORMATION.
E N D
Interoperability at work GIS Workshop 17 June 2014 Jan Bliki Jan.Bliki@eea.europa.eu
The EEA framework to provide policy relevant information (Source EEA, 1999) REPORTING EEA data warehouse explain & communicate ASSESSMENT analyse & understand indicators INFORMATION graphs & maps visualize & describe DATA European databases store & manage ReportNet air Base water Base soil Base ETC Topic Databases waterNet soilNet airNet measure & record MONITORING national databases
Reporting activity for EEA priority dataflows (Source EEA, 1999) • Number of envelopes: 17,073 • Number of releases envelops: 16,230 • Number of files: 214,511 • Number of feedbacks: 54,546 • 120-150 GB data per year
Cross-sector data interoperability (EEA, 2014) INSPIRE data Data from other sectors SD:Species distribution Waste EL:Elevation PD: Population Distribution PRTR SEVESO TN:Transport networks Urban Planning Waste Management Plans Environmental Impact Assessment Risk Management … ER:Energy Resources PF:Production and industrial facilities US: Utilities and Governmental Services (Waste Management) AF:Agricultural and aquaculture facilities • SO:Soil • BU:Buildings • AM:Area management/ restriction/ regulation zones & reporting units HB:Habitats and biotopes
Internet of things (EEA, 2014) Software as a Service (SaaS) Linked data XML SQL TXT WMS XLS GDB JSON ATOM REST WFS FTP INSPIRE SMTP MDB Social Media RDF Web sites KML GML ZIP HTML TAB
Server constellation for GIS content (EEA, 2013) http://maps.discomap.eea.europa.eu http://discomap.eea.europa.eu http://sdi.eea.europa.eu http://eea.maps.argis.com http://cr.eionet.europa.eu/ http://www.eea.europa.eu HTTP HTTP Web mapsArcGis online PLONE DAVIS Map applicationsArcGis online Rest-api’s, WMS, WFS, CSW (Web Services) python Geo-networks ArcGis online ArcGis Server ReportNet SQL Server Microsoft Azure RDF Active Batch
Automation of the entire process (EEA, 2014) Microsoft SQL Server Python Scripting ArcGis Modal Builder 10,000+ lines of code 400+ SQL procedures 100+ Modals
Maintenance and complexity (EEA, 2014) EEA needed to search for graphical ETL tools ETL = Extract-Transform-Load strategical experience Effort (time) Visual Flow and Self-Documentation Can handle data clean-up Is robust Is obvious and easy to learn Customizable Strongly GIS oriented Multiple formats Supports INSPIRE formats Server oriented Is well integrated with EEA SDI Soft. not documented Scripting environments Visual development tools documented obvious things Ability
Our choice (EEA, 2014) FME Workbench (Desktop) FME Server
Server constellation for GIS content (Updated) (EEA, 2014) http://maps.discomap.eea.europa.eu http://discomap.eea.europa.eu http://sdi.eea.europa.eu http://eea.maps.argis.com http://cr.eionet.europa.eu/ http://www.eea.europa.eu HTTP HTTP Web mapsArcGis online PLONE DAVIS Map applicationsArcGis online Rest-api’s, WMS, WFS, CSW (Web Services) python Geo-networks ArcGis online FME Server ArcGis Server ReportNet SQL Server Microsoft Azure RDF Active Batch
Results (march 2014 – may 2014) Natura 2000 exports formats Total development time : 5 working days Previous scripts : 24 working days for partial solutionMaintenace cost : Reduced to 80%
Example Natura 2000 (march 2014 – may 2014) Natura 2000 exports formats Total development time : 5 working days Previous scripts : 24 working days for partial solutionMaintenace cost : Reduced to 80%
Example generic download option (march 2014 – may 2014) Any web map must have a download Total development time : 15 working days Reads: Map/Feature/Raster services (REST,WFS,CSW) Filters: Boundingbox, Attributes, Timeline, Visible Ouput: Shape, KML, GML, SQLLite
Example customization (march 2014 – may 2014) EEA Specific formats integrated • One time created, used many • Plug and play • Easy to use by none developers
Questions ? Thank you! Jan.Bliki@eea.europa.eu