160 likes | 170 Views
This workshop explores the common developments and infrastructures for Eurostat modernisation, including data warehouses, IT infrastructure, standardisation, and collaboration tools.
E N D
Overall framework :The ESS instruments - a review J.M. Museux – Eurostat Methodology and Research Unit jean-marc.museux@ec.europa.eu
Joint strategy : how we produce EU statistics • The development of data warehouses and HUB mode/technology for enabling vertical integration of processes and the development of multipurpose statistics • The development of interoperability of systems through the reuse of IT tools and sharing of resources (SOA, distributed architecture, data and metadata exchange standards (SDMX), metadata repositories, etc.). • The development of metadata systems, methodological and statistical standards and common IT tools aiming at industrialisation of production processes. • Innovation in methods for producing statistics like reuse existing data sources, data matching and linking, mixed modes approach, visualisation and macro validation … aiming at efficiency gains and quality improvements. • Better documentation of processes (process indicators and metadata) as a back bone for monitoring efficiency-quality trade off and quality assurance. ESSnet workshop
Legal framework : from stove pipe legislation to cross cutting framework legislation Methodological developments Best practices – guidelines – rules Common tools Modernisation of IT infrastructure (SOA, web services, distributed, use of standardised IT solutions) Standardisation and industrialisation Common description and semantic Common data exchange standard Common metadata Common tools ESS strategy ESSnet workshop
ESS architectures Common developments/ infrastructures International standards ESSnet workshop
ESSnets A collaborative network of several ESS organisations aimed at providing results beneficial to the whole ESS 26 ESSnet projects since 2008 - a portal www.essnet-portal.eu ESSnet functions: review - coordination - planning ESSnet mapping according to their contribution to innovation process ESSnet workshop
ESSnets typology ESSnet research consolidation and incorporation of research knowledge and testing of prototype tools Ex. SDC I - ISAD ESSnet pole of expertise specialisation in process steps – cover wider range of activities (best practices identification, guidelines, tool development, dissemination of knowledge-know how and training Ex SDC II, DI, SAE, Mixed mode approach ESSnet infrastructure facilitation to incorporation of international standards, recommendations, cases studies, taylorisation, improvement of standards, setting up of common infrastructure Ex. EGR, SDMX I & II, MEETS Datawarehouse, Geostat, CORA & CORE, Decentralised access to EU micro data ESSnet workshop
ESSnets typology ESSnet standardisation contribute to knowledge and process standardisation (concept, tools, guidelines, ….) Ex SDC harmonisation, MEETS Memobust, Preparing Standardisation ESSnet strategy : support to strategic action like Sponsorship on Standardisation ESSnet piloting domain dependent, testing in common, practical implementation ESSnet workshop
ESSnet – contribution to a reference architecture Stand Prep SDC Harm Memobust DI Consistency CORE DW EGR SDMX Decentralised Access ESSnet ESSnet workshop
Contribution to ESS business process Net SILC Culture Geostat PH Administrative Data Profiling DI ICT Linking SDC ESSnet workshop SAE
Common tool development Tools developed in common for implementing ESS guidelines Need for specific governance and development strategy Open source Modular – web service – portability (JAVA) ESS Steering Group – User group Best practice Demetra+ : Tool for implementing ESS seasonal adjustment guidelines Demetra+ user group – prototype development Java toolkit (API, GUI, Data cruncher to be run in batch, library of core functions, structured objects) Re-used for Ecotrim, NAPS developments Argus+ : sustainability of T-Argus – proof of concept Metadata and SDMX “suite” ESSnet workshop
Eurostat modernisation - VIPs Strategic project for Eurostat and ESS modernisation Joint venture between business area units (relevance) and horizontal units (methodology, IT) 9 projects (still on going) being launched in 2010, 2011 and 2012 • Data matching • Secure infrastructure for sharing confidential data • Data validation (vertical integration) • New Eurostat dissemination chain • National account production system • Geospatial statistics & tools • HUB for ICT statistics • PILLAR approach for household data collection • Administrative sources for social statistics • Master in Official statistics ESTAT process /infrastructure ESS focus ESSnet workshop
Eurostat modernisation - VIPs Common characteristics Cross domains development ESTAT focus - IT or process oriented ESS focus Prepare for higher (MS- Eurostat) integration Need to maintain global coherence Planning – yearly work programme Spin off of ESS(net) project ESS relevance - coordination ESSnet workshop
VIP, ESSnet – elements of coherence Stand Prep ICT HUB Memobust SDC Harm Data Matching DW DI Pillar Data Validation Geo Admin New Diss Consistency CORE DW Demetra+ NAPS Argus+ EGR SDMX Decentralised Access SICON ESSnet Common tools VIP ESSnet workshop
Strategic level – sponsorship Sponsorship on standardisation Sponsorship group : general directors or deputies of NSOs (NL,DE, HU, IT, FR, LV), co chaired by CBS and Eurostat IT director to build mechanism and steer competence on key challenge for the ESS over a relatively short period (2 years) Sponsorship is expected to define the scope and the business case for ESS standardisation; review the state of the art, identify barriers and proposed remedies to set up an action plan and mechanism for standardisation in the ESS liaise with external initiatives and actively involve stakeholders. ESSnet workshop
Strategic level – initial reflection Standardisation is a process: Set up, agree on standards Maintain and manage coherence Support use and implementation of standards Key elements Standards (rules, guidelines, handbook, tools) are agreed by consensus Mixed (bottom up and top down approach) ESSnet and standardisation All Essnets contains the seeds for standardisation ESSnet lack of focus, ESSnet follow up How to make it happen ? ESSnet workshop
Conclusions Many initiatives on going – bottom up approach initially Hard to maintain coherence between different layers, scope Need for an Enterprise Architecture approach Assembling the different piece of the jigsaw Defining ESS common architecture elements (principles, common target, ….) allowing distributed and coherent developments and overall alignment Tool for strategic planning and for driving change ESSnet workshop