140 likes | 244 Views
Networks and Information Models Roma 04-12-2012 Georges Pongas. « Networking » Cross cutting project. Value added services for exchange of - statistical information including confidential data among ESS partners --at reasonable cost --with security --with high reliability
E N D
« Networking » Cross cutting project • Value added services for exchange of • - statistical information including confidential data among ESS partners • --at reasonable cost • --with security • --with high reliability • --backbone of future infrastructure
Current situation • Edamis/Stadium/Statel • -conceived in late 80’s • -runs at Eurostat servers and is based on a virtual system • -satisfies confidentiality requirements • -current monthly workload :15GB
VIPS Needs • Accomodate requirements for ICT, EGR, VIPV, SIMSTAT meaning: • -an increase of the throught to at least 100GB • -implementing a symmetric behavior in the data exchange • -implement exchange behavior to the VIP applications
Objectives • Create at ESS level a secured network for large amounts of data • Apply SOA principles to insure extensibility and modularity • Give facilities for future applications integration • Apply synergies (reuse existing successful initiatives such as CCN/CSI) to diminish costs
Planning • Preparatory work to cover the needs of SIMSTAT (2013-2015) • Finalize the system to integrate all the ESS VIP projects (2016-2017)
Information Models • Foundation • Interoperability of processes and applications requires that the transfered information is described • Common information models are the backbone of a cross cutting infrastructure where many stakeholders are implicated.
Current Situation • Most ESS data do not use a standard information model • Some transmissions use CSV with variables description located in independent data transmission guides • Gesmes transmissions depend on inaccessible DBs. • SDMX increased use to note.
(Continued) • There is no common standard agreed fot the description of register or microdata files • There is no standard for the trasmission of complex edit rules • DDI , the dominant initiative for describing microdata, is not used by the ESS.
(Continued 2) • The Generic Statistical Information Model (GSIM) aiming to cover all statistical objects is under development GSIM is aligned with DDI and SDMX without being tied to implementation details.
The needs • Insure coherence among ESS projects • Insure interoperability between information systems • Be generic enough to describe all statistical data structures (micro, macro, meso and meta) • Be mappable to DBMSs • Provide links between formats
Project Benefits • Integration of data and metadata makes easy : • To locate and retrieve data • To write applications reading and writing data • To write complex statistical applications
Project Objectives • To remain a non informatics project • Gather all the information SDMX, DDI, GSIM • Transmit relevant knowledge through seminars and summarizing documents distribution • Create guidelines for transactionsl/register data descriptions • Create guidelines for DDI use inside the ESS • Analyse limitations of SDMX and possible synergies with DDI
(Continued) • Time series handling extensions of the current initiatives. • Metadata storage needs analysis • Analysis of CORE and GSIM outputs • Define an information model for process descriptions • …..