Implementing ESS standards for reference metadata and quality reporting at Istat

1. Implementing ESS standards for reference metadata and quality reporting at Istat Work Session on Statistical Metadata Topic (i): Metadata standards and models Giorgia Simeoni, Istat Unit «Quality, audit and harmonisation» simeoni@istat.it 6 May 2013

2. Contents Project background SIDI/SIQualarchitecture and contents ESS standardsfor referencemetadata and qualityreporting Project objectives and outline The quality reports subsystem design

3. Project background • ESS referencemetadata and quality reporting conceptualharmonisation: • Euro-SDMX MetadataStructure (ESMS) • ESS Standard for Quality Reports Structure (ESQRS) • National implementation in progresssupported by SDMX compliant IT tools (MetadataHandler) • SIDI/SIQual - Istat officialsystem for referencemetadata and qualityindicatorsdocumentation – includes a lot of information required from ESMS and ESQRS Project: to enhance SIDI/SIQual in order to produce ESS standard metadatafiles and qualityreports in compliance with SDMX technicalstandards

4. SIDI/SIQual

5. SIDI/SIQualarchitecture SIDI SIQual internet Staff Management Reference metadata ETL National Statistical Programme Reference metadata Management metadata Input GUI SIQual intranet Quality indicators Reference metadata Dissemination website Quality indicators ARMIDA (Validated microdata) Product quality report Processquality report DARC (Administrative archive) Short method. note IT Application Catalogue Quality reporting

6. SIDI/SIQualcontents • OPERATIONS • Phases • Operations • Sub-operations • QUALITY CONTROL ACTIONS • Phase/Non sampling Errors • Preventing • Monitoring • Evaluating • GENERALISED SOFTWARE • Phases • Software • IN-DEPTH DOCUMENTATION: • Sampling design • Index production methodology • … CONCEPTUAL METADATA Themes Units …. • DOCUMENTS REPOSITORY • Regulations, Manuals • Questionnaires • Documents (fieldoperations, methods, standards, …) • STANDARD QUALITY INDICATORS • Processoriented • Product oriented

7. ESS standards for reference metadata and quality reporting Euro SDMX MetadataStructure ESMS Example

8. ESS standards for reference metadata and quality reporting ESS Standard for Quality Reports Structure

9. Project objectives and outline • Project: • Enhancing SIDI/SIQual in order to be compliant with the ESS conceptual and technical standards for reference metadata files and quality reports. • Frameworks: • Istat multi-year innovation strategy Stat2015 • Eurostat Grant co-funding “Implementing the SDMX Istatstrategy” • Organisation: • Start:second half of December 2012 • Duration: for 2 years • Main phases: • The design phase. Main output expected: the document of requirements for the SIDI/SIQual enhancement (6 months devoted); • The software development,including requirement analysis, detailed design, realisation and test (1 year devoted) • The implementationprocess, the first metadata files and quality reports will be produced via the new subsystem

10. Project objectives and outline Main advantages:

11. Project objectives and outline • 1.The design phase: four steps to collect requirements • The first step: mapping between ESMS and ESQRS and SIDI/SIQualcontents • Based on standard ESS Guidelines • Exercise of compilation from SIDI/SIQual Example for ESMS concept «Statistical Unit» ESMS SIDI

12. Project objectives and outline 1.The design phase The second step: analysis of National Reference Metadata Editor (NRME) functionalities, available Metadata Structure Definitions, already filled in metadata files and quality reports • Main inputs obtained: • «Input» compliance with SDMX artifacts and concepts is needed • Functionalities to be implemented to support compilation (e.g: copy of a previous edition, re-use of single items, …) • …

13. Project objectives and outline 1.The design phase The second step: analysis of NRME functionalities, available Metadata Structure Definitions, already filled in metadata files and quality reports Difficulties: two levels “Domain” customisation At Metadata Structure Definition level: introduction of Domain specific concepts Example This case can be managed through a more generalised software implementation, that will also facilitate the software reuse and higher its flexibility for changing requirements

14. Project objectives and outline 1.The design phase The second step: analysis of NRME functionalities, available Metadata Structure Definitions, already filled in metadata files and quality reports Difficulties: two levels “Domain” customisation Within sub-concept level: introduction of different html tables in different domains Example The solution to thisissueisstill under evaluation, suggestions?

15. Project objectives and outline • 1.The design phase • The third step: involvement of stakeholders • At national level • Contacts with Eurostat • The fourth step: drafting the requirements’ document

16. Project objectives and outline • 2. The software development: • Design by Istat IT experts • Realisation outsourced • 3. The implementation process: • Under definition a proposal for the governance to be then approved by the top management • The production of metadata files and quality reports with the new subsystem should be centrally supported

17. Quality reporting subsystem building blocks Euro-SDMX registry SDMX artifacts import functionalities (6) SDMX Metadata set (5) Eurostat (NRME or EDAMIS) WS (8) GUI template management (7) Enhancement to be compliant to SDMX artifacts (3) SEP GUI for metadata files compilation (4) Enhancement for ESMS/ESQRS contents not included (1) Pulling out procedures (2) Quality reports (8) GUI Enhancement (1) SIDI Reference Metadata & Quality indicators DB SIDI Metadata & quality indicators GUI ETL Web Browser SIQual (8)

18. Thank you for your attention! Comments and suggestions are welcome simeoni@istat.it