210 likes | 229 Views
The Role of Metadata. UNECE Training Workshop on Dissemination of MDG Indicators and Statistical Information Astana, Kazakhstan 23 – 25 November 2009 Steven Vale, UNECE. Contents. What are metadata? Types of users What do the users need? Metadata standards. 24.9.2009. What Are Metadata?.
E N D
The Role of Metadata UNECE Training Workshop on Dissemination ofMDG Indicators and Statistical Information Astana, Kazakhstan 23 – 25 November 2009 Steven Vale, UNECE
Contents What are metadata? Types of users What do the users need? Metadata standards 24.9.2009
What Are Metadata? • Official definition: “Data that define anddescribe other data” • Metadata are an essential tool to communicate about data(and data quality!)
What are Metadata? Metadata Data
Types of Metadata • Structural metadata • Table / chart titles • Row / column headings • Row / column values • Source information • Reference metadata • Footnotes • Definitions • Methodological texts
Types of users • “Tourists” – want basic data and easy to understand metadata • Most users are likely to be tourists • They are not experts in statistics or databases systems
Types of users • “Harvesters” – want data for basic research or economic decisions, with summary metadata to help them understand data quality • They have some statistical knowledge
Types of users • “Miners” – want detailed data for further analysis • They need detailed metadata so that they can fully understand the data • They are prepared to do some work themselves to get the data
Layers of Metadata Structural Metadata for “Tourists” Simple Reference Metadata for “Harvesters” Drill down Detailed Reference Metadata for “Miners”
Most statistical organizationsare good at providing ... • Structural metadata • Simple reference metadata But not so good at ... • Detailed reference metadata
How to Improve Reference Metadata • Write the metadata for users not producers • Follow international standards for terminology and definitions • Develop a simple, easy to use tool for storing and publishing reference metadata • Provide clear links from (and to) data
Metadata Standards • Statistical Data and Metadata eXchange (SDMX) • Guidelines for Statistical Metadata on the Internet • Common Metadata Framework • European Commission Recommendation on reference metadata for the European Statistical System
SDMX • Statistical Data and Metadata eXchange • A set of technical and content-related standards for data (and metadata) transfer between statistical organizations • Recognized as a preferred standard by the United Nations Statistical Commission • Technical standards have ISO accreditation • ISO 17369
SDMX Content-oriented Guidelines • Adopted January 2009 • Harmonization of concepts and terminology • Main components: • Cross-domain concepts • Cross-domain code lists • Statistical subject-matter domains • Metadata common vocabulary • www.sdmx.org
Guidelines for Statistical Metadata on the Internet • Approved by the Conference of European Statisticians • Specific advice for web dissemination • www.unece.org/stats/publications/metadata.pdf
Common Metadata Framework • Being developed with input from national and international statistical organizations, coordinated by the METIS Steering Group. • 4 parts: each concentrates on different aspects of statistical metadata systems • Latest versions are on the METIS wiki: www1.unece.org/stat/platform/display/metis
Part A • Explains importance of metadata and metadata systems • Published on the web • Printed version 2009/2010
Other Parts in Development • Part B: Metadata Concepts, Standards, Models and Registries • Part C: Metadata & the Statistical Business Process • Part D: Implementation • Case studies from national and international organizations
European Commission Recommendation on Reference Metadata • Promotes standard concepts for reference metadata • Consistent with SDMX • Legal document but not compulsory • Reference: 2009/498/EC
Summary • Metadata help users fully understand data • Different users need different levels of detail of metadata • Reference metadata provide descriptions of the data and any quality issues • International standards are important to ensure harmonized concepts, definitions and presentation of metadata