180 likes | 310 Views
Metadata Standards and Their Support of Data Management Needs. Daniel W. Gillman Bureau of Labor Statistics Paul Johanis Statistics Canada. Overview. Terminology Theory ISO/IEC 11179 Statistical Data Corporate Metadata Repository Model Metadata Schemes XBRL; Neuch â tel; DDI; SDMX; CWM
E N D
Metadata Standards and Their Support of Data Management Needs Daniel W. Gillman Bureau of Labor Statistics Paul Johanis Statistics Canada METIS Work Session
Overview • Terminology Theory • ISO/IEC 11179 • Statistical Data • Corporate Metadata Repository Model • Metadata Schemes • XBRL; Neuchâtel; DDI; SDMX; CWM • Integration • Conclusion METIS Work Session
Terminology Theory • Property = something observed • Object = perceivable or conceivable • Characteristic = abstraction of properties of objects • Concept = unique combination of characteristics • Designation = association of sign with concept METIS Work Session
Terminology Theory • Concepts • Intension = sum of characteristic • Extension = set of corresponding objects • General = 2 or more objects in extension • Designation = term (Example: man) • Individual = 1 object in extension • Designation = appelation (Example: Dan) METIS Work Session
ISO/IEC 11179 • 2nd Edition Published (in 2005); 3rd Edition underway • Freely available on web • http://isotc.iso.org/livelink/livelink/fetch/2000/2489/Ittf_Home/PubliclyAvailableStandards.htm • See also • ISO/IEC TR 20943 (Achieving Content Consistency) • ISO/IEC 11404 (Language Independent Datatypes) • Future – ISO/IEC 20944 • Interoperability and Bindings METIS Work Session
ISO/IEC 11179 • Object Class • “What is being counted here?” • Example – METIS 2006 attendees • Property • Characteristic of the object class • Example – country of birth • Data Element Concept := OC + P METIS Work Session
ISO/IEC 11179 • Value Domain • What are the allowed values? • Example – ISO 3166-1 Country codes (2-alpha) • Data Element := DEC + VD METIS Work Session
Statistical Data • Data • Population (concept) = Object Class • Characteristic (concept) = Property <11179> • Values (designation) = Value Domain • Micro-data • General concept • Macro-data • Individual concept METIS Work Session
CMR • CMR – Corporate Metadata Repository Model • Extension of ISO/IEC 11179 • For statistical surveys • Sample • Questionnaire • Data sets • Products • Systems METIS Work Session
Metadata Schemes • XBRL (extensible business reporting language) • DDI (data documentation initiative) • SDMX (statistical data and metadata exchange) • Neuchâtel Group (classification + variable models) • CWM (common warehouse metamodel) METIS Work Session
Metadata Schemes • XBRL – XML for Financial Data and Metadata • Recording + Transferring • Instance documents based on “taxonomies” • Schema – element structure • Labels – reuse across languages and purposes • References – to legal or accounting standards • Presentation – rules for specifying hierarchy of elements • Calculations – rules for calculations between elements • Definitions – rules for other relationships between elements METIS Work Session
Metadata Schemes • DDI (data documentation initiative) • Data archives, for codebooks • 5 chapters • Document; Study; File; Data; Other • Main concept – data set • Describes • Microdata • Tables METIS Work Session
Metadata Schemes • SDMX (statistical data and metadata exchange) • BIS, ECB, IMF, World Bank, UN, Eurostat, OECD • Main concept – data or metadata structure definition • Scheme for defining data and metadata transfer structures • Describes • Macrodata • Time series METIS Work Session
Metadata Schemes • Neuchâtel Group (classification + variable models) • Sweden, Norway, Netherlands, Switzerland, US • German IT company • Did include Denmark, Finland • Main concepts – classification, variable • Describes • Classifications, microdata METIS Work Session
Metadata Schemes • CWM – Common Warehouse Metamodel • OMG – Object Management Group • Information supply chain = Survey life-cycle • Tool integration • Common metadata model framework • Map between tools • Share metadata • Common view of metadata METIS Work Session
Integration Data Dissemination Data Dissemination Data Transfer between Organizations and Organizational Units Data Collection Data Collection DDI ISO11179/ CMR XBRL SDMX Database Interoperability CWM Thesauri/search resources METIS Work Session
Integration METIS Work Session
Conclusion • Metadata Constructs • Throughout survey life-cycle • Many linkages • Questions METIS Work Session