1 / 25

Metadata management at Statistics Canada

Metadata management at Statistics Canada. Alice Born Standards Division, Statistics Canada alice.born@statcan.ca FEDCASIC Workshop March 6-8, 2007. Outline. Description of STC’s Integrated Metadatabase (IMDB) Common metadata set Tools for entering metadata

roana
Download Presentation

Metadata management at Statistics Canada

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Metadata management at Statistics Canada Alice BornStandards Division, Statistics Canada alice.born@statcan.ca FEDCASIC Workshop March 6-8, 2007

  2. Outline • Description of STC’s Integrated Metadatabase (IMDB) • Common metadata set • Tools for entering metadata • Registration – data elements, questions, etc. • Integration • STCwiki

  3. What’s needed for metadata management • Disciplined approach to data and metadata management - standards • An agreed enterprise-wide metadata architecture • Standard, generic E2E processes: collection, processing and dissemination of statistical data and metadata

  4. Statistical metadata at Statistics Canada • Integrated Metadatabase (IMDB) • Information about each of Statistics Canada’s 560+ current surveys • Aimed at helping users interpret statistical data • Survey description • Survey instrument – questionnaires, questions • Methodology • Data accuracy • Variables, classifications • Also repository for all variables, classifications and questionnaires

  5. What is the IMDB based on? • ISO/IEC 11179 Metadata Registries • Corporate Metadata Repository (CMR) – USBC (D. Gillman) • Business dimension – supports survey life cycle • Data dimension – data elements and value domains • Questionnaire model • Administration – registration • Initially built to support data dissemination but can be linked to other parts of the survey life cycle

  6. Surveys and statistical activities- definition • Metadata in the IMDB is organized around the survey entity • Three types of surveys: • Direct – paper surveys, CAPI, CATI • Administrative • Derived – GDP, CPI • Statistical activity is a group of surveys that share common feature, common explanatory text • e.g., System of National Accounts, Health

  7. Regions Statistical Activity Organization Survey Stewardship Contact Universe Documentation Frame Identification Survey instance Identification Time Frame Instrument Keyword Question Classification Theme Data file Methodology Data Element (ISO 11179) Instrument designSamplingData sourceError detectionImputationEstimationQuality evaluationDisclosure controlRevisions and seasonal adjustmentData accuracy Data Element Concept Object Class Property Formula Conceptual Domain Value Domain

  8. Common metadata set

  9. Common metadata set – list of surveys

  10. Common metadata set – survey instance

  11. Common metadata set – list of variables

  12. Common metadata set – data element

  13. Data elements and value domains Following ISO 11179 approach to defining variables and reusing items: • 85 object classes (statistical units) • 290 characteristic items (properties) • 506 data element concepts • 1,059 value domains (non-enumerated and enumerated - classifications) • 1035 data elements (variables)

  14. Loading metadata into IMDB

  15. CMR – Business dimension model StatisticalActivity Applications/Software Target population Survey Frame and Sample Methodology Survey Instance Products(COR) Questionnaires Questions Responses Data File Data elements Survey Specification Manager

  16. Registration of metadata • Set of rules that apply to metadata registry • Monitor source of metadata and quality of the metadata • Registration status – identifies the quality or progression of quality • Administrative status – stage in the registration process • Registration level – level of conformance or harmonization

  17. Registration status Identifies the quality or progression of quality Preferred standard high Retired Standard Superseded Progression of quality Qualified Recorded Candidate Historical Application Incomplete low

  18. Management of Registration status Registration Authority Preferred standard Retired (Completeness, accuracy, adherence to quality and terminological description standards) Standard Superseded Standards Division Registrar Qualified Recorded Responsible Owner (Content) Candidate Historical Submitter Steward Incomplete Application

  19. Administrative status Stages in registration process De-registered Registered Reserved for edit New Not registered

  20. Registration level Level of conformance or harmonization Agency International Branch North America Field Canadian Division Program Survey

  21. Administered items requiring registration –Data elements - registration Data Element Data Element Concept Object Class Survey variable Property Conceptual Domain Value Domain

  22. Integration – next steps

  23. Metadata Schemes - STC • XBRL (extensible business reporting language) – financial data for business surveys • DDI (data documentation initiative) - DLI • SDMX (statistical data and metadata exchange) – OECD’s NAWWE, education statistics, external debt • CWM (common warehouse metamodel) – System of National Accounts - IMDB

  24. Linking questions to IMDB • Linking the Survey Specification Manager (question blocks for household surveys) to IMDB • Potential for: • Reuse of administrative layer in the IMDB • Linking to other metadata (questions to data elements and value domains, surveys) • Populating the questionnaire model in the IMDB from the SSM

  25. STC Wiki

More Related