270 likes | 448 Views
Census Corporate Statistical Metadata Registry. By Martin V. Appel Daniel W. Gillman Samuel N. Highsmith, Jr. U.S. Bureau of the Census. Overview . Objectives Definitions Standards Models Implementation. Census Bureau Metadata Objectives.
E N D
Census Corporate Statistical Metadata Registry By Martin V. Appel Daniel W. Gillman Samuel N. Highsmith, Jr. U.S. Bureau of the Census Open Forum on Metadata Registries
Overview • Objectives • Definitions • Standards • Models • Implementation Open Forum on Metadata Registries
Census Bureau Metadata Objectives • Gain Acceptance of One Logical Metadata Registry Model • Support wide Range of Projects, Surveys, Applications, and Users • Comply with Federal Standards Open Forum on Metadata Registries
Statistical Metadata: Definition Definitions • Descriptive information or documentation that facilitates sharing and understanding statistical data over the lifetime of the data. • Includes • file location, record layout, database schemas, data dictionary, definitions, questions, questionnaires, sample design, processing steps, data quality, etc. Open Forum on Metadata Registries
Purposes of a Statistical Metadata Repository • End-user oriented • Electronic Data Dissemination • Production oriented • Automated Survey Design and Processing Open Forum on Metadata Registries
What is the Corporate Metadata Repository (CMR)? • Electronic card catalog • Provides access to metadata describing many classes of objects • throughout a survey • across many surveys • Types of classes are • variables or data elements questionnaires • datasets other products (reports) • documents surveys • Metadata quality monitored through registration process Open Forum on Metadata Registries
Problems The CMR Solves? • Supports Cataloging and Reuse of Metadata • Design and Processing • Data Dissemination • Facilitates • Sharing of Data / Metadata • Data Administration • Survey Design and Processing • Survey Reengineering • Complies with Required Federal Standards • GILS • FGDC • and otherstandards, e.g. DDI Open Forum on Metadata Registries
StandardsSupporting the CMR CMR MMSD X3.285 SDSM Census Bur Open Forum on Metadata Registries
Models • Repository Models • Business Data Model • Data Element Registry Model • Metamodel • Model for Searching and Classifying • Business Process Model • Table of Contents Open Forum on Metadata Registries
Integrated Statistical Model Metadata Repository Metamodel Data Element Registry Model Business Data Model Open Forum on Metadata Registries
Repository Model Overview Registration Business Data Documen- tation Data Element Metamodel Open Forum on Metadata Registries
Business Data Model Survey Instance Survey Questionnaire Survey Dataset Sample Questions Universe/Frame Products Open Forum on Metadata Registries
Prototype Corporate Metadata Repository DADS FERRET CMR w/ Standard Interface DocsOpen Business Data Model + DER Model + Meta Model (access, search, security) Variables / Documentation/ Data sets/ Tools Registration Tool TOC Browser Tool Metadata CRUD Tool
Near Term Implementation • Find a Home • Design & Build Physical Architecture • Production Pilot • Automated Survey Design and Processing • DocsOpen • Econ Questionnaire Design • Electronic Data Dissemination Integration • DADS • FERRET • Product Registry Open Forum on Metadata Registries
Long Term Implementation:Integrated Information Solutions Program (IIS) • Data Integration, Access and Delivery • provides access to integrated data sets • provides ongoing customer support • Product Creation System • Policies and Standards • New Business Practices • Metadata and Data Support Open Forum on Metadata Registries
Current Situation Observations • Each Program Area Operates Independently, Thereby: • Creating difficulty when two program areas must coordinate • Discouraging the notion of corporate data or metadata assets • Minimizing economies of scale or reuse • Discouraging the production of and access to integrated data Open Forum on Metadata Registries
Integrated Information SolutionsProcess Model Overview The IIS program will manage: Products Customers Resources • Conceive Products • Plan and Design Products • Develop Products • Deliver Products • Maintain Products • Prospect for Customers • Target Customers • Optimize Customers • Plan and Acquire Resources • Implement Resources • Maintain Resources Open Forum on Metadata Registries
IIS Product Process Product concept Usage statistics Previous experience with similar products Corporate data and metadata repository Improve or discontinue decisions Source data & metadata Approved product Product concept Approved model Approved product Usage statistics Product access Customer Conceive products Plan and design products Develop products Deliver Products Final model Approved product Customer Needs Questions Product Concept Final marketing plan Support High-level product concepts Preliminary Marketing plan Orders Feedback Approved business case Product Concept Feedback summaries Maintain Products Resource Allocation Tracking System Decision to improve product Customer Database Feedback summaries Open Forum on Metadata Registries
Phased Implementation Strategy • Phase 1 : (January 99 - September 00) • Specifications for technology solutions developed • Establish corporate metadada repository • Pilot projects • Phase 2: (FY2001 and FY2002) • Implementing technology solutions • Non-Decennial portion of DADS incorporated • Phase 3: (FY2003) • Bulk of IIS processing vision put in place • DADS fully incorporated into IIS Open Forum on Metadata Registries
Questions Open Forum on Metadata Registries
X3.285 Fundamental Model DATA ELEMENT CONCEPT DATA ELEMENT (1:N) (1:N) Object Class Object Class (1:N) (1:1) (1:1) Property Property (1:1) Representation Open Forum on Metadata Registries
Data Element Model Data Element Concept Data Element Value Domain Open Forum on Metadata Registries
Registration Model AdministeredComponent Common Attributes subtype ClassifiedComponent Classification Scheme subtype Metadata Objects ... Open Forum on Metadata Registries
Documentation Model Administered Component Documentation Type Documentation Open Forum on Metadata Registries
Access Constraint Archive Citation Contact Data Dataset Supplier Data Quality Dataset Descriptive Statistics Distribution Information Documentation Emprise Field Format Frame Methodology Planning and Design Pointer to Object Product Program Questionnaire Question Sample Series Sponsor Status Survey Survey Instance System Technique Theme Universe FGDC SDSM Chapters Open Forum on Metadata Registries