1 / 16

ESCWA SDMX Workshop

This workshop session explores the use of DDI (Data Documentation Initiative) in the statistical lifecycle and its relationship with SDMX (Statistical Data and Metadata Exchange). Topics include metadata reuse, multilingual support, extensibility, and the various modules and components of DDI 3.0. Technical specifications and XML schemas for data collection are also discussed.

corcoranj
Download Presentation

ESCWA SDMX Workshop

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. ESCWA SDMX Workshop Session: Role in the Statistical Lifecycle and Relationship with DDI (Data Documentation Initiative)

  2. General Statistical Business Process Model and SDMX

  3. General Statistical Process Business Model and SDMX DDI DDI SDMX

  4. General Statistical Process Model and SDMX SDMX DDI DDI SDMX

  5. DDI 3.0 and the Survey Life Cycle • A survey is not a static process: It dynamically evolved across time and involves many agencies/individuals • DDI 2.x is about archiving, DDI 3.0 across the entire “life cycle” • 3.0 focus on metadata reuse (minimizes redundancies/discrepancies, support comparison) • Also supports multilingual, grouping, geography, and others • 3.0 is extensible

  6. DDI 3.0 Modules • Conceptual Components (concepts, universes) • Data Collection (survey instruments and collection processing) • Logical Products (variables, categories, code lists) • Physical data product (descriptions of file structures) • Physical Instance (instances of data files) • Archiving (information about holding, storage, and organizations) • Comparative (mapping schemes) • Grouping (for comparison, and longitudinal studies, panels, and series) • Instance (the wrapper) • DDI Profile (describes which DDI 3 elements are used) • Study Unit (describes a single study)

  7. Category Scheme Code Scheme Concept Scheme Control Construct Scheme GeographicStructureScheme GeographicLocationScheme InterviewerInstructionScheme Question Scheme NCubeScheme Organization Scheme Physical Structure Scheme Record Layout Scheme Universe Scheme Variable Scheme Packages of reusable metadata maintained by a single agency Technical Specifications - Maintainable Schemes (that’s with an ‘e’ not an ‘a’)

  8. DDI “Mind Map”

  9. DDI – “Mind Map”

  10. archive comparative conceptualcomponent datacollection dataset dcelements DDIprofile ddi-xhtml11 ddi-xhtml11-model-1 ddi-xhtml11-modules-1 group inline_ncube_recordlayout instance logicalproduct ncube_recordlayout physicaldataproduct physicalinstance proprietary_record_layout (beta) reusable simpledc20021212 studyunit tabular_ncube_recordlayout xml set of xml schemas to support xhtml Technical Specifications – XML Schemas

  11. Use within data collection Research Staff Principal Investigator Collaborators <DDI 3.0> Variables Physical Stores <DDI 3.0> Funding Revisions <DDI 3.0> Questions Instrument + + <DDI 3.0> Concepts Universe Methods Purpose People/Orgs + + $ € £ <DDI 3.0> Data Collection Data Processing Data Archive/ Repository Submitted Proposal Presentations + Publication

  12. DDI and Generic Process Example DDI Survey/Register Anonymization, cleaning, recoding, etc. Tabulation, processing, case selection, etc. Indicators Raw Data Set Micro-Data Set/ Public Use Files Aggregation, harmonization Aggregation, harmonization SDMX Aggregate Data Set (Higher Level) Aggregate Data Set (Lower level)

  13. General Statistical Process Model and SDMX SDMX Concept Scheme Code List, HCL,SDMX RegistrySDMX DSD and data set SDMX MSD and metadata set

  14. SDMX SDMX Process Model

  15. Process - Schematic Process Process Step Transition Computation target inputs outputs Process Artefact

  16. Process - UML

More Related