160 likes | 250 Views
Central Warehousing Work Session of Friends of the Chair Group Bern, Switzerland 6 – 8 June 2007 Marie Brodeur/Michel Girard Statistics Canada. Overview. Categories of warehouses Data and analysis Business Intelligence software Comparing data from various sources
E N D
Central Warehousing Work Session of Friends of the Chair Group Bern, Switzerland 6 – 8 June 2007 Marie Brodeur/Michel Girard Statistics Canada
Overview • Categories of warehouses • Data and analysis • Business Intelligence software • Comparing data from various sources • Characteristics of data warehouses • Examples
IntegrationSuite of centralized tools • Collection – Processing – Analysis • PIPES – Improving provincial statistics • Improving consistency • Improving coherence • Story using data from various sources • Coherence among surveys, entities… • Breadth and depth of business survey data
IntegrationStatistical agencies • Ability to validly compare data and aggregate statistics across industries and/or institutional sectors and/or other aspects of economic interest • Rely on standardization • Standard units • Standard classifications • Common analytical framework
Warehouse • Link with source data at the cell level • Even at the micro level • Common classifications/concordances • Source data are treated according to same concepts and definitions • Promote integration not only reconciliation • Capacity to show adjustments
WarehousingEvolution of the concept • Unified Survey Tracking, Analysis and Retrieval Tool (U-START) • SNA Analytical Warehouse (SNA AW) • CANSIM (STC Dissemination) • Tabulations and metadata • Focus is on aggregate data • Issue with comparability
U-START • Philosophy • Contains survey and administrative data • Feeding CSNA from one central point • Coherence of analysis • Residential construction/wood production • Feeding CSNA analytical output
U-START • Point and click access to data and metadata • Collection, edit, imputation and estimation phase • A data/document querying tool • Including questionnaire image • Quick access to user defined static report • Frequency reports, grouped tabulations, contribution reports • Ability to summarize large databases • Drill down - macro to micro and navigation • Exporting tool: off-the-shelf software/databases • Links to analytical outputs/survey notes or information (Corporate knowledge)
SNA WarehouseBeing implemented… • Accessing source data and metadata • Common way to manipulate the data • Not a place to process • Excellent to compute consistently derived statistics • Analytical tool • Promoting common judgment • Dealing with new staff • Facilitate integration not only reconciliation
U-START and SNA Warehouse • Quick access to data • Learning tool • Consistency of derived statistics • Capacity to analyze data at various stages of production • Adjustments • Promote coherence • Must work on documentation aspects