290 likes | 412 Views
SIMPII – Workshop on Information Technology. Day 1 Introduction. Statistics Canada. November 28 th 2011. Introduction StatCan Organization Social Surveys Overview Business Surveys Overview Evolution of IT at StatCan Conclusion. Outline. SIMPII – 2006-2012
E N D
SIMPII – Workshop on Information Technology Day 1 Introduction Statistics Canada November 28th 2011 Statistics Canada • Statistique Canada
Introduction StatCan Organization Social Surveys Overview Business Surveys Overview Evolution of IT at StatCan Conclusion Outline Statistics Canada • Statistique Canada
SIMPII – 2006-2012 3 projects (Social, Economic, Environment) Concepts, methods, implementation Logical continuation – Systems development Introduction Statistics Canada • Statistique Canada
Presenters: Jean Labbé (IT Manager - for Social, Health and Labour Statistics ) Brigitte Lizotte (IT Solution Architect / Process Engineer - infrastructure for business surveys) Laurie Reedman (Chief Methodologist responsible for generalized systems) Danielle Lalande (SIMP II Program Coordinator) Introduction Statistics Canada • Statistique Canada
General objectives of the workshop: Provide the NBS with guidelines and tools for systems development in a national statistical office Share StatCan’s experience in systems development Questions are welcomed Introduction Statistics Canada • Statistique Canada
About 6,500 employees (including terms) 6 fields (3 Program fields and 3 Service fields) 18 Branches and ~70 Divisions StatCan Organisation Statistics Canada • Statistique Canada
Administrative data division Dissemination division StatCan Organization • Service areas provide support to corporation or to program areas • Typically a survey team will include members from : • Designated program area • Frame division • Collection division • Methodology division • IT division Statistics Canada • Statistique Canada
Mostly use data from Social and Business surveys Surveys for Balance of Payments Direct Investment surveys Environment Surveys Government Surveys Building permits (municipal) Overview of surveys: National Accounts Statistics Canada • Statistique Canada
Labour Force Survey Travel Survey of Residents of Canada Survey of Household Spending National Population Health Survey Canadian Community Health Survey Canadian Health Measures Survey General Social Survey (themes) Overview of Social Surveys Statistics Canada • Statistique Canada
Population Census (quinquennial) Aboriginal Peoples Survey Administrative data Vital Statistics - Marriage and Divorce Databases Vital Statistics – Death Database Canadian Cancer Registry Retirement Savings Data Detailed Income Data Overview of Social Surveys Statistics Canada • Statistique Canada
Longitudinal Surveys Canadian Household Panel Survey Survey of Labour Income Dynamics Youths in transition Education Surveys Justice Surveys And many more…. Overview of Social Surveys Statistics Canada • Statistique Canada
Entreprise-based surveys Quarterly Survey of Financial Statement Financial and Taxation Statistics for Enterprises (Annualized survey data + Administrative data) Company-based surveys Transportation surveys Overview of Business Surveys Statistics Canada • Statistique Canada
Establishment-based surveys Large number of annual surveys on specific industries Manufacturing Distributive Trades (Wholesale & Retail) Service Industries Annual survey on Capital Expenditure Sub-annual surveys Manufacturing Retail Sales Food services Overview of Business Surveys Statistics Canada • Statistique Canada
Prices surveys Longitudinal samples Administrative surveys Exporter and Importer Register Databases Census Census of Agriculture No Economic Census Several other surveys E.g. Non-profit organizations Overview of Business Surveys Statistics Canada • Statistique Canada
Large number of surveys at StatCan Up to 25 years ago: Stove-pipe approach IT Evolution at StatCan Statistics Canada • Statistique Canada
Stove-pipe model: Each program had separate systems High maintenance Large amount of duplicated work Initiative: Create generalized systems for specific tasks GSAM (sampling), GES (estimation), GEIS (imputation), DC2 (collection) Use readily-available systems BLAISE for collection IT Evolution at StatCan Statistics Canada • Statistique Canada
Inititative: Unified Enterprise Survey (UES) Goal: unify processes for a subset of business surveys. Started with 7 surveys in 1998 Up to 60 surveys used the infrastructure in 2010 Focus on annual, establishment-based surveys IT Evolution at StatCan Statistics Canada • Statistique Canada
UES was a linear process – longer turnaround System was saturated Very hard to add more surveys with slightly different requirements New Initiative : Integrated Business Statistics Program (IBSP) IT Evolution at StatCan Pre-collection Processing Collection Analysis Dissemination Statistics Canada • Statistique Canada
IT Evolution at StatCanGuiding Principles for IBSP processing • Model to be generic but flexible • One model developed for both annuals and sub-annuals • Processing model to allow annual business surveys to release data 12 months after the end of the RY • Maximize the use of administrative data (tax data) • Active collection (follow-ups) to be driven by quality indicators Statistics Canada • Statistique Canada
IT Evolution at StatCanGuiding Principles for IBSP processing(2) • Maximize the use of generalized systems, corporate services and existing approaches • The processing to be entirely metadata driven • Target and minimize the records to be validated / edited by Subject-Matter Areas • Electronic Data Reporting to be the primary mode of collection • Maximize the automation of manual processes Statistics Canada • Statistique Canada
IT Evolution at StatCanRolling Estimates Model • Combines collection, processing and analysis • Iterative model used partly in key infra-annual surveys • Produces estimates, quality indicators and measure of impact scores periodically… • …which dynamically drives follow-up and editing strategies • Improves quality – timeliness and accuracy Collection Pre-Collection Dissemination Processing Analysis Statistics Canada • Statistique Canada
Partner Divisions (Survey steps in which each group is involved in) Business Register (1) Methodology Services (2,7,8,9,10,11,12) Corporate Collection Services (1,3,4,6,7) Tax Data Division (1,6,7,8,9) System of National Accounts (11) Standards Division (4,13) Informatics Services (1 to 14) Dissemination Services (12,13,14) Ten different Subject Matter Areas (1 to 14) Enterprise Statistics Division (1 to 14) Information Management Committee (14) 1.Frame Maintenance 2.Sampling 3.Questionnaire Design 4.Data collection + capture+ coding 5.Integration of Survey Data 6.Integration of Tax &Auxiliary Data 7.Editing 8.Imputation 9.Estimation / Weighting 10.Seasonal adjustment 11.Analysis / Data Quality Evaluation 12.Disclosure Control 13.Dissemination 14.Archiving
Similar initiative for Social Surveys Common Tools IT Evolution at StatCan Statistics Canada • Statistique Canada
Generic Statistical Business Process Model IT Evolution at StatCan The Joint UNECE / Eurostat / OECD Work Session on Statistical Metadata (METIS) developed the Generic Statistical Business Process Model (GSBPM) in 2009. Statistics Canada • Statistique Canada
Large initiatives at StatCan for development of new integrated systems One model for business surveys One model for social surveys Still in development process Advantages: Coherence (concepts, software) Efficiencies (less development, less maintenance) Facilitates staff rotation Flexibility Conclusion Statistics Canada • Statistique Canada
Xie xie Danielle Lalande SIMP II Program Coordinator International Cooperation Division (613) 951-8920 danielle.lalande@statcan.gc.ca 2014-08-25 Statistics Canada • Statistique Canada Statistics Canada • Statistique Canada 29