1 / 13

On Tap: Developments in Statistical Data Editing at Statistics New Zealand

On Tap: Developments in Statistical Data Editing at Statistics New Zealand. Paper by Allyson Seyb , Felibel Zabala and Les Cochran Presented by Felibel Zabala. Sept 2012. Aim of paper.

bevis
Download Presentation

On Tap: Developments in Statistical Data Editing at Statistics New Zealand

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. On Tap: Developments in Statistical Data Editing at Statistics New Zealand Paper by Allyson Seyb, FelibelZabala and Les Cochran Presented by FelibelZabala Sept 2012

  2. Aim of paper • To describe the latest developments in Statistics New Zealand’s economic and household processing platforms

  3. Strategic Developments Statistics 2020 TeKāpehuWhetū - Recent actions • Reduction in number of tools • Use of Colectica to centralise storage of all information of Statistics NZ’s outputs • Establishment of processes to research and introduce new standard methods and tools

  4. Strategic Developments (cont’d) International collaboration • Regular bilateral and trilateral meetings with various national statistical offices • Involvement in the Statistical Networks on Confidentiality and the Industrialisation of Editing • Continued investigation on the use of SELEKT • Evaluation of SAS2Argus

  5. Platforms • Need for new infrastructure to produce statistics that are fit for purpose in a cost and effective way • A platform is a logical cluster of functionality that enables components to be put together to provide a complete end-to-end system

  6. Five main platforms Need Develop & Design Build Collect Process Analyse Disseminate Micro-economic System 1 System 1 System 1 Dissemination System 1 Collection System 2 System 2 System 2 • Use standard tools • Use for • Surveys and censuses • Administrative sourced data • Mixed sources • Use SAS for processing and analysis System 2 Household System 3 System 3 System 3 System 4 System 3 National Accounts System 5 System 4 System 4 System 6 System 4 System 5 System 5 System 7 System 5 System 6 System 6 System 8 System 9 System 7 System 7 System 6 System 10 System 8 System 8 System 11 System 7 System 9 System 9 System 12 System 13 System 10 System 10 System 14 etc etc etc etc System 25 System 60 System 50 System 80

  7. Household platform • Is a second generation platform with the design informed by an evaluation of the interim platform • Processes and in the future analyse three social surveys and their supplements • Uses standard tools to load, code, micro-edit and finalise a unit record dataset • Processes a Blaise-based survey

  8. The Household Platform Uses a mix of shared and specific systems Screens Info Tasks Rules Survey Specific View Diary Edit Diary Data Load Diary Save Diary Derivations Edits Metadata Config. Paradata Surv. Inst. Shared across Social Search View Metadata Data Load Save Core DVs Core Edits Config. Paradata Code Edit Treat Estimation Core Questions Extract Setup Shared across Stats Process Configure File SAS Configure Execute Portal Workflow Statistical Toolbox Setup CANCEIS Classifications & Stds Select GREGWt Metadata Admin X12 Other Data

  9. The Household platform Format of micro-level data

  10. Micro-economic Platform • Previously referred to as BESt platform • Processes and analyses economic surveys and administrative data collections • Also has elements of ‘Develop and Design’, ‘Build’, ‘Collect’ (from general Business Process Model) • Has a user configurable workflow • Allows incremental statistical maintenance and uses standard tools for common processes

  11. The Micro-economic platform Uses a mix of shared and specific systems Screens Info Tasks Rules Survey Specific Configuration Data Manual edit Reporting Metadata Configuration Process trace Shared across Micro Economics Load data Load metadata Metadata Metadata Data View Derivations Edits Configure process Manual edit (generic) Code Imputation Generic E&I Build cubes Configuration Process trace Treat Estimation Run process Extract Write-back Sample select Trace Reporting Allocate System Admin View Respondent Shared across Stats Business Intelligence SAS Workflow Statistical Toolbox Banff Classifications & Stds Metadata X12 Other Data

  12. Challenges and lessons learnt • Balancing generic and specific needs • Determining process elements suitable to be implemented as common services • Moving from a process culture to a more constructive innovative culture Key enabler of the culture change - the adoption of an agile project management approach for IT development projects

  13. Moving forward • Review of Statistics NZ’s generic Business Process Model • Implementation of a framework to measure and report on the benefits achieved with recent and on-going developments • Transformation of the organisation’s data collection processes

More Related