180 likes | 294 Views
Seminar on New Frontiers for Statistical Data Collection WP 30 Moving to common survey tools and processes – the ABS experience. Jenine Borowik, Adrian Bugg, Brent Ross. Outline. ABS experience – progressive convergence of data collection tools and methods ABS 2017 directions
E N D
Seminar on New Frontiers for Statistical Data CollectionWP 30 Moving to common survey tools and processes – the ABS experience Jenine Borowik, Adrian Bugg, Brent Ross
Outline • ABS experience – progressive convergence of data collection tools and methods • ABS 2017 directions • Risks and issues • Conclusion
Major ABS Change • 1960’s • - Integration of Economic Statistics • Integration of Household Statistics 1980 2010 1950 1960 1965 1970 • 1995 • Analysis Unit Established • ABS Website • 1stConfidentialised unit record file 1992 National Project Centres 1990’s Increased use of Adm Data 2011 Future Organisation Structure 1968-69 Economic Census Information Management Transformation 1990 2000 2002 Business Statistics Innovation Program 1964 1st Mainframe ABS 2017 1992 Lotus Notes/WDBs 1950’s Introduction of Sample Surveys 1970’s Formal User Consultation Introduced
Individual collection methods and systems for Progressive convergence of tools and methods CAPI / CATI Paper and scanning Establishment of ESDC (100-400 office based interviewers) Single field interviewer workforce (300-900 field based interviewers) Administrative Data Acquisition Unit Integrated Collection and Dissemination Division • Household surveys • Business surveys • Population Census • Others • “cottage industries”
ABS experience • Existing purpose built capability • Specialised • Inflexible and vulnerable • High cost to maintain and change • Slow to change • Cycle of leap and legacy
The Challenges Riding the big data wave New competitors & changing expectations Increasing cost & difficulty of acquiring data Competition for skilled resources - low unemployment Reducing budget Rapid changes in the environment
Where are we headed? • Over the next 5 years we will transform the way the ABS manages information from collection to dissemination • Providing a better evidence base for use by Governments and the community
ABS 2017 Program Goals • Reduce the cost and time of doing business • Grow the business through new statistical products and services • Deliver the first large scale digital Census (2016) on time, to budget and quality • while delivering Business As Usual.
How will we get there? • Through large scale Innovation across the whole ABS • We will: • radically transform the way we acquire, collate, use, reuse and disseminate statistical information • By: • industrialising, modernising and reengineering our business processes • reengineering our statistical infrastructure and the way we manage information • developing capability needed to meet future needs • collaborating with other international NSIs • focussing on a limited number of centralised projects, including the digital Census for 2016
1. Business Process Reengineering • Change the way we acquire and process data – emphasis on e-collect for Census 2016, business and household surveys, including web and hand held devices • Increase our access to and use of large administrative datasets • Integrate and join data from a range of sources
2. Reengineering Statistical Infrastructure • New Core Information Management Infrastructure tools • metadata driven systems based on agreed standards • One ABS data warehouse to store, manage data from all sources • On-line data that can be queried • Management of statistical workflows • International collaboration to build next generation statistical tools
Acquire@ABS High Level Overview PROVIDERS Governments Households Individuals Businesses CHANNELS/MODES en masse (system to system) On paper On the phone On line On the go On site ABS Receive data Digitise data Support Providers Despatch Instruments / Requests for Info Run Collection Transform & Load data Design, Build & Test Collection Instruments, Processes & Systems Manage Provider Information Manage Workforce & Workload
Collection Futures for Census, Household & Business Surveys Household Surveys Business Surveys Population Census
ABS 2017 Infrastructure ABS 2017 Strategy Line of business - silo / legacy Enterprise Solution Line of business - utilising core infrastructure Enterprise Ready Candidate for future upgrade Minimise -where enterprise is undesirable (business case doesn't exist) Freeze, Minimise investment
Risks and issues • New stovepipes with standard tools • Future organisational structure – “Operations Division” • Don’t want to build if we don’t need to • Standards versus flexibility • Cultural change and resistance • Achieving the savings • One size may not fit all • Trade offs will need to occur in some business areas • We can’t resolve all problems
Thank you Further information: • Jenine Borowik jenine.borowik@abs.gov.au • Adrian Bugg adrian.bugg@abs.gov.au