1 / 18

Evolution of Statistical Data Collection: ABS's Progressive Convergence Journey

Explore ABS's transformation in data collection methods, embracing innovation to meet changing demands while managing challenges. Discover how ABS is reshaping its infrastructure and processes to enhance statistical information delivery for the future.

jmcalister
Download Presentation

Evolution of Statistical Data Collection: ABS's Progressive Convergence Journey

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Seminar on New Frontiers for Statistical Data CollectionWP 30 Moving to common survey tools and processes – the ABS experience Jenine Borowik, Adrian Bugg, Brent Ross

  2. Outline • ABS experience – progressive convergence of data collection tools and methods • ABS 2017 directions • Risks and issues • Conclusion

  3. Major ABS Change • 1960’s • - Integration of Economic Statistics • Integration of Household Statistics 1980 2010 1950 1960 1965 1970 • 1995 • Analysis Unit Established • ABS Website • 1stConfidentialised unit record file 1992 National Project Centres 1990’s Increased use of Adm Data 2011 Future Organisation Structure 1968-69 Economic Census Information Management Transformation 1990 2000 2002 Business Statistics Innovation Program 1964 1st Mainframe ABS 2017 1992 Lotus Notes/WDBs 1950’s Introduction of Sample Surveys 1970’s Formal User Consultation Introduced

  4. Individual collection methods and systems for Progressive convergence of tools and methods CAPI / CATI Paper and scanning Establishment of ESDC (100-400 office based interviewers) Single field interviewer workforce (300-900 field based interviewers) Administrative Data Acquisition Unit Integrated Collection and Dissemination Division • Household surveys • Business surveys • Population Census • Others • “cottage industries”

  5. ABS experience • Existing purpose built capability • Specialised • Inflexible and vulnerable • High cost to maintain and change • Slow to change • Cycle of leap and legacy

  6. The Challenges Riding the big data wave New competitors & changing expectations Increasing cost & difficulty of acquiring data Competition for skilled resources - low unemployment Reducing budget Rapid changes in the environment

  7. Where are we headed? • Over the next 5 years we will transform the way the ABS manages information from collection to dissemination • Providing a better evidence base for use by Governments and the community

  8. ABS 2017 Program Goals • Reduce the cost and time of doing business • Grow the business through new statistical products and services • Deliver the first large scale digital Census (2016) on time, to budget and quality • while delivering Business As Usual.

  9. How will we get there? • Through large scale Innovation across the whole ABS • We will: • radically transform the way we acquire, collate, use, reuse and disseminate statistical information • By: • industrialising, modernising and reengineering our business processes • reengineering our statistical infrastructure and the way we manage information • developing capability needed to meet future needs • collaborating with other international NSIs • focussing on a limited number of centralised projects, including the digital Census for 2016

  10. 1. Business Process Reengineering • Change the way we acquire and process data – emphasis on e-collect for Census 2016, business and household surveys, including web and hand held devices • Increase our access to and use of large administrative datasets • Integrate and join data from a range of sources

  11. 2. Reengineering Statistical Infrastructure • New Core Information Management Infrastructure tools • metadata driven systems based on agreed standards • One ABS data warehouse to store, manage data from all sources • On-line data that can be queried • Management of statistical workflows • International collaboration to build next generation statistical tools

  12. Expected Changes in our statistical cycle

  13. Acquire@ABS High Level Overview PROVIDERS Governments Households Individuals Businesses CHANNELS/MODES en masse (system to system) On paper On the phone On line On the go On site ABS Receive data Digitise data Support Providers Despatch Instruments / Requests for Info Run Collection Transform & Load data Design, Build & Test Collection Instruments, Processes & Systems Manage Provider Information Manage Workforce & Workload

  14. Collection Futures for Census, Household & Business Surveys Household Surveys Business Surveys Population Census

  15. ABS 2017 Infrastructure ABS 2017 Strategy Line of business - silo / legacy Enterprise Solution Line of business - utilising core infrastructure Enterprise Ready Candidate for future upgrade Minimise -where enterprise is undesirable (business case doesn't exist) Freeze, Minimise investment

  16. Risks and issues • New stovepipes with standard tools • Future organisational structure – “Operations Division” • Don’t want to build if we don’t need to • Standards versus flexibility • Cultural change and resistance • Achieving the savings • One size may not fit all • Trade offs will need to occur in some business areas • We can’t resolve all problems

  17. Thank you Further information: • Jenine Borowik jenine.borowik@abs.gov.au • Adrian Bugg adrian.bugg@abs.gov.au

More Related