1 / 37

Data Revolution and Innovation in Official Statistical Production: Key Challenges and Research Areas

This presentation provides an overview of Eurostat and the European Statistical System (ESS), highlighting the data revolution and innovation in official statistical production. It discusses key challenges and research areas, including the use of multiple data sources, data mashups, and the need for tailored services for customers. It also explores the role of the ESS in addressing methodological challenges and leveraging big data and administrative databases. The presentation concludes with the communication revolution and the availability of new digital tools for accessing and disseminating statistics.

cpaige
Download Presentation

Data Revolution and Innovation in Official Statistical Production: Key Challenges and Research Areas

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Data revolution and innovation in official statistical production: key challenges and research areas

  2. Content of the presentation • Overview of Eurostat and the ESS • produced statistics • Data revolution • innovation in official statistical production • key challenges and research areas • Communication revolution

  3. Eurostat Overview

  4. Eurostat Joseph Bech building, 5, rue Alphonse Weicker, 2721, Luxembourg

  5. We provide high quality statistics for Europe ...making a difference in the ocean of information

  6. The European Statistical System (ESS) A partnership of Eurostat and the National Statistical Institutes and other national authorities of the EU, the EEA and the EFTA countries

  7. How does this partnership work? • ESS: • Harmonisation of methodologies, concepts and classifications • National statistical offices: • Collection of data • Eurostat: • Consolidation of the data • Production of European aggregates

  8. What data is available at Eurostat?

  9. Eurostat website: ec.europa.eu/eurostat

  10. Some things we don't do... • Economic and political comments (Spokesperson’s Service) • Public Opinion - Eurobarometer (DG Comm) • Economic forecasts (DG Ecfin) • Business/consumer confidence (DG Ecfin) • EU budget figures (DG Budget, DG Regio) • Tax rates (DG Taxud)

  11. Stay up-to-date

  12. Data Revolution

  13. Data Availability Limitation of traditional surveys: • Increasing non-response rates • Concerns about response burden • Lack of flexibility and associated costs

  14. Innovations and changes of the statistical production cycle • Use of multiple data sources • Data mashups • A new data "factory" • Data analytics services for "prosumers"

  15. Use of multiple data sources • Extending traditional data sources to administrative and big data

  16. 6.Support & Coaching 4.Sampling frames COMPRENSIVE USE OF DATA & BURDEN REDUCTION 5. Pilot projects • ADMINISTRATIVE SOURCES: • Population • Health • Taxes • Social security • Census • Education • Unemployment • … … ADMIN

  17. Big data sources

  18. example Mobile network data forpopulation statistics (Belgium) Census (2011) Mobile phones (2015)

  19. Multidimensional Poverty Index (Lighter colour indicates higher poverty) Poverty map estimated based on mobile phone data Poverty map in finer granularity estimated based on mobile phone data Smith, Christopher, Afra Mashhadi, and Licia Capra. "Ubiquitous sensing for mapping poverty in developing countries." Paper submitted to the Orange D4D Challenge (2013).

  20. Data mashups Assembling and reassembling data from multiple sources Aim is to improve analytics

  21. A new data "factory"

  22. Data analytics services for "prosumers" Statistical organisations need to extend their products according to their users' needs: • Tailor-made services for customers • Data-driven surveys • Economic modelling • Forecasts and projections Change without modernising the production processes would not be effective

  23. Enabler: ESS Vision 2020 portfolio

  24. ESS domains DIGICOM BIGD SERV Europe 2020 Economic Governance & Globalization ESBRs ESDEN VALIDATION ADMIN ADMIN Economic and Social Performance Environmental Sustainability Business People's Europe Geospatial, Environmental, Agricultural & Other SIMSTAT/ REDESIGN Cross cutting

  25. Methodological challenges

  26. Challenge: Data integration • Integrating data coming from multiple sources collected in various ways • Will rely on DIGIT platformsand tools developed for exploiting new data sources • Fostering the development of methodological approaches to compile/describe sets of cross-domain indicators • representing and explaining interlinks

  27. Challenge: Big Data and Administrative databases • Cleaning the data • Constructing the population weights • Sample recalibration techniques vs missing structural variables • Representing and explaining interlinks

  28. Problems • BDATA: Self-selectivity bias of the sample • ADMIN datasets often suffer from lots of missing records and duplicates. • BDATA: suffers from high level Noise. • BDATA: often miss structural information, making linkage between datasets impossible. • BDATA: Spurious regressions

  29. Opportunities • New Metrics • New Methodologies and algorithms • Integration matching techniques • New data collection - webcams

  30. Changes in statistical production

  31. Communication Revolution

  32. Communication Availability Limitation of traditional tools: • No timeliness • Limited value added to statistics • Only for specialised users • Lack of flexibility

  33. New digital publication

  34. Eurostat wiki Search all SE publications New section with easy explanations

  35. Interactive tools Economic Trends Country profiles Regional Statistics Illustrated

  36. Mobile apps Country profiles My Region EU Economy Eurostat quiz Available for iPhone, iPad and Android

  37. Thank you for your attention!

More Related