1 / 22

Electronic Questionnaire Collection at Statistics Canada

Electronic Questionnaire Collection at Statistics Canada. Milana Karaganis Marc St-Denis. Outline. Electronic Questionnaire project Electronic Questionnaire for business surveys. Statistics Canada • Statistique Canada. 2014-09-17. 2. Electronic Questionnaire Project.

armina
Download Presentation

Electronic Questionnaire Collection at Statistics Canada

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Electronic Questionnaire Collection at Statistics Canada Milana Karaganis Marc St-Denis

  2. Outline Electronic Questionnaire project Electronic Questionnaire for business surveys Statistics Canada • Statistique Canada 2014-09-17 2

  3. Electronic Questionnaire Project • Build generic EQ service to be used by all surveys • EQ platform • Standard approach to EQ • Create a critical mass of EQ service users • 160+ surveys • Business surveys and some social surveys • Reduce collection and operations costs • Timeline: April 1, 2010 -> March 31, 2016 Statistics Canada • Statistique Canada 2014-09-17 3

  4. Electronic Questionnaire Project • E-questionnaire solution • Support all EQ applications for all surveys • Use Statistics Canada infrastructure • Comply with security and confidentiality standards • Automate EQ survey application development -> build an engine to render EQ applications based on provided inputs, E-questionnaire Generation System (EQGS) Statistics Canada • Statistique Canada 2014-09-17 4

  5. Electronic Questionnaire Project Statistics Canada • Statistique Canada 2014-09-17 5

  6. Electronic Questionnaire Project • Standard approach to EQ – corporate solution • Develop EQ applications according to EQ standards • Apply standard look and feel • Build functionalities required for all surveys • Use standard collection strategies • EQ as initial collection mode in sequential mode collection • Use standard development process • Shorten development cycle Statistics Canada • Statistique Canada 2014-09-17 6

  7. Statistics Canada • Statistique Canada

  8. Statistics Canada • Statistique Canada

  9. Progress To-Date • EQ solution implemented • Change Management process • First set of EQ standards released • Survey development process created • Initial collection strategies established • Deployed 39 EQ applications and realized efficiencies • Overall success: • Lessons learned • Big cultural shift Statistics Canada • Statistique Canada

  10. EQ Among Business Surveys • Outline • Evolution of EQ collection strategies • Results observed to date • Survey collection strategy guidelines • Results of tests Statistics Canada • Statistique Canada

  11. Collection Strategies Among Business Surveys • Moving from conventional collection modes (PAPI & CATI) to EQ (over 100 surveys in 5 yrs) • Evolution of multi-modal collection with EQ as primary mode • Measuring results and improving • Respecting data quality, timeliness, budgets • Reviewing collection strategies Statistics Canada • Statistique Canada

  12. Reviewing Collection StrategyQuarterly Services Indicators (QSI) Survey Statistics Canada • Statistique Canada

  13. Reviewing Collection StrategyQuarterly Services Indicators (QSI) Survey Statistics Canada • Statistique Canada

  14. EQ Collection Strategy Guidelines • Developing tools to ensure optimal collection strategies (monthly; quarterly; annual) • Follow-up schedule geared to multi-mode collection • Standardise approach towards efficiencies • Considering respondent burden, data quality, response rates, costs Statistics Canada • Statistique Canada

  15. EQ Experimental Design for the UES Statistics Canada • Statistique Canada

  16. Results of the experimental design Progressive unweighted return rate (%) for each treatment (2011) Number of call attempts by survey treatment Statistics Canada • Statistique Canada

  17. Highlights • Treatments consisting of 4 e-reminders only resulted in 46+% as of June 20th • At end of collection (Oct 14) the 4 treatments had very similar response rates • T2 showed the lowest attempts and lowest TPU • Limited worth conducting telephone NRFU for first few months; still reach similar final response rates with fewer phone attempts Statistics Canada • Statistique Canada

  18. Access Code Letter • Piloted for UES 2012 collection • Conducted pre-contact for birth cases in sample • Unable to contact cases = mailed an access code letter providing hyperlink to an EQ • More difficult cases since unable to reach during pre-contact • After 30 days, telephone NRFU Statistics Canada • Statistique Canada

  19. Access Code Letters: Results Collection status on July 16, 2012 for units that received an access code letter Statistics Canada • Statistique Canada

  20. The Future • Successful in achieving its objectives • Mission critical monthly surveys • UES (60 surveys) + LFS • Add new functionalities to EQ platform • Respondent EQ = Interviewer EQ • Assess respondent’s level of tolerance to edits • Streamline processes and operations • Monitor quality, response rates, costs • Research Statistics Canada • Statistique Canada

  21. milana.karaganis@statcan.gc.ca marc.st-denis@statcan.gc.ca Statistics Canada • Statistique Canada

More Related