Collection of Paradata in a CAPI System with Wireless Telecommunications

1. Collection of Paradata in a CAPI System with Wireless Telecommunications Vesa Kuusela and Kai Vikki Social Survey Unit Statistics Finland

2. Background • Paradata did not exist in paper-and-pencil era • Computer Assisted Interviewing (CAI) systems brought along many possibilities to collect data about the process • CATI call schedule systems collect (automatically) data that can be used for quality control or for process development • In CAPI system paradata collection has to be arranged separately • Problem has been the limited telecommunications facilities • At Statistics Finland, newly redesigned CAPI information system is based on 3G telecommunications • Fast data transmission has opened new perspective for paradata collection Q2010, Helsinki 2010

3. Wireless Wide Area Network (WWAN) • WWAN uses mobile telecommunications network for transfering data • Nearly the same as mobile phone network (GSM) • Based on third generation (3G) of telecommunication hardware standards • Universal Mobile Telecommunications System (UMTS) is most common of the 3G technologies (in Europe) • In theory, UMTS supports up to 21 Mbit/s data transfer rates - in practice much less. • General packet radio service (GPRS) is a mobile data service for the 2G mobile communication systems (GSM). • GPRS provides data transfer rates up to 114 kbit/s • Pricing is based either on amount of transferred data or on fixed monthly fee Q2010, Helsinki 2010

4. Current status of 3G • WWAN is originally designed for the new mobile telephones but its use for wireless connection to the Internet increases rapidly • In Finland, 3G/UMTS networks cover nearly all parts of country and GPRS covers the whole country • Currently fastest available transfer rates are 5 Mbit/s downstream and 2Mbit/s upstream • For computer use, a slot for a SIM card is needed either on mother board, on PCMCI card, or in a connector to UBS port. Q2010, Helsinki 2010

5. Building blocks of new CAPI System • Interviewers connect using 3G over the Internet • Fixed monthly fee, independent of amount of transmitted data • Data transmission with Secure FTP (SFTP) • Firewall protected SSH-Server on Demilitarized Zone • SSH-server has Inbox and Outbox for each interviewer • At the main office, a network computer called ”Separator” polls SSH-server once in 10 minutes and delivers objects to appropriate places Q2010, Helsinki 2010

6. Schematic display of technical arrangement Q2010, Helsinki 2010

7. Features of new system • Interviewers have • Laptop computer • “Net stick” for (high-speed) Internet access through WWAN • While conducting interview, interviewer works off-line • All telecommunication (for CAPI) is arranged through the Internet and SFTP • Data transmission once a day • In addition, through VPN interviewers • have access to Statistics Finland intranet • are clients to Statistics Finland email system Q2010, Helsinki 2010

8. Paradata from interviews • All Statistics Finland questionnaires include a standard set of data fields for automatic recording of • interviewer code • date and time of interview • end result (interview or non-response) • reason of non-response with standard coding • three start and end times to record the total processing time of each case • At the office, paradata from interviews are processed and printed every day with a standard reporting scheme • For specific needs it is possible to add automatic fields or questions for interviewers to collect paradata Q2010, Helsinki 2010

9. Example of a standard report of a survey (LFS) Same table can be produced also for all regions or based on repondents’ characteristics (e.g. gender or age) Q2010, Helsinki 2010

10. Recording of contact history of cases • In interviewers’ user interface is application for recording of all contact attempts with respondents • Time stamps are automatically attached to each transaction • Agreed appointments are added to the calendar application Q2010, Helsinki 2010

11. Example of recorded contact history • Each transaction is on one row showing • Date and time • Contact media • Contacted person • Time of agreed appointment • Remarks • Contact history is returned automatically with other case data Q2010, Helsinki 2010

12. Possibilities provided by new technology • Technically, the amount of collected paradata is no problem anymore • Very large paradata files can be sent, e.g. audit trail files, audio files and video files • Many features of CATI case management can be installed in the new CAPI system • Some new possibilities for CAPI system design also emerge • New approach to paradata collection • The difficult question is what to do with the paradata Q2010, Helsinki 2010

13. Questions in paradata collection • For what purpose is paradata collected? • Quality control and quality assurance? • To increase cost-efficiency of data collection? • How is paradata collection arranged? • Automatically • Requires some standardisation in data collection • Interviewers enter appropriate data • Causes extra cost if interviewers are paid by hour • By supervisors from other process or administrative information • How is the reporting arranged? • Automatic reporting • Ad hoc –type reporting • What about feedback for process control? Q2010, Helsinki 2010

14. Future scenarios • Technically, CAPI case management with WWAN could be designed similarly as in a CATI system • Storing data real-time in a central data base is possible already (on-line interviewing) • Case assignment to interviewers is more problematic • Connection between interviewer and office can be arranged using e.g. VPN or Citrix • For example, it is possible to build a system where supervisors see in real time when an interviewer is conducting an interview and for what survey Q2010, Helsinki 2010

15. The end Thank you for your attention Q2010, Helsinki 2010