1 / 22

TQM in Interview Data Collection Process Matti Simpanen

TQM in Interview Data Collection Process Matti Simpanen. Quality outcome Good reputation and glory!. Weighting, corrections Analyse, reporting. Data collection=Interviews!. Survey plan, sampling. Research problem. Interview is not a constant variable!.

cybil
Download Presentation

TQM in Interview Data Collection Process Matti Simpanen

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. TQMin Interview Data Collection ProcessMatti Simpanen

  2. M.Simpanen • Quality outcome Good reputation and glory! • Weighting, correctionsAnalyse, reporting • Data collection=Interviews! • Survey plan, sampling • Research problem

  3. M.Simpanen Interview is not a constant variable! • My mission is try researchers to bear in mind the data collection should not be forgotten in quality reports • Researchers should demand quality in data collection process, and not to keep it as given, constant quality • Also financiers should consider the quality of data, not only how get data with lowest expensies

  4. M.Simpanen Topics The employment system The recruitment process Interviewer training The standardised interviewing method Setting the objectives Quality monitoring

  5. M.Simpanen Survey process is a coherent process A survey is a process in which every individual stage is influenced by the other stage Every part of the survey process has to have adequate understanding of the survey process, its backgrounds, goals and operating principles Even interviewers or other field workers Needs continuous quality monitoring (various perspectives) Interviewers employment system What kind of employment system helps to keep quality high? Remuneration From what interviewers are paid? Efficienty or quality? System has to be encouraging and fair

  6. M.Simpanen Quality starts from the recruitment process Systematic recruitment process to measure applicant’s ability to understand and follow the standardised interview method (see later) to measure interaction and style of interview (positiveness) to measure ability to adopt backgrounds and goals of surveys quickly (general understanding of surveys and interview work) to measure general commitment abilities and a tolerance of routines Interviewers represent survey organisation, are impartials In Statistics Finland recruitment process divides into three phases: Phone contact (systematic evaluation of applicant's voice, interaction, etc). Structured job application form (internet-based) Job interviews (f-to-f)

  7. M.Simpanen The quality demands training and orientation To orietate interviewers / other field workers to survey process basic training, project training, further training Basic training The goal is to orientate new interviewers to do interviewer’s work to familiarise interviewers to standardised interviewing method to orientate new interviewers to the survey process as a whole to orientate new interviewers to the organisation (commitment) In SF one week basic training + repetition and follow-up after 1-2 months

  8. M.Simpanen Interviewer skills need continuing training • Further training • to develop and to maintain interviewers skills • to motivate interviewers • to commit interviewers to the survey process and to the quality work • to repeat items of standardised interviewing method • Goal of training is to get interviewers understand their role in the survey process and the value of their work

  9. M.Simpanen Standarised interviewing method • Questionnaire standards • Interviewing techniques • Interviewing style • Interview interaction

  10. M.Simpanen Questionnaire standards • Structured way to make questions, answer alternatives, introductions, descriptions to the questionnaires • factual and other (opinion) questions • standards are guiding the interviewer • helps researcher to formulate questions • for example does the question really measure the researcher wants it to measure • Helps the interviewer realise how to ask different kind of questions • gives time to interviewer to use his/her skills of interaction to get the interviews • interviewer´s work is to do interviews, not to think how different questions should be asked (to reduce interviewer effect)

  11. M.Simpanen Interviewing techniques • the manner in which interviewer presents questions and answer alternatives, introductions, descriptions • the manner interviewer presents the question modules and introductions and • clarifies questions if the respondent does not understand the question (neutral probing) • Interview technique is NOT monotonous repeating the questions • Interview techniques allow more time to use to the interaction • Using interviewing techniques the interviewer ”teaches” the respondent to understand our way to do interviewing work (the right answer atmosphere) • To keep quality high (to ask questions similarily leads to less interviewer effect and more comparable and reliable data)

  12. M.Simpanen How satisfied are you to your life as general? How satisfied are you to your spouse? Correlation: +0,37 How satisfied are you to your spouse? How satisfied are you to your life as general? Correlation: +0,62 Examples: Question order

  13. M.Simpanen Interviewer: Always read the following text as well: Did you return in August or July from a domestic trip with overnight stay, with a destination of at least 30 km from your home. Included are all trips with overnight stay in Finland; also trips to own free-time residence, visits to friends or relatives, and business and professional trips?

  14. M.Simpanen Interviewing style • Articulation • Pace • Use of pauses and emphasis • Speech manners • Neutrality of language • Voice in general

  15. M.Simpanen Interview interaction • We put effort to interaction: • The basic precondition is to get the respondent to agree to the interview • Interviewers behave to convince the respondent (persuasion) • To create right kind of atmosphere by applying the interviewing technique and to use the correct interviewing style • In SF we measure by recordings the interviewers´ interviewing techniques, interviewing style and interaction

  16. M.Simpanen Objectives, follow-up • To maintain quality high needs the objectives, the goal settings • efficiency and quality • to the projects and to the interviewers • short-term and long-term goals, even mid-term goals on project • schedule, response rate, quality • Quality control by monitoring (recordings, supervisor monitoring) • Objectives to commit interviewer • to the project • to the survey • to the organisation • Cost control system

  17. M.Simpanen Feedback system • Appraisals or personal discussions • Interviewer feedback surveys • Respondent feedback surveys

  18. M.Simpanen Appraisals, discussions • Basic/project training is not enough to keep quality of interviews high • Needs also discussions with interviewers time to time • how the employee has succeeded • how to improve his/her performance • co-operation in the work society • motivation • professional development • and again to commit him-/herself to the survey and to interview work • In SF each employee has annual development and performance discussions (appraisals) with their immediate or own supervisor • personal performance -> flexible personal pay component

  19. M.Simpanen Interviewer feedback surveys • Systematic, comparable feedback surveys from each projects • to develope questionnaires and survey processes • systematic feedback • Feedback surveys show also that researchers/organisation respects interviewers’ attitudes and their work • Also systematic feedback on the interviewers’ working conditions, work methods and job orientation • to motivate • to commit the interviewers part of the survey processes

  20. M.Simpanen Respondent feedback surveys • Systematic, comparable feedback surveys from each projects • to develope questionnaires and survey processes • systematic feedback • response burden • validation

  21. M.Simpanen At the end... The main point is NOT to say every organisation should have its own interviewing organisation but ... survey is the coherent process - including several subprojects every party of the whole process has to have similar values of the process every party has to have similar understanding of the process every party needs to commit themselves to the survey process - not only an individual project Processes should be systematic and systematically evaluated To maintain quality of data collection demands continuing follow-up All these mentioned before have a great influence to the quality Research, analyse and report also paradata of interviews Poor data collection cannot be corrected with mathematical tricks!

  22. M.Simpanen Thank you!matti.simpanen@stat.fi

More Related