210 likes | 501 Views
Surveys. Questionnaires & Interviews Electronic Methods. Survey Error. Types of Surveys. Self-administered (questionnaire) Telephone On-line Interviews. Statements vs Questions. Statements are most often used when the research anticipates composite score development Questions
E N D
Surveys Questionnaires & Interviews Electronic Methods
Types of Surveys • Self-administered (questionnaire) • Telephone • On-line • Interviews
Statements vs Questions • Statements are most often used when the research anticipates composite score development • Questions • open-end (easy to do, difficult to manage in analysis) • closed-ended (fixed) response (requires more attention in the development – easier to manage in analysis
Criteria for Statement/Question Development • Clear – neither vague or ambiguous • Avoid “Double Barreled” questions • Respondents must be competent • Respondents must be willing • Questions must be relevant • Shorter is better • Avoid “negative” items • Avoid biased items/terms
Questionnaire format • Introduction – completion time • White space • Literacy level • Organized • Easy to follow • Demographics at the end • Return address/Contact Person • THANK YOU
Formats • Use “boxes” • Contingency Questions • Matrix Questions • Appearance (bold, highlight, Caps, etc.) • Order – logical (general first – open-ended first) • Avoid “staples” (use 11 x 17 paper folded instead of stapling two 8.5 x 11)
PRE-TEST • PRE-TEST • PRE-TEST • PRE-TEST • PRE-TEST
MAIL QUESTIONNAIRES • ANONYMOUS vs CONFIDENTIAL • COVER LETTER • RETURN ENVELOP OR ADDRESSED AND POSTPAID QUESTIONNAIRE • REMINDER CARD • FOLLOW-UP MAILING • MONITOR RESPONSES – (return rate: 50%=C, 60%=B, 70% or more=A)
INTERVIEWS • Interviewing is “interaction” and the interviewer may effect the data: • Begins with the survey form and an “interviewer guide” and “respondent’s material” • Interviewer training – including practice interviews • Recording responses, probes vs clarification, field editing
ALTERNATIVE SURVEY METHODS • Computer-Assisted Telephone Surveys (CATI) • Computer-Assisted Personal Interviews (CAPI) • Computer-Assisted Self-Interviews (CASI) • Computerized Self-Administered Questionnaire (CSAQ) • Touchtone Data Entry (TDE) • Voice Recognition (VR)
Surveys Large amount of data can be collected More detailed data Fewer incomplete forms Higher return rates Flexibility in sampling Fewer misunderstood questions Questionnaires Economy Speed Lack of interviewer bias Anonymity & Privacy Surveys vs Questionnaires
QUESTION GUIDELINES Prior Questions
Prior Questions • SHOULD YOU DO THE STUDY? • WHO WILL USE THE DATA? • HOW WILL THE DATA BE USED? • WHAT DATA NEED TO BE COLLECTED? • WHO WILL SUPPLY THE DATA? • HOW WILL THE DATA BE ANALYZED?
MEASUREMENT IDEAS • INTERVIEW POTENTIAL USERS • REVIEW LITERATURE • INTERVIEW SAMPLE OF RESPONDENTS • BRAIN-STORMING
CRITERIA FOR QUESTIONS • CLARITY • LENGTH • SPECIFICITY • UNIDIMENSIONALITY • WORD CHOICE
Criteria for Questions (cont) • BIAS • SENSITIVITY • REDUNDANCY • PURPOSEFULNESS • OMNISCIENCE
THE RESPONSES: Open-Ended • PILOT STUDIES • LESS BIASED • VARIETY OF RESPONSES • INTRODUCE NEW TOPICS • RESPONDENTS “HAVE THEIR SAY” • BACKGROUND FOR INTERPRETATION • “LIFE & CREDIBILITY”
THE RESPONSES: Fixed-choice • UNIFORM STIMULI • EASY & QUICK TABULATION • NOT DEPENDENT UPON WRITING ABILITY OF RESPONDENTS • LESSEN PROBLEMS OF VOCABULARY • MORE QUESTIONS ASKED • EASIER FOR PEOPLE TO COMPLETE