1 / 25

Response rates and disposition coding

Response rates and disposition coding. PHC 6716 June 8, 2011 Chris McCarty. RDD Telephone Disposition Codes. I = Complete interview (1.1) P = Partial interview (1.2) R = Refusal and break-off (2.10) NC = Non-contact (2.20) O = Other (2.30)

duante
Download Presentation

Response rates and disposition coding

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Response rates and disposition coding PHC 6716 June 8, 2011 Chris McCarty

  2. RDD Telephone Disposition Codes I = Complete interview (1.1) P = Partial interview (1.2) R = Refusal and break-off (2.10) NC = Non-contact (2.20) O = Other (2.30) UH = Unknown if household/occupied HU (3.10) UO = Unknown, other (3.20) e = Estimated proportion of cases of unknown eligibility that are eligible

  3. Types of rates • Response Rate (RR) = Proportion of cases interviewed of all eligible cases • Cooperation Rate (COOP)= Proportion of cases interviewed of eligible cases contacted • Refusal Rate (REF) = Proportion of eligible sample that refused • Contact Rate (CON) = Proportion of eligible sample where a household was reached

  4. What gets reported? • It is rare to see anything other than the response rate reported • Occasionally people will report the cooperation rate • This is often reported when the response rate is low

  5. AAPOR Response Rates

  6. AAPOR Response Rates I = Complete interview (1.1) P = Partial interview (1.2) R = Refusal and break-off (2.10) NC = Non-contact (2.20) O = Other (2.30) UH = Unknown if household/occupied HU (3.10) UO = Unknown, other (3.20) e = Estimated proportion of cases of unknown eligibility that are eligible

  7. Calculating e • e is an estimate of the proportion of non-contacts that are eligible • Its calculation depends on survey design and execution • There are a number of ways it can be calculated • Some people just make assumptions about e • http://www.aapor.org/pdfs/erate.pdf

  8. Example of calculating e for May 2011 CCI

  9. Comparison of response rates for May 2011 CCI RR1 11.1 RR2 11.1 RR3 12.9 RR4 12.9 RR5 16.2 RR6 16.2

  10. Exceptions to AAPOR Disposition Codes • In some cases AAPOR codes may not be detailed or descriptive enough to allow for exceptional circumstances with sample • If possible AAPOR codes should be used • If new codes must be used they should aggregate to existing AAPOR codes

  11. Last versus Final Dispositions • Last Disposition is actually the “most recent disposition” • Final disposition requires a rule for evaluating call history • There are no firm standards for evaluating call history • Research suggests that the difference is trivial

  12. Last versus Final Dispositions --Research For most recent call: Rule 1: Business always coded as business Rule 2: No eligible respondent always coded as no eligible respondent Rule 3: Disconnected number previously coded as no answer or temporary phone problem always coded as disconnected number Rule 4: Fax/data line previously coded as no answer or temporary phone problem always coded as Fax/data line Rule 5: Non-working number previously coded as a temporary phone problem always coded as a non-working number

  13. Council of American Survey Research Organizations (CASRO) Disposition Codes and Response Rates

  14. Example response rates • BRFSS Response rates by state (page 32): ftp://ftp.cdc.gov/pub/Data/Brfss/2010_Summary_Data_Quality_Report.pdf • Quinnipiac polls: • http://www.quinnipiac.edu/x271.xml

  15. What affects Response Rates? • Maximum call attempts • Maximum number of refusal callbacks • Fielding time • Rotation of calls across day of the week and time of day • The population surveyed • Survey length • Sample quality • Listed versus random-digit dial • Salience of survey topic to respondent

  16. Variables in model used to predict response rate across 205 surveys

  17. What would it take to get a 70% response rate?

  18. Ways people overstate response rates • Pre-screening samples incorrectly (e.g. removing persistently unavailable numbers) • Unreasonable calculations of e • Purchasing RDD sample from higher density banks

  19. Response rates with lists • When sampling from a list most of these rules must be modified • The fundamental question is “Who is eligible?” • If being on the list makes them eligible then they are

  20. Analyze the effects of non-response • If you have information about all potential respondents, compare respondents to non-respondents • Compare converted refusals to non-refusals • Compare early responders to late responders

More Related