130 likes | 255 Views
Response representativeness, proxy report and measurement error in the LFS. Barry Schouten & Kasper Leufkens Statistics Netherlands. ITSEW 2010, June 14-16. Goal. Investigate relation between response representativeness and measurement error as a function of design features
E N D
Response representativeness, proxy report and measurement error in the LFS Barry Schouten & Kasper Leufkens Statistics Netherlands ITSEW 2010, June 14-16
Goal • Investigate relation between response representativeness and measurement error as a function of design features • Generalize from survey item specific measurement error to measurement risk profiles
Design features • Number of visits to address • Appointments • Proxy reporting Assumption: Interviewer strategies not affected by restriction to smaller number of visits, no appointments, self-report only
Definitions Response propensities: Measurement risk profile(s): Profile propensities Response error:
Definitions Survey error quality indicators based on bias of response mean Maximal nonresponse bias Maximal interaction bias Profile rate
Implementation for LFS Two profiles: • Socially desirable answers: employed according to respondent but not in registration, or not employed but subscribed employment office according to respondent but not in registration • Acquiescence: not employed according to respondent but in registration Response and profile propensities estimated using registrations and frame data: age, household composition, urbanization of residence area, job status, ethnicity, house value
Results – Nonresponse bias Diamonds = no proxy, no appointment Traingles = no proxy, appointment Filled circles = proxy, no appointment Solid circles = proxy, appointment
Results – Nonresponse bias Diamonds = no proxy, no appointment Traingles = no proxy, appointment Filled circles = proxy, no appointment Solid circles = proxy, appointment
Results – profile 1 Diamonds = no proxy, no appointment Traingles = no proxy, appointment Filled circles = proxy, no appointment Solid circles = proxy, appointment
Results – profile 2 Diamonds = no proxy, no appointment Traingles = no proxy, appointment Filled circles = proxy, no appointment Solid circles = proxy, appointment
Conclusions • All design features have strong impact on response rate • Maximal nonresponse bias stable with respect to number of attempts and appointments • Maximal nonresponse bias smaller when proxy allowed • Profile 1: interaction bias and profile rate stable, small increase in interaction bias when proxy allowed • Profile 2: interaction bias and profile rate negatively affected by proxy reporting. No impact of other design features
Discussion • Are assumptions about interviewer strategies reasonable? • Is concept of measurement risk profile useful and is it sensibly implemented in LFS? • If so, is it useful to monitor the proposed “survey item independent” indicators? • Are results conforming to literature/experience?