280 likes | 409 Views
‘Keeping in touch’ on the Wealth and Assets Survey (WAS ). Oliver Tatum and Angie Osborn Understanding Society Research Conference 2013. Outline. WAS background Longitudinal issues Experiment design Research findings Future plans Questions. WAS background.
E N D
‘Keeping in touch’ on the Wealth and Assets Survey (WAS) Oliver Tatum and Angie Osborn Understanding Society Research Conference 2013
Outline • WAS background • Longitudinal issues • Experiment design • Research findings • Future plans • Questions
WAS background • Wealth & Assets Survey (WAS) • Longitudinal survey of private households in GB • All adults over 16 years (excluding 16-18 year olds in FT education) • Consortium of government departments • Collects data on: • value of all personal savings, assets and debt; • level of saving for retirement; • financial advice: frequency and types received; • attitudinal (attitudes to saving, financial acuity, wellbeing, health)
WAS background: Survey topics • Property wealth • House value minus Mortgage values • Other Property – Buy to let/ 2nd homes (incl. Overseas) • Physical wealth • Vehicles, House contents and Collectables • Financial wealth • Assets: Current / Savings/ Investment accounts/ Shares/ Trusts • Liabilities: Loans / Credit Cards/ Store cards/ Mail order/ HP • Pension wealth • Employer sponsored & Individual Personal pensions • Retained pensions (previous employment) • Pension from a Spouse or Partner (current or former)
Distribution of Total Household Wealth, Great Britain, 2008/10
WAS background: Survey design • Random sample, stratified by Postcode • Royal Mail Postcode Address File (PAF) • Wealthiest 10% Postcodes over-sampled (3:1) • All private households in GB (excl. north of Caledonian Canal, the Scottish Islands and the Islesof Scilly) • Computer Assisted Personal Interviewing (CAPI) • Responses weighted using census data to allow results to be generalised to GB population
WAS background: Survey design • Re-interview households every two years • Follow original sample members to new addresses Wave 1 Wave 2 Wave 3 Wave 4 July 06–June 08 July 08-June 10 July 10-June 12 July 12-June 14 • Keeping In Touch Exercise telephone (KITE) 4 months (previously 3 months) before follow up
WAS background: Survey design Wave 1 • 62,400 households sampled • 55,829 households eligible • 30,595 achieved household interviews Wave 2 • Wave 1 respondents re-interviewed • Wave 1 non-contacts re-attempted • 20,170 achieved household interviews Wave 3 & Wave 4 • Wave 1&2 respondents re-interviewed • Wave 2&3 non-contacts & soft refusals re-attempted • New panel boost : • 12,000 new addresses in wave 3 • 16,000 new addresses in wave 4
Longitudinal issues • Attrition: • Maintaining WAS longitudinal sample over time by maximising response at next wave • Tracking: • Accurately tracking WAS original sample members who move address (local/distant) between waves • Engagement: • Keeping respondents interested in & engaged with WAS over time
Longitudinal issues: Current measures • Anticipatory: • various contact details collected • nominated persons contact details • likelihood of moving in the next year checked • respondent change of address cards • incentives for participation • Between wave: • telephone ‘keep in touch exercise’ (KITE) • UK address changes service • In wave: • interviewers trace local movers in the field • pre-paid respondent letter left with old address • distant movers reissued to another interviewer
Longitudinal issues • Attrition: • Maintaining WAS longitudinal sample over time by maximising response at next wave • Tracking: • Accurately tracking WAS original sample members who move address (local/distant) between waves • Engagement: • Keeping respondents interested in & engaged with WAS over time • Value for money: • Using resources required to address these issues as efficiently/effectively as possible
Aims of the Experiment • To measure the impact of two KITE methods on response rates for field work • To establish the best timing for issuing survey newsletters to respondents • To measure the effectiveness of two KITE methods to identifying eligible and ineligible movers • To provide supporting information to make an informed decision about the cost-effectiveness of assessed treatments.
KITE Experiment Design (1) KITE + Newsletter KITE KITE No treatment Newsletter
Experiment Design (2) Newsletter • 2-page leaflet • Easy-to-read graphs • Media headlines and user feedback • Highlighting importance to participate • Contact details KITE Interview • ~ 5 min CAPI interview • 4 months before field interview • Up-date on household composition and contact details
Hypothesis testing H0: The individual’s field interview outcome is independent from the experiment group H0: The individual’s field interview outcome is independent from the length of time between posting the newsletter and the field interview H0: The resident status at the field interview is independent from the experiment groups
Hypothesis Testing (1) H0: The individual’s field interview outcome is independent from the experiment group.
Hypothesis Testing (2) H0: The individual’s field interview outcome is independent from length of time between posting the newsletter and interview.
Hypothesis Testing (3) H0: The resident status is independent from the experiment groups.
Summary (1) H0: The individual’s field interview outcome is independent from the experiment group KITE and newsletter together do have some positive effects on response at the field stage
Summary (2) H0: The individual’s field interview outcome is independent from the length of time between posting the newsletter and the field interview This test did not show any conclusive evidence on the best time to post newsletters
Summary (3) H0: The resident status at the field interview is independent from the experiment groups The KITE interviewer does have an effect on the identification of movers
Conclusion • Continue KITE interviews positive impact on identifying movers and tracing them at new location • Consider introduction of periodical newsletters positive impact on response rates in combination with KITE interviews
Future plans • Attrition and response measures: • Introduce mailed out newsletter for previous respondents • Introduce key WAS results factsheet for field interviewers • Email KITE for telephone KITE non-contacts • Incentives testing: unconditional £5 voucher with advance letter for boost addresses (Apr–Sep 2013) • WAS outputs: • WAS Wave 3 results scheduled December 2013 • Wave 5 development • Wave 5 pilot in October 2013 • Wave 5 launch scheduled for July 2014
Questions / Comments? Oliver Tatum oliver.tatum@ons.gsi.gov.uk Angie Osborn angie.osborn@ons.gsi.gov.uk