1 / 24

Sébastien Faivre, INSEE, Head of the Sampling Unit Q 2014

Maintaining high quality surveys with optimized interviewers replacements : the new French sample monitoring strategy. Sébastien Faivre, INSEE, Head of the Sampling Unit Q 2014. 1. INSEE Household Surveys Sampling 2. The issue of unexpectedly missing interviewers

nigel-berry
Download Presentation

Sébastien Faivre, INSEE, Head of the Sampling Unit Q 2014

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Maintaining high quality surveys with optimized interviewers replacements : the new French sample monitoring strategy Sébastien Faivre, INSEE, Head of the Sampling Unit Q 2014

  2. 1. INSEE Household Surveys Sampling 2. The issue of unexpectedly missing interviewers 3. INSEE new sample monitoring strategy to deal with unexpectedly missing interviewers 4. Conclusion

  3. INSEE Household Surveys Sampling INSEE surveys are mainly face to face surveys drawn in the French Master Sample and carried out by INSEE interviewers network Sampled dwellings are concentrated in a limited number of areas (primary units) to: - Reduce collection costs (journey time,tracking…) - Hire a fixed network of investigators who gain experience of field operations over time 3

  4. The sample frame: the French rolling census Small municipalities (less than10 000 inhabitants) : building 5 random samples of municipalities (« rotation groups »), with equal probabilities whole Census each year of all municipalities belonging to one of the rotation groups. Big municipalities (over 10 000 inhabitants) : Building in each of them 5 samples of addresses (« rotation groups ») from a file updated each year (RIL, register of located blocks). Drawing each year a sample of dwellings (clusters of addresses) ; the average sample rate is about 40 % of all dwellings belonging to the current rotation group. Census of this sample of dwellings. 4

  5. The French New Master Sample 2009 Takes profit from the « freshness » brought by the rolling Census : Using as a frame of a given year n + 1 all the dwellings covered by the Census at year n. The yearly sampling frame covers only a part of the territory. 5

  6. The French New Master Sample 2009 => Advantages : Limit the wastes due to the changes in buildings (demolition, main homes becoming secondary homes and V.V….), which create unwished costs. Draw in a more efficient way samples on particular sub-populations (whose recent characteristics are known). Get rid of a specific system to cover new dwellings. 6

  7. The French New Master Sample 2009 It implies to build specific primary units called IAA (Interviewers Action Area). An IAA may be either: - a big municipality - a collection of small municipality that includes at least one municipality in each of the five rotation groupes and 300 dwellings in each of the five rotation groups

  8. Example of an IAA formed of small municipalities

  9. The French Master Sample 2009 Among the 3743 IAA built in the French Metropolitan Territory: 37 have been incorporated in the take all stratum (big municipalties with more than 40 000 dwellings in 1999) 488 additional have been selected proportionnaly to size with a regional stratification and a balanced sample design Each year, the samples are drawn among the dwellings censused the year before in the drawn IAA. 9

  10. The French Master Sample 2009 The number of dwellings drawn in each IAA is calculated: in order to minimise the variance of the final weights of dwellings under constraints of minimum and maximum number of dwellings drawn in each IAA, to provide a reasonable amount of work to the interviewer in charge of the IAA 10

  11. The issue of unexpectedly missing interviewers Hired interviewers are expected to devote a fixed amount of time (set beforehand by contract) to data collection. It comprises: The total travel time to reach the dwellings The total time surveying sampled households 11

  12. The issue of unexpectedly missing interviewers Generally not possible to increase interviewer’s time devoted to data collection Usually costly and complicated to recruit another interviewer in a specific area and train him/her in a very short time Therefore, missing interviewers may not always be replaced

  13. INSEE new sample monitoring strategy Aim : minimising the sample weights dispersion Under the constraints of not exceeding available interviewers’ time devoted to data collection

  14. INSEE new sample monitoring strategy The method is based on two hypothesis: The number of visits per household is the same in the usual IAA and in the vacant IAA The total time surveying sampled households for the interviewer remains the same after the redesign of the sample

  15. INSEE new sample monitoring strategy Under those two assumptions, the number of dwellings finally surveyed by the interviewer in the usual IAA and in the vacant IAA shall fullfill following constraint: where denotes the number of dwellings the interviewer was exepected to survey in its usual IAA, the journey time for the interviewer to reach its usual IAA and its journey time to reach the vacant IAA. Notice that asking the interviewer to carry out one survey in the vacant IAA leads to give up dwellings in its usual IAA

  16. INSEE new sample monitoring strategy Let denote the final sample weight of dwelling d The method finds the allocations ( ) that minimize the sample weights dispersion under the constraints of the interviewers’ time devoted to data collection. An additional constraint of a minimum number of dwellings to be surveyed may also be introduced A step by step approach to find the solution

  17. Example of use of the method Taken from the Housing Survey in the region Rhône-Alpes 2591 dwellings have been drawn in the region. The initial weights dispersion is 1954 The red IAA (Vizille) is vacant, with 32 dwellings drawn in this IAA. Interviewers affected to the blue IAA (La Mure) and the yellow IAA (Saint-Marcellin) can be asked to carry out surveys in the vacant IAA.

  18. Example of use the method

  19. Example of use of the method For one dwelling surveyed in the red IAA by the interviewer affected to the blue IAA, it has to give up 25/10=2,5 dwellings in the blue IAA For one dwelling surveyed in the red IAA by the interviewer affected to the yellow IAA, it has to give up 55/29=1,9 dwellings in the yellow IAA => it is less « expensive » to ask the interviewer of the yellow IAA to carry out surveys in the red IAA, though the blue IAA is nearer from the red IAA.

  20. Results

  21. Resultats 14 dwellings on 32 will be surveyed in the red IAA 35 dwellings on 52 will be surveyed in the blue IAA 30 dwellings on 43 will be surveyed in the yellow IAA Surveyed dwellings in the three IAA are randomly selected among the initiallly sampled dwellings

  22. Results The interviewer affected to the yellow IAA surveys 7 dwellings in the red IAA and has to give up 13 dwellings in its usual IAA The interviewer affected to the blue IAA surveys 7 dwellings in the red IAA and has to give up 17 dwellings in its usual IAA

  23. Conclusion This sample redesign methodology has been implemented for two surveys so far. It has proved efficient to reorganise field operations in order to avoid bias due to a vacant IAA When the results of those surveys will be available, accuracy estimations will be carried out to account for the impact on quality of this new sample monitoring strategy

More Related