Agricultural Data Collection Procedures

1. Agricultural Data Collection Procedures Section B

2. Quality Control Tools • Listing sheet controls • Interviewer observations • Formal / Informal reviews • Reinterview • Address listing QC

3. Listing Quality Control Tools Dependent Quality Control, including: • Advance listing • Suppression If errors are found, choices include: • Listing mistakes corrected • Re-list enumeration area

4. Dependent Quality Control • Supervisor or another enumerator checks a sample of the listing. • Copy listing information for select units without enumerator knowledge. • Review a randomly chosen area to verify coverage, check for omissions and completeness.

5. Other Listing Quality Control Tools Advance Listing • Supervisor lists sample before enumerator • Compare work when enumerator completes the sample section. Suppression • Enumeration units are removed from listing • Supervisor checks for enumerator updating of suppressed (omitted) units

6. Interviewer Observations • Supervisor watches enumerator work • Does not interact to minimize bias • Makes notes during observation • Provides feedback after observation

7. Interviewer Observations • Assess effectiveness of training • Ensure enumerators can do their work • Provides continuous feedback • Corrective actions may be needed

8. Formal / Informal Reviews What are the goals of reviews? • To ensure the quality of the data collected on forms and questionnaires • To ensure interviewers and clerks understand and follow procedures for completing forms and questionnaires

9. Informal Reviews • Supervisor reviews enumerator forms during enumeration • Check for legibility, completeness and accuracy • Provide feedback • Repair errors

10. Formal Reviews • Conducted by field office staff upon completion of EA • Provides check of supervisory work • Repair errors or return to field where necessary

11. Random Reinterview • Another field staff member interviews an enumeration unit after enumerator • Finds same respondent and completes new questionnaire • Questionnaires are compared to verify content

12. Random Reinterview Sample • Supervisor takes simple random sample from each enumerator’s workload • Above supervisory level uses two-stage sample: • Sample of enumerators in their area • Sample of enumeration units from those enumerators

13. Reinterview Errors • Falsification (release interviewer) • Interviewer error (retraining/feedback) • Respondent error (no action) Rework may be necessary for falsification or other serious errors

14. Administrative Reinterview • Accumulates data on work characteristics for all interviewers • Vacant enumeration units • Partial interviews • Enumeration units by type/location • Deleted enumeration units • Average size per enumeration unit

15. Administrative Reinterview • Provides a more targeted and informed approach to identifying outliers • Does not replace other reviews • Management tool and provides organizational operational data

16. Administrative Reinterview • Compile data for all enumerators • Compare individual data to compiled data • Note areas of variance for investigation • Could be that individual is performing better than group

17. Administrative Reinterview Actions • Cannot take corrective action without investigation • Increase suspect enumerator reviews: • Informal/formal review • Reinterview

18. Supplemental Reinterview • Purposeful selection of a particular enumerators work for reinterview • Supervisor selects sample size • Ensure quality • Avoid over-sampling

19. Supplemental Reinterview • Means for checking work of selected enumerators • Especially useful for suspected falsification • Should be stopped once quality is of acceptable level

20. Section B Quiz • What are the five quality control tools available for data collection operations? • What are three listing quality controls? • Explain how to conduct interviewer observation. • Name the three types of reinterviews that can be used to assess the content and quality of data collection. • Is falsification a serious problem? Yes or No