SLIHS Midterm Review Meetings: Improving Data Quality & Addressing Field Challenges

1. 2018 Sierra Leone Integrated Household Survey (SLIHS) Abu Bakarr Turay, SLIHS National Coordinator SLIHS Midterm Review Meetings in Kenema (Sept 10-11); Bo (Sept 12-13) and Makeni (Sept 14-15) September 10-15, 2018

2. 2018 Sierra Leone Integrated Household Survey (SLIHS) 2018 SLIHS SECOND DATA QUALITY REVIEW MEETINGS FOR ALL FIELD TEAMS Kenema (Sept 10-11), Bo (Sept 12-13) and Makeni (Sept 14-15)

3. OUTLINE OF PRESENTATION • 5. Reminders • Survey Period and Books • Sources of Errors • Use of dates and period • Female 15-49 birth history • Education and Age • 6. Evidence from the Data • MICS 6 Matching • Under fives • Health in the last 4 wk • Being Pregnant • Economic Activities (ISIC) • Livestock • Food Item Report • Assumptions • Rules for the Meeting • Objectives of the Meetings • General Update • SLIHS Background • Activity • Deployment • Publicity • Monitoring • payment and HR Issues • Sample Achieved

4. Assumption • We make certain assumptions about the field staff: • They did acquire enough knowledge for them to have passed the selection exams on Friday 8th December 2017 during the field staff • They are available - field staff have given up all other things to be part of the survey - SLIHS is their only priority job • They are willing and ready to learn - take corrections from the coordinators, supervisors and from each other • They are willing to sacrifice for their country - money is secondary and not the primary motivation and ready to work anywhere they are posted • They have values and are very disciplined

5. RULES • Participants MUST attend ALL the training sessions • Be on time, 9am to 5:30pm (1 tea break and 1 lunch break) • Phones MUST always be on silent mode or off totally • Manuals/presentations are our key documents for this review • The sessions are participatory, ALL questions are welcome • All should be respectful and allow each other to make their points

6. OBJECTIVES OF SLIHS MIDTERM REVIEW MEETINGS 1/2 • To review and better understand the instrument/questionnaire in terms of: • Content-formulation of questions and instructions • Structure-skips based on age, sex and other responses • Understand the manual and code sheet and find the best possible ways of completing the questionnaires • Discuss errors and problems spotted in the data already collected

7. OBJECTIVES OF SLIHS MIDTERM REVIEW MEETINGS 2/2 • Discuss field challenges regarding: • Redeployment arrangements • Respondents cooperation • Local authorities supports • Terrain • Data entry problems • Internet connectivity • Finance and logistics • Other • Avoid the impact of monotony: • Fatigue • Negative dexterity • Rest from your labour: • Take a break • See places • Refresh • Interact with other Teams

8. GENERAL UPDATES

9. Update- 2018 SLIHS BACKGROUND 1/2 • The 2018 SLIHS is a nationwide survey conducted under the Statistics Act, 2002 • SLIHS is part of the NSDS and AfP development priorities under Pillar 7 • SLIHS is a Multi-topic household survey-covering socio-economic facets • The SLIHS was conducted in 2003/04, the last SLIHS was conducted in 2011 • The data generated is being used to prepare a new development agenda

10. Update- 2018 SLIHS BACKGROUND 2/2 • 19 Teams-each comprising 1 Supervisor, 3 Enumerators and 1 Data Entry Clerk are have been deployed to carryout the data collection for12-cycle/month • 10 households are selected from each cluster and interviewed every cycle • A diary of daily consumption and expenditure is being used to support the interviews • The diary is completed four (4) times in a five-day interval period (20 days) • All data collected is captured in the field by the data entry clerks • SLIHS is collaborating with MICS, using shared EAs of 506 • SLIHS is funded by the Government and the World Bank

11. UPDATE-ACTIVITY • Training Enumerators & Supervisors was on 27 Nov-8 Dec, 2017 and selection Exams-8 Dec • Logistics Training for the selected teams was on 11-18 Dec • Deployment meeting was 28-30 Dec, 2017 • First Quarter data collection Jan-Mar, 2018 • First Data Quality Review meetings: April 4-10 • Second Quarter data collection Apr-Jun, 2018 • Stakeholder update meeting: May 31, 2018 • Third Quarter data collection: July-Sept, 2018 • We are now in the ninth cycle, data collection also started on 2 Sept • Food dairy is administered for 20 days (5 day interval) • The cycle lasts for a maximum of 22 days

12. UPDATE-REDEPLOYMENT OF FIELD TEAMS • Deployment field staff is being done at the end of every cycle in readiness for the commencement of the following cycle data collection • 15 teams are provided with vehicles for the redeployment from one cluster to the next. • For riverine areas, some amount to cover boat fare is being provided to field teams to cover the multiple crossing of the teams during data collection. • Made enough provision to cover multiple movement within the cluster

13. UPDATE-PUBLICITY • 2018 SLIHS publicity is being done at various levels including the use of the electronic media and one-to-one contact by the field staff. • Furthermore, we signed memorandum of understanding (MoU) with 19 radio stations all over the country to air SLIHS jingles in Krio and other local languages at least 5 days every month to raise the awareness level of the general public • Posts and banners printed and given to field teams • Posters and hand bills are given to every field staff every cycle/monthly to be displayed at the household level

14. UPDATE-MONITORING • Effective Monitoring is an important part of quality data collection process • We maintained the 4 levels of monitoring: • The first level is the work of the Supervisors, responsible for reviewing and editing all the questionnaires • The second level is the work of the Data Entry Clerks (DECs) who are responsible for inputting the data; and in the process raise quality control issues bordering on the use of codes and following the skip patterns.

15. UPDATE-MONITORING • The third level of monitoring of data collection is the work of the monitoring teams, which comprise: • The National Coordinator • 4 regional Coordinator • 3 Data Processing Support Staff • 13 District Statistician/Coordinators • Stats SL Management Staff • MDAs Officials • Stats SL Public Relation Officers • Stats SL Transport Officers • Monitoring of the data collection is carried out every month from the first day of data collection

16. UPDATE-PAYMENT OF ALLOWANCES AND HR ISSUES • Payment of allowances to field teams is being done every month through the banking system, • We are up-to-date with no arrears, although there are delays sometimes by the banks to credit accounts • Fuel is provided for bikes and generators at the current pump price of Le 8,000 • Consolidated allowance paid-increase to all field staff • Made changes/replacement so far of: • 3 Enumerators-1 in Team 11, 1 in Team 1 and 1 in team 19 • 1 DEC in Team 13 • 1 Resignation-Supervisor of Team 19 • 1 Promotion- Enumerator 193 to Supervisor 195 in Team 19

17. CYCLES AND HOUSEHOLD NUMBERS • Cycle 1-57 hhs 570 • Cycle 2-57 hhs 570 • Cycle 3-57 hhs 570 • Cycle 4-57 hhs 570 • Cycle 5-57 hhs 570 • Cycle 6-57 hhs 570 • Cycle 7-57 hhs 570 • Cycle 8-57 hhs 570 • Total 456 hhs 4560 • This means we are on target to achieving the 684 clusters and 6,840 hhs in 12 months

18. Sample achieved-update (Jan-Jun)

19. Sample achieved-update (Jan-Jun)

20. REMINDERS

21. Reminders-Survey Period and Books • Period of the survey-22 days-from 2nd -24th of the month • Supervisors should not hold on to the books up to the next cycle, thus preventing the DECs from doing their work • Submission-some teams are lagging behind, cycle 8 is still outstanding for some teams and books • Teams are still ignoring the food dairy, entering straight into Bk4, which is against the procedures • Enumerators sometimes leave behind the diary with the households-this has d

22. Reminders: The Food Item Diary • The diary keeps stock of the quantity and ‘market’ value of food and related items consumed daily by the HH • The diary will be completed each day for 20 days on a five-day interval basis • It is to be completed daily preferably by a member of the HH for the five-day period interval of 4

23. REMINDERS: Source of Errors and poor Responses • We have identified few sources of errors or nor responses: • Poor introduction of the survey-you fail to establish the right environment for the survey • Interviewers not asking questions the right way-e.g H3:did you go to the hospital in the last 2 or 4 weeks? • Not being skillful enough to crosscheck some responses with members of the hh like in the case of Section W: Livestock • Supervisors not staying in the field or supervising in the field-they are becoming book collectors • Supervisors doing edit corrections with the DECs only- • Enumerators being away from the field-causes rush with work • Interviewers not distributing the lights

24. Reminders: Time Periods – not properly being applied “Last 12 Months” : Starting from end of last completed month and going back. Day of interview July 28th (month is not complete) Last completed month: June 2018 Going back Last 12 Months from: July 2017 to June 2018 “Last Week” / “Last 7 days” : This is the last completed week/7 days. For example: If you are conducting an interview on Friday, August 5th, the “Last 7 days” refers to: • The days from Friday July 29 to Thursday August 4 • This is the last completed 7 days/week. Going back

25. Reminder: Section A: HH Roster-Relationship to the head 1/2 • Note: • Relationship of members of the household refers to the Head of the Household • Relationships here explore biological and legal/social relationships, and any other • Legal/Social Relationship to the Head • Spouse (must have the opposite sex) • step / adoptive child • brother/sister-in-law • Parent-in-law • son/daughter-in-law • Uncle/Anty-in-law • Cousin-in-law • maid / nanny / servant • Biological Relationship to the Head: • biological child • Grand child • brother/sister • niece/nephew • Parent • Uncle/Anty • Cousin • No Relationship to the Head • non-relative (eg. Friend, neighbour, community workers, servants, lodgers,etc..)

26. Reminder: Section A: HH Roster-Relationship to the head 2/2

27. Reminder: Section F: Women’s Reproductive Health Birth history must be consistent with the age of the woman as suggested in the table Birth History (F1-5)

28. Reminder: ISIC and ISCO Codes Before you write the codes Describe first the nature of the work or occupation Go through the codes and see the most suitable

29. Reminder: Level of Education and Age • Age is important is education so cross check age and level of qualification in B8 because we know that a 10 year old cannot be a university graduate

30. EVIDENCE FROM THE DATA

31. MICS 6 Matching List • MICS 6 has provided us with the household roster for each household interviewed in the 506 EAs • The list provided to you is to be used independently • However the composition of the household should not significantly be different • We have seen poor marching with MICS household member by some Teams/Enumerators

32. MICS 6 Matching List • Matching with MICS6 HHs is at 77%, which is very good • The worst matching was in Teams 7 (46.6%), 15 (43.7%), 16 (40%) • The best are Teams 10 (13%), 17 (18%), 13 (19.53%), 1 (19.54%), 2(19.7) 23%

33. Household Size • HH size: Team 1 interviewed the most single-member hhs than any of the other teams

34. Under fives Reporting • Team 7 and 13 Reported the highest number of under fives; Teams 2, 3 and 4 reported the least

35. Under fives Reporting • Great improvement in the under-fives reporting and compliant to theory, the best is Team 9

36. Under fives Reporting • the 2 second best Teams are Team 7 and 13:

37. Under fives Reporting • This is the least theory compliant: Team 1

38. Being Sick or Injured in the last 4 weeks • The responses are generally low; and the least reported cases are by Team 1, 8, 15 and 11

39. Being Pregnant or given birth to a child in the last 12 months • The reposes are between 12-35% of female 15-49 who answered yes...; the lowest responses are from Team 1, while Team 7 and 13 are the high performing ones

40. Economic Activities (ISIC) • Trade dominates in the pure urban areas, while Agriculture dominates in the pure rural areas

41. Economic Activities (ISIC) • There is a fair distribution of economic activities for teams covering both rural and urban areas

42. Owing Livestock • Team 3 interviewed no hh owing livestock, not even one chicken

43. Food Items Reporting • Team 5 reported the highest number of food items, and Enumerators 3 and 4 reported the highest number of food items; followed by Team 2, Enumerators 4 and 2, and Team 1,Enum 2

44. Food Items Reporting • Team 6 reported the least number of food items (Enum. 4), followed by Team 13 (Enum.2); Team 8 (Enum. 3); Team 7, Enum. 2) and Team 1 (Enum. 5)

45. General Perception • It is generally perceived that: • the main aim of those Enumerators and Teams found not doing the right thing in the field is to reduce workload and complete the survey questionnaires quickly • they don’t have the time to do the job • they maybe less knowledgeable to do the survey • they are less motivated for one reason or the other • they are under less supervision

46. AN ADVICE • Whatever the reason, the impact of a bad work done in the field is far reaching on the quality of the data collected and on the policy to be drawn from the exercise • So please let’s all be careful…….

47. The End Thank you