Multiple Indicator Cluster Surveys Survey Design Workshop

1. Multiple Indicator Cluster SurveysSurvey Design Workshop Data Analysis and Reporting MICS Survey Design Workshop

2. Purpose • Provide an overview of the MICS process in analyzing data • Provide an overview of the preparation of the Summary Findings and the Final Report

3. Process for report preparation • Data entry and processing programs will be covered in second workshop • Standard set of MICS tabulations and guidelines will be provided • Standard guidelines and templates for Summary Findings and Final Report will be provided

4. Process for report preparation • Technical support for data analysis and report writing will be through UNICEF regional consultants • Once a draft final report is produced, a review process is initiated with the Regional and Global MICS Team

5. Before producing tabulations and writing reports • Carry out basic checks of data quality (non-sampling errors) using the Data Quality Tables • Calculate response rates • Response rates lower than 90% suggest results may be biased

6. Before producing tabulations and writing reports (continued) • Check for variables with large numbers of Missing. • Make sure it is not a problem with data entry or editing • Any variable with 10% or more missing values, use with caution; if very high, do not use at all

7. Before producing tabulations and writing reports (continued) • Check for variables with large numbers of “Don’t know” or “Other” answers. • Large numbers of DKs can indicate difficulty understanding the questions • High proportions of “Other” indicates questionnaire did not account for most common responses

8. Before producing tabulations and writing reports (continued) • Check for expected patterns in the data. • Unexpected patterns may result from • faulty sample design, • improper implementation of the sample, • interviewer errors, or • respondents’ inaccurate answers.

9. Before producing tabulations and writing reports (continued) • Decide on basic background variables and their groupings • - Geographic areas, urban/rural residence, level of education, male/female, wealth quintiles, religion of household head, etc. • Calculate the wealth index

11. Producing final tables • Use tabulation plan • Check unweighted number of observations for displaying results • Cells based on very small numbers of cases are not reliable and should not be shown; results based on fewer than 25 unweighted cases should not be shown, 25-49 unweighted cases should be shown within parentheses (caution)

13. The MICS Report Templates There are two templates available in MICS which can be customized by countries depending on the content of the survey: • Summary Findings Report • Final Report Templates are/will be available in English, French, Arabic, Russian and Spanish.

14. MICS Report Templates

15. Why use the MICS templates? • To facilitate the efficient production of MICS reports so countries do not have to “reinvent the wheel” and spend time on the design of tables, indicator explanations etc. • To ensure the production of comparable reports that can be used easily to draw comparisons between countries. • To increase confidence among users in the survey; MICS is a recognised household survey programme with an internationally accepted methodology

16. The Summary Findings Report • A very short and visual report that does not need a lot of text/writing. • The tables and topics included in the report are a subset of the final report • Quick results on critical indicators such as mortality and malnutrition to allow for possible programme response as soon as possible. • Will buy time while working on the final report • See childinfo.org for examples

17. Describing findings • Make sure that data quality is taken into account during report writing • When comparing findings to previous results or between groups, make sure that sampling errors are taking into account

18. Content of the Final Report Template

19. The Final Report • To convey the results of the survey to a wide audience which includes government agencies, non-governmental organizations, other multilateral donors, the press, and the general public • The report describes the current situation of children and women taken from all indicator results included in the survey. It also includes detailed information on survey methodology and implementation. • See childinfo.org for examples

21. Who should write the Final Report? • Once tables are generated and finalized it should be quite straight forward to write the report. • Typically it is the MICS implementing agency and/or members of a stakeholder/technical committee who write the report. Chapters can be divided among different people. It is useful to have people familiar with subject matter. • Experts in various fields should be consulted and asked to review the tables in order that the key messages and any unusual findings are addressed and dealt with properly in the report and that technical terminology is appropriately used.

22. Report Writing • Will partly be covered during the 3rdMICS Workshop: Data Dissemination and Further Analysis • However, the writing process should begin earlier. The survey teams should not wait for attending the workshop to start preparing the reports • See childinfo.org for MICS4 3rd workshop presentation files

23. Dissemination of Findings • There will be a separate workshop session • 3rd MICS Workshop: Data Dissemination and Further Analysis • National seminar, distribution of findings, other dissemination activities

24. Further Analysis of the Data • MICS data can be used for statistical analysis beyond that contained in the survey report • The data collected should be exploited as fully as possible • 3rd MICS Workshop: Data Dissemination and Further Analysis • Potential topics for further analysis: • Analysis of data quality, Analysis of trends • Identification of “most vulnerable” groups • Multivariate analyses of determinants of child health or schooling outcomes