Workshop on MDG Monitoring 5-8 May 2008, Kampala, Uganda

1. Production and Use of Administrative Data and Sub National Level Data for MDG Monitoring in Africa: Challenges and Opportunities Workshop on MDG Monitoring 5-8 May 2008, Kampala, Uganda Dimitri Sanga, Ph.D. Senior Statistician

2. Outline • Background • Data Sources for MDG Monitoring • Use of Administrative Data Sources for MDG Monitoring • The Need for MDG Data at the Sub National Level • The Way Forward

3. Background 3

4. MDG Monitoring Monitoring and evaluation of progress made towards the achievement of the MDGs is data intensive They require data from various sources produced using different tools The choice of the source depends on the availability of the data and the indicator 4

5. Data sources for MDG monitoring The main sources of data for MDG monitoring include: Household surveys Censuses Administrative records: Health, education statistics Civil and vital registration systems: birth, deaths, marriages, divorces… 5

6. Data sources for MDG monitoring (2) Different indicators require different type of data Sometimes, multiple types of data could shed light on a single MDG indicator Thus, the need for making a choice of data source 6

7. Example 1: Mortality Data on mortality (infant, child and maternal) can be obtained from: Vital registration systems Household sample surveys In most developing countries: Registration of births and deaths is incomplete Underestimation of mortality rates Household sample surveys are the commonly-used data source to estimate mortality Since mortality is a relatively rare event: need for large surveys to capture enough deaths to obtain reliable estimates of mortality 7

8. Example 2: Education Many countries use administrative data (data from school registers) to calculate primary or secondary enrollment rates Enrollment rates based on administrative data overstate those based on HS: Administrative data report on the number of children enrolled at the beginning of the school year HS data typically report school attendance data (Does your child currently attend school?) 8

9. Advantages of administrative data sources Reduction of response burden as the NSO would have access to the data provided by the system Provide data on small areas and targeted population groups Coverage at relatively low cost as compared to other sources Possibility to link with other data sources and to produce new type of data and statistics 9

10. Use of Administrative Data Sources for MDG Monitoring 10

11. Administrative data Data produced in countries on the basis of some administrative processes Compiled in the course of routine operations of government ministries and institutions Units and variables defined according to : Administrative acts Rules Regulations Definitions adopted in the administrative data may differ from the needs of the official statistics 11

12. Vital and civil registration systems Vital and civil registration systems (VCRS): Record the occurrence and characteristics of vital events: birth, death and causes of death, marriage, etc. Based on laws, regulations and other legal requirements If complete, VCRS are source of reliable continuous flow of vital statistics 12

13. Vital and civil registration systems (2) VCRS provide accurate measures of vital events and population change over the time VCRS have to be complete and accurate to provide accurate and reliable data as alternative to censuses and surveys 13

14. Vital and civil registration systems in Africa (3) In most African countries VCRS are under developed Problems hampering their development include: Infrastructure Organization and management of the registration process Capacity constraints Legal framework 14

15. Example 1: Deaths coverage* Deaths coverage in SSA is much below average Concentration of the system in urban areas explains partially this low coverage *Report on the WHO workshop on Minimum data Set on Ageing in Sub Saharan Africa, 2003 Rates computed using WHO life tables estimates for deaths at national level as denominators 15

16. Example 2: Births registration* Birth registration coverage is below 50% in many countries Some exceptions: birth registration coverage of over 90% (Mauritius, Egypt, Libya, Tunisia…) *UNICEF, Deficient Birth Registration Systems in Developing Countries, Population Development Review, Vol. 24, No 3, 1998 16

17. Some good practices: South Africa Launch of a joint vital registration infrastructure initiative Collaboration: Department of Health Department of Home Affairs StatsSA Significantly improved coverage of all births and deaths 17

18. Some good practices: Mauritius One of the well developed civil and vital registration systems in Africa Civil Status Division: collection of vital statistics and transmission to the NSO Entirely computerized system with a civil status database Complete coverage of vital events 18

19. Some good practices: Other countries Some countries with high coverage and completeness of birth and death registration: Tunisia and Egypt Countries developing their civil and vital registration systems: Sudan Ethiopia Botswana 19

20. Challenges of using administrative data sources Availability of data limited only to variables covered by registers Some restrictions on definitions of units and variables Vulnerability to changes in legislation and administrative practices Data are usually compiled by people who lack skills in handling data Provide information on the sections of the population accessing some facilities and not on those without access 20

21. Challenges of using administrative data sources (2) Numbers may be inflated in some areas Primary purpose is NOT data collection Data are collected by different authorities using their own definitions, classifications, methodologies and time frames Institutional constraints: inadequate support in terms of funds, equipment, personnel and skills 21

22. Opportunities offered by the use of administrative data sources Opportunities include: Improvement in Management Information Systems (MIS) adopted by many sectors especially health and education Advances in ICT that enable data capture, processing, archiving, transfer… Enhanced collaboration between line ministries and the NSO 22

23. Administrative data Enable the possibility to reduce the burden on respondent Provide better and more detailed picture of the society Require a good knowledge of their content for proper use for statistical purposes Some pre requisites for further development of register-based statistics include: Strong legal bases Clear and effective confidentiality rules Awareness of every employee Public trust 23

24. The Need for Sub National Data for MDG Monitoring 24

25. MDGs monitoring: at which level? Reporting and monitoring MDGs at the national level is a good start The Millennium Declaration is about improving the conditions of people in member states There is a need to monitor MDGs at the sub-national level But this is feasible only if data at lower levels are readily available 25

26. Advantages Data at lower levels of disaggregation: Allow for targeted socioeconomic policy decision-making and programme formulation Allow planners and policy makers to be able to identify: That some locales require more support for educational programmes Others require disproportionate investment in HIV treatment or malaria abatement 26

27. The MDG Mapper A tool developed by the UNECA for dynamic mapping of comparative progress by African countries towards achieving the MDGs Uses the official UNSD database Tool presents countries that have: Required trend to meet the goals Current trend Progress at current rates: on/off target ? Assessment made at national level and sub national where data exists 27

28. The Mapper at the national level Net enrolment rates in primary education, both sexes A Map will be inserted here! 28

29. The Mapper at the sub national level A Map will be inserted here! http://geoinfo.uneca.org/mdg/ 29

30. National vs Sub National Storylines Incidence of poverty in Ghana by area Source: Ghana Statistical Services, 2007. Poverty line: 2,884.7 new cedis per year 30

31. Increasing needs for data at the sub national level Policy makers who have participated in training on the use of the Mapper: Recognized the importance of such a tool for policy decision making: e.g. on which indicator the country should concentrate (off target?) Insisted on the need to use such a tool at the sub national level: variability across states, regions, provinces, districts Global (national) trends hide variability at state, region, province… levels Therefore, the need to make available sub national data and use them with the Mapper 31

32. Some good practices Ethiopia and Ghana: sub national data used for the MDG presentation at the ECOSOC meeting in Geneva Other countries: South Africa Zambia 32

33. Challenges Most administrative data (Health, Education, Access to Water, Sanitation…) and Census data can be disaggregated at lower levels For data from a HS, the survey needs to be large enough to yield reliable estimates at lower levels Increased cost of obtaining the information both in terms of human and financial resources For this reason: few HS provide data at the sub national level 33

34. Opportunities Opportunities include: Increased demand for data at lower levels Geographical Information Systems (GIS) technology (poverty mapping) Collaboration between Central Statistical Offices and sub national statistical institutions 34

35. Conclusions Sub national data disaggregation needs adequate sample sizes in HSs Disaggregation to sub national levels needs corresponding responsibilities Need to use MDG process to support strengthening of disaggregation opportunities 35

36. The Way Forward 36

37. Administrative data Assessment of the use of administrative data by African countries: challenges, constraints Organize workshops and expert group meetings on the use of administrative data in African countries Capacity building in terms of training and technical support 37

38. Sub national data production Organization of a seminar of the need for the production of sub national information for MDG monitoring: end of June 2008 Paris21 task team on the production of sub national data 38

39. Thank you! African Centre for Statistics Visit us at http://www.uneca.org/statistics