WHO/UNICEF Joint Monitoring Programme for Water Supply and Sanitation (JMP)

1. Comparing national and international monitoring of the MDG drinking water and sanitation target Rolf Luyendijk,UNICEF UNSD/UN-ESCWA Workshop Bayrouth, Lebanon, 7-10 December, 2009 WHO/UNICEFJoint Monitoring Programmefor Water Supply and Sanitation (JMP)

2. UNICEF and MDG monitoring

3. This presentation: Monitoring the drinking water and sanitation MDG 1.Introduction 2. Definitions 3. Data sources 4. JMP Methodology 5.Experiences and challenges in comparing national and international monitoring

4. WHO/UNICEF Joint Monitoring Program (JMP) • Established in 1990 • Secretariat: • UNICEF & World Health Organization

5. Scope of work of the JMP Monitor trends and progress within the water supply and sanitation sector Advocate for action at all levels Build national capacity for monitoring

6. WHO-UNICEF Joint Monitoring Program (JMP) • Responsible for monitoring progress towards MDG 7 Target 7c • Global accountability • Advocacy • 1.5 million children under five die of diarrhoeal disease (88% WASH related) • Almost 1 billion without drinking water • 2.5 billion without sanitation • 1.2 billion people practising open defecation

7. 50% or less 51% - 75% 76% - 90% 91% - 100% No or insufficient data Sanitation in the Arab States: Sanitation coverage, 2006 WHO/UNICEF JMP, 2008

8. 36 million people in the Arab States still practise open defecation, 2006 Yemen: 7.7 million Sudan: 13.9 million Somalia: 4.5 million Morocco: 4.3 million

9. Since 1990, the population without access to an improved drinking water source in the Arab States increased in both urban and rural areas 1990 2006

10. Data sources on access to water supply and sanitation • 1980 – 1997 Reported data from Governments • 1997 – data from household surveys and censuses • JMP data sources are primary sources: • National household sample surveys (DHS, MICS, LSMS, CWIQ, WHS, HBS, H&N, RHS, PAPFAM etc) • National censuses • Note: JMP is not involved in primary data collection

11. Coverage distribution Reported data Survey data

12. Use of “user-based” household surveys and censuses instead of “provider-based” data • Standardized definitions among surveys • Objective “snapshot” of the situation • Nett picture of new facilities constructed and those fallen in disrepair • Avoid double counting of upgraded improved facilities (e.g. hand pump to piped house connection) • Allows for analyses • Disaggregated into wealth quintiles • Comparable across countries • Monitor trends over time • Etc.

13. JMP – data base (2008) • Data for +/- 170 countries • 850+ results of HH surveys + Censuses from 1985 – 2008 • Bulk of surveys for LDCs, SSA, larger developing countries • 30 - 35 new survey results per year • Frequency for most developing countries one survey every three years

14. MDG target + Indicators MDG 7, Target 7C: • Halve, by 2015, the proportion of people without sustainable access to safe drinking water and basic sanitation Indicators (based on information collected): • Proportion of population that uses an improved drinking water source, urban and rural • Proportion of population that uses an improved sanitation facility, urban and rural

15. “Improved” means…. An ‘improved’ drinking water source is: “a source that by the nature of its construction adequately protects the source from outside contamination in particular with fecal matter” An ‘improved’ sanitation facility: “ a facility that hygienically separates human waste from human contact”

16. JMP definitions of improved/unimproved Drinking Water Sanitation • Piped into dwelling, plot or yard • Public tap/standpipe • Tube well/borehole • Protected dug well • Protected spring • Rainwater collection • Flush/pour flush to: • piped sewer system • septic tank • pit latrine • Ventilated improved pit (VIP) latrine • Pit latrine with slab • Composting toilet IMPROVED • Unprotected dug well • Unprotected spring • Cart with small tank/drum • Tanker truck • Surface water (river, dam, lake, pond, stream, canal, irrigation canal)‏ • Bottled water • Flush/Pour flush to elsewhere • Pit latrine without slab/open pit • Bucket • Hanging toilet/hanging latrine • Shared sanitation of any type • No facilities, bush or field UN-IMPROVED

17. Core question on water and sanitation for household surveys - What is measured? • What is the main source of drinking water for members of your household? • What kind of toilet facility do members of your household usually use? • http://www.wssinfo.org/pdf/WHO_2008_Core_Questions.pdf • Standard set of only eight questions used by DHS and MICS • Detailed descriptions and definitions of technologies • Indicator tabulation plans

18. Monitoring MDG drinking water and sanitation targets • A country’s responsibility • At global level: WHO/UNICEF JMP • Challenges: • Track progress over time • Ensure comparability over time • Track progress towards the MDG target vs. baseline year 1990 • Ensure comparability of data among countries (JMP specific challenge)

19. JMP methodology • Compile data • Check validity of the survey • Ensure comparability of data with: • “Improved” facilities • House connections • Open defecation • Plot survey and census data on time-line • Use linear regression for estimates = Modeled!

20. Latest data point DHS 2002 :51% Hallo

21. Estimates Coverage 2004 = 50% Latest data point DHS 2002 :51% Hallo

22. Estimates Coverage 2004 = 54% Added Fictive data point 2005 :58% Hallo

23. Estimates Coverage 2004 = 50% = 54% 2006 = 57% Added Fictive data point 2005 :58% Hallo

24. Estimated Coverage 2004 = 50% = 54%= 54% 2006 = 57% = 59% 2008 = 63% Added Fictive data point 2008 :65% Hallo

25. Experiences and challenges with water and sanitation data interpretation • Surveys and Census data are incomparable • Poor disaggregation • Inconsistency on use of definitions of access • National definitions not consistent between NSO/CBS and line-ministries

26. Examples of data interpretation

27. Examples of data interpretation

28. Examples of data interpretation

29. Examples of data interpretation

30. Insufficient disaggregation

32. Most common discrepancies between national and international coverage estimates(in order of most frequent occurrence) 1.Use of different definitions of access or poorly defined categories 2.Use of latest survey or census data instead of a computed estimate 3.Use of different population estimates 4.Use of old estimates, instead of latest available data 5.Use of reported (provider-based) data rather than household survey or census data

33. JMP Challenges ahead (1) Global and National • 2007 – 2010: regional and country workshops, comparing UN - with national coverage estimates and MDG monitoring to exchange experiences for mutual learning and understanding • Facilitate the development and roll-out of standard protocols for water quality monitoring

34. Challenges ahead (2) Methodological Challenges • Continue to develop and validate tools and instruments to measure: • Sustainable access • Safe drinking water – water quality • Access to basic sanitation • Appropriate hygiene - and hand washing behaviour • Disparities (pro-poor focus) • Access in peri-urban and urban slum areas • Disaggregate urban data between cities and small towns Challenges for wider sector monitoring • Strengthen sub-national monitoring • Invest in sector monitoring of the enabling environment • E.g. policies, HR capacity, financing mechanisms and investments, sustainable operation & maintenance, decentralization of authority, quality management etc.

35. MDG drinking water and sanitation monitoring challenges at national level • Agree on the use and measurement of standard definitions of access between NSO & line ministries • Harmonize data collection mechanisms • Use of same questions and response categories among surveys and censuses • Set “own” MDG drinking water and sanitation target • Link access data to water quality surveillance information

36. JMP Website: www.wssinfo.org • JMP country files • Four graphs with regressions line • All HHS + census data per country • Regional and global coverage estimates • Core questions on WSS for household surveys • Standard indicators • Definitions of service categories • Etc.

37. Thank you !