170 likes | 265 Views
Mekong Institute & UNESCO Regional Office-Bangkok. Training Course on “ Training of Trainers from the Greater Mekong Sub-Region on Decentralized Education Planning in the Context of Public Sector Management Reform ”. Issues, challenges in using the internationally comparative data.
E N D
Mekong Institute & UNESCO Regional Office-Bangkok Training Course on “Training of Trainers from the Greater Mekong Sub-Region on Decentralized Education Planning in the Context of Public Sector Management Reform” Issues, challenges in using the internationally comparative data 23 February – 6 March 2009; KhonKaen, Thailand Module E4 Prepared by the Education Policy and Reform Unit UNESCO Bangkok February 2009
Session 3 • What are the issues, challenges in using the internationally comparative data at the country level and how to resolve them?
Issues on Collecting, Using the Internationally Comparative Data (1) • Comparability (Definitional issue) • Use of population data • Level of disaggregation • Availability of statistics • Multiple sources • Usefulness and way to interpret
Issues on Collecting, Using the Internationally Comparative Data (2) • Comparability (Definitional issue) • National definition vs. International definition • Theoretical definition vs. Operational definition • Different conceptual definitions
Issues on Collecting, Using the Internationally Comparative Data (3) • Use of population data • National estimates vs. UN estimates • Different sources at the national level • Different sources at the regional and global levels
Issues on Collecting, Using the Internationally Comparative Data (4) • Level of disaggregation • Availability of data by disaggregating • Geographical break-down • Other social-economic break-down
Issues on Collecting, Using the Internationally Comparative Data (5) • Availability of statistics • Which indicators are available at the which level • Regional average • Global figures • Estimating methodology (Treating missing values)
Issues on Collecting, Using the Internationally Comparative Data (6) • Multiple sources • Different sources at the national level • Different sources at the regional and global levels • Population • Education Indicators • Surveys vs. EMIS
Issues on Collecting, Using the Internationally Comparative Data (7) • Usefulness and way to interpret • Unit of analysis • Purpose (monitoring vs planning) • Ranking among the countries • Index • Political agenda
Issues on Collecting, Using the Internationally Comparative Data (8) How are we resolving?
Be Transparent about Differences between National and International Indicators • How: • Better coordination with relevant agencies • A systematic ISCED mapping • Identification of data gaps • technical guidelines • Clear and transparent on how and sources of data for producing indicators Problem:Differences between national and international indicators create confusion: ISCED & population estimates Solution:Greater transparency, accurate documentation and communication of the differences
Integrate Evidence from a Range of Data Sources • How: • Development of standard monitoring indicators • Harmonizing definitions to support collection and use of survey-based data, e.g.. NSO household surveys • Improvement on meta data Problem:the widening range of indicators and data sources that are available but not comparable Solution:Harmonization of measurement concepts and maintaining standards across different data sources
Diagnose/Follow up Infrastructure and Technical Capacity Problems • How: • Diagnosing systems (DQAF) to identify problems in data production cycles • Capacity building • Exploiting Information technology Problem:Weak/ineffective information system or no reliable national information (particularly -post-conflict countries & emergencies) Solution:Wide range of partnerships. Strategic interventions in chain of data production. Donors: funding and raising the importance of statistics
Support Culture of Data Use • How: • Evidence-based planning • Capacity building • Creating and pressuring demand (global development agenda: EFA, MDG, PRSP, MEA) Problem: lack of demand-driven services, use of statistics; low analytical capacity; low investments in statistics Solution: Stimulate demand and supply for reliable data:
Narrow the Data Relevance Gap –(identify issues – develop concepts) • How: • Involving stake-holders in questionnaire redesign • Allowing for context- & regionally-specific indicators • E.g. Global & Regional EFA Working Groups • E.g. GMR, MDA, • Capacity building • Problem:Indicators do not address key policy issues • Solution:Improving existing and developing new indicators through: • inter-Governmental consultations • technical advice and approbation process
Narrow the Data Timeliness Gap - (identify blockages – improve production cycle) • How: • Evidence-based planning • Aligning data collection to national production cycles • Full utilization of information technology • Capacity building and effective resource management • Problem:Data do not capture recent changes in policy • Solution:improve timely collection and reporting: • Donors’ pressure for data use in planning • Review system of data collection and reporting