100 likes | 227 Views
What is convincing evidence? Naved Chowdhury & Enrique Mendizabal. Objective of the session: To arrive at a definition of CONVINCING evidence –what makes evidence stick in the mind of policymakers? What types of evidence have a high level of stickiness?. Definitions we often use.
E N D
What is convincing evidence?Naved Chowdhury & Enrique Mendizabal Objective of the session: To arrive at a definition of CONVINCING evidence –what makes evidence stick in the mind of policymakers? What types of evidence have a high level of stickiness?
Definitions we often use • Research: “any systematic effort to increase the stock of knowledge” • Policy:a “purposive course of action followed by an actor or set of actors” • Evidence: “the available information supporting or otherwise a belief or proposition” • Evidence-based Policy: “public policy informed by rigorously established evidence”.
Policy Makers’ Evidence Researchers’ Evidence Different Notions of Evidence • ‘Scientific’ (Context free) • Proven empirically • Theoretically driven • As long as it takes • Caveats and qualifications • Colloquial (Contextual) • Anything that seems reasonable • Policy relevant • Timely • Clear Message Source: Phil Davies Impact to Insight Meeting, ODI, 2005
Components of robust evidence & analysis (supply side) • Is the evidence credible? • Can we make generalisations from it? • Is it reliable enough for M&E or impact assessments? • Is it objective? How do we account for bias? • Is it rooted in an understanding of the framing assumptions?
Components of robust evidence & analysis (demand side) • Is the evidence policy relevant? • Is it timely? Has it been delivered fast enough to inform policy decisions? • Is it accessible to all key stakeholders, not just researchers? • Is the evidence cost-effective? • Is it interdisciplinary enough to address cross-cutting issues?
How is Evidence used by CSOs? • Regardless, evidence is used in various stages of the policy process: • Agenda Setting • Influencing policy formulation • Influencing policy implementation • Influencing the monitoring and evaluation of policy
GROUP WORK 1 • What are the Characteristics of Convincing Evidence? • What characteristics are more important? • Some characteristics could be: • Quality: rigour • Objectivity: not biased • Relevance: timing and planning • Credibility: depends on who produces it • Practicality: have practical use • Accuracy: the right solution for the problem
GROUP WORK 1 • Individually think about (up to) 5 characteristics of convincing evidence • In groups discuss and identify (up to) 10 characteristics of convincing evidence • In plenary, arrive at a definitive list • In plenary, rank the list in order of importance or stickiness
GROUP WORK 2 • What different types of evidence exist? • What are their characteristics? • Some examples of type of evidence are: • Surveys • Pilot projects • Impact assessments • Policy Analyses • Statistical Analysis • Qualitative Appraisal • Observations • Photographs and oral evidence
GROUP WORK 2 • Individually, think about (up to) 5 types of evidence • In groups, discuss and arrive at (up to) 10 types • In plenary, arrive at a definitive list • In plenary, identify their characteristics