130 likes | 226 Views
Thinking Evaluation in( Situ ) Action: From theory to program changes. Elizabeth Moreira dos Santos National School of Public Health (ENSP/FIOCRUZ), Brazil. Rio de Janeiro, March, 2009. Thanks... Thanks...THANKS !. LASER/DENSP ENSP/FIOCRUZ PN DST/HIV/AIDS CDC-GAP/Brasil
E N D
Thinking Evaluation in(Situ) Action: From theory to program changes Elizabeth Moreira dos Santos National School of Public Health (ENSP/FIOCRUZ), Brazil Rio de Janeiro, March, 2009
Thanks... Thanks...THANKS ! LASER/DENSP ENSP/FIOCRUZ PN DST/HIV/AIDS CDC-GAP/Brasil Guests and participants
Overview Capturing the atmosphere Naming the seminar Framing: questions, focus and dilemmas Realist expectations
Capturing the atmosphere: Guests and Participants Universities and Research Institutions National HIV/AIDS Programs MoH representatives Civil Society Representatives National Regulatory Institutions Graduate Students
Capturing the atmosphere: Thinking Evaluation Advanced and international seminars provide for refreshment and instigate discussion around controversies in the field. Moreover, they account for renewing and establishing new connections which are crucial for collaboration
Naming the seminar: an agony • From theory to practice: to know, to do and to interact (connect ?) • Program-driven theory and evaluationscience (systematic inquiry) • M&E can advance knowledge about social problems and their solutions (support action) • Embracing diversity (higher-order framework versus the benefits of competing theories and approaches)
Framing questions and focus (Weiss, 1998 p.273) Implementation Evaluation: Outcome Evaluation: Finding out what works and setting standards Questions: What went on in the program over time? How closely did the program follow its plan? Did program recipients improved? Did recipients do better than nonrecipients?
Framing questions and focus(Weiss, 1998 p.273) Impact Evaluation Finding out what works and setting standards Questions: Is the observed change due to the program? What characteristics are associated with success and failure? Through what processes did change take place over time? What was the worth of the relative improvement of recipients ?
Framing questions and focus(Weiss, 1998 p.273) Critical review Connections to utilization Questions: What unexpected events and outcomes were observed? What are the limits to the findings? What do these findings mean in practical terms? What recommendations do the findings imply for modifications in program and policy? What new program and policies do the findings support?
Framing debates and dilemmas Social inquiry and the paradigms: positivism, constructivism and pragmatism Pluralism What works? Which debate? What constitute credible evidence in evaluation? Embracing diversity ? (higher-order framework versus the benefits of competing theories and approaches) Whose perspectives? How much users should be involved?
Realist Expectations • Communities of practices are strategic to guarantee sustainability of collaborative initiatives. A skilled evaluator cannot work without the needed expertise and technology.In this, they become dependent on one another in a process of mutual adaptation and identification.
Gracias! Obrigado! Thank you! bmoreira@ensp.fiocruz.br