680 likes | 718 Views
Frameworks. 1 March 2011. Session Outline. Introduction to frameworks Conceptual frameworks Results Frameworks Logical Framework Hands on activity: developing frameworks. -- Why frameworks. Designing M&E Frameworks assists in the development of
E N D
Frameworks 1 March 2011
Session Outline • Introduction to frameworks • Conceptual frameworks • Results Frameworks • Logical Framework • Hands on activity: developing frameworks
-- Why frameworks Designing M&E Frameworks assists in the development of • Clearly understood program/project goals and measurable, long-term, short-term, and intermediate objectives • Clearly defined relationships between program/project inputs, processes, outputs, and outcomes, • Understanding between program/project activities and the external context (environmental factors) • Sound implementation of programs • Design sound M&E plans
Characteristics of frameworks • All types of M&E frameworks: • Inter-relate components, levels and directions of action • Enable understanding of how • programs influence health outcomes (conceptual framework) • programs should operate (logical framework) • Programs achieve goals (results) • Facilitate consensus building around a common paradigm
Types of frameworks • Different origins • Many types: • Conceptual • Results • Logical & Logic model • Specific types • Results Based Management framework
Learning Objectives: Conceptual Framework • At the end of this session, participants will be able to: • Understand why and how conceptual frameworks are useful for understanding programs and planning M&E • Describe the role of conceptual frameworks in program design, program evaluation, and evaluation research. • Describe the components of conceptual frameworks • Design a conceptual framework to be most useful for M&E planning • Design a conceptual framework for an intervention program
Conceptual framework • Research framework
Group work- 1 • Why did we have political revolt in Egypt • Why do we have poverty in province B • Why do we have crime in City Z • Why do we have famine in Country X • How come we have street abortion in South Africa • Why do we have teenage pregnancy in Community B • How come Spain won the FIFA soccer world cup • How come China has a booming economy • How come the people of Thailand are so hospitable • How did Uganda manage to control an epidemic
What is happening • World • Society/community • Workplace • hospital
When we conceptualise • Definitions • What is the meaning of the word or term or idea • What is the actual use of the word • What are the boundaries within which a term operates • What are the contrary examples of the word
Concepts • Enable interpretation of a subject • Analyse complex subject matter • Synthesize separate pieces of a subject matter into a unit • Perceive similarities and differences • Enable us to make value judgments • Extend our knowledge
In program design/programming • What do you need to know • Why do have to know
M&E CONCEPTUAL FRAMEWORKS Conceptual, or “research”, frameworks are diagrams that identify and illustrate the relationships among all relevant systemic, organizational, individual, or other salient factors that may influence program/project operation and the successful achievement of program or project goals.
Purpose of conceptual frameworks • Provides a perspective for understanding program objectives within a complete context of relevant factors in a program’s operating environment • Clarifies analytical assumptions and their implications for program possibilities or limitations on success, as well as measuring and analyzing that degree of success
Purpose of Conceptual Framework:cont. • Makes explicit connections among relevant contextual (environmental) factors and your program • Helps to clarify the “why” and “how” questions of program operation and design: • Assumptions that underlie the chosen activities • Factors the activities are expected to affect • Causal linkages leading to achievement of program objectives • Guides identification of appropriate indicators • Guides impact analysis
Individual characteristics Healthstatus Healthypractices Serviceutilization Institutionalcapacity Programsustainability Program supply Technicalinputs Conceptual Frameworks
Proximate Determinants Model for HIV/STI(Boerma and Weir) Health Outcome Demog. Outcome Underlying Proximate Biological Context Sociocultural Socioeconomic Programmatic Interventions VCT STD control Condom promote IEC Partner acquis. Mixing patterns Concurrency Exposure to infected HIV incidence Health Impacts: Morbidity Mortality Condom use Concurrent STI Risky sex Treatment Efficacy of Transmission Per contact STI incidence Duration of activity Treatment Socioeconomic Impacts:Socio-Economic Decline (household and national) -Orphans and Vulnerable Children
Research • Concepts –connotations-defines the problem and constructs for measurement • Operationalise-denotations- variables • Framework allows integration of the program(research) with existing knowledge ( accepted thinking) of the problem. Concepts are identified and linked to one another
Research cont.. • Research starts from this conceptual or theoretical framework • Basis to Formulate our hypothesis • Expresses Assumptions • Testing/Falsification • This is the basis of deductive approach in research
Trying it out!! • Identify the problem ( concepts) • Define drivers of the problem • Define elements of your program( concepts) • Identify factors(concepts) in your environment • identify individual factors(concepts) • Establish relationship between the factors • Simplify and refine diagram • Create and present your framework
summary • To show where program fits into wider context • To clarify assumptions about causal relationships • To show how program components will operate to influence outcomes • To guide identification of indicators • To guide impact analysis (causal pathways)
Activity • Get into your project/program groups • Develop a conceptual framework for your intervention • After 45 minutes, a member of each group will share the framework with all participants
What are strategies • What are results
Revisit your conceptual framework • What is your vision? • What is your mission? • Where are your strengths?
M&E STRATEGIC (RESULTS)FRAMEWORKS Strategic/Results frameworks are diagrams that identify steps, or levels, of results, and illustrate the causal relationships linking all levels of a program’s objectives.
Purposes: • Provides a clarified focus on the causal relationships that connect incremental achievement of results to the comprehensive program impact • Clarifies project/program mechanics and factors’ relationships that suggest ways and means of objectively measuring the achievement of desired ends
Strategic framework • Results framework • Diagrams • Summary of results • They identify and illustrate the causal relationships linking all levels of program strategy. • Objectives to impacts
Results Frameworks • Presents program strategy for achieving specific objective • Usually presented as diagram, • Includes objective and intermediate results • Includes assumptions behind hypothesis (why the program/strategy is expected to work) • Both a planning and management tool
Goals and Objectives • Goal: • A broad statement of a desired, long-term outcome of the program • Objectives: • statements of desired, specific, realistic and and measurable program results Source: GAP 2003
Results Framework Example – PEPFAR funded ART Program SO: Utilization of ART services IR-1: Availability of quality services IR-2: Demandfor services IR-1.1: Increase ART sites IR-2.1: Increase knowledge of ART IR-1.2: Supply sites with ARVs IR-2.2: Increase referral from VCT IR-1.3: Training for providers
Results Frameworks: Key Elements • Goal • Strategic Objective • Should be appropriate & realistic • Balance ambition and accountability • Intermediate Results • Smaller goals • Integral to achieving SO • Hypothesized cause-effect (based on conceptual theory) linkages • Flow from one intermediate result or to many • Move “up” in the results framework • Critical assumptions • Relative to the achievement of the SO • General condition which holds true for SO to be achieved • Be realistic!
Results Frameworks: National TB Program SO1: Increase tuberculosis case detection rate to 70% IR1: Increased availabilityof quality services IR2: Increased demand for quality services IR2.1: Customerknowledge of TB improved IR1.1: Services increased IR1.2: Practitioners’ skillsand knowledge increased IR2.2: Social support for TB practices increased IR1.3: Improved program management Source: MEASURE Evaluation, 2004 (draft)
Results Frameworks FIVE-YEAR GOAL: Foundation Established for Reducing Famine Vulnerability, Hunger and Poverty SO 14: Human capacity and social resiliency increased IR 14.1: Use of high impact health, family planning, and nutrition services, products, and practices increased IR 14.2: HIV/AIDS prevalence reduced and mitigation of the impact of HIV/AIDS increased IR 14.3: Use of quality primary education services enhanced IR 14.3.1: Community participation in the management and delivery of primary education services strengthened IR 14.2.1: Reduced risk behavior IR 14.1.1: Community support for high impact health interventions increased IR 14.2.2: Mother-to-child transmission of HIV reduced IR 14.1.2: Availability of key health services and products improved IR 14.3.2: Planning, mgmt and monitoring and evaluation for delivery of primary education services strengthened IR 14.2.3: Access to care and treatment for people living with HIV and AIDS increased IR 14.1.3: Quality of key health services improved IR 14.3.3: Quality of primary education improved IR 14.2.4: Care and support for orphans and vulnerable children expanded IR 14.1.4: Health sector resources and systems improved IR 14.3.4: Equitable primary education services strengthened IR 14.2.5: A more supportive environment for responding to HIV/AIDS Source: USAID/Ethiopia Integrated Strategic Plan, February, 2004 (revised draft)
Results Frameworks: basis for programmatic process • Agreement within operating unit and donor expectations • Selecting appropriate indicators for the M&E system • Use performance information for management decisions • Analyzing and reporting on program results
Building a Results Framework • Group work • Using your conceptual framework as a basis • Discuss and draw a strategic framework for your program • After 45 minutes, a member of each group will share the framework with all participants