Monitoring & E valuation Intermediate - Introduction

Monitoring & EvaluationIntermediate - Introduction Section 1 Review of M&E Elementary Introduction to Tools and Methods? Training Resources for ODA Investment M&E in Vietnam

Review – The Investment Cycle • M&E Concepts and the Project Cycle • “Monitoring” vs “Evaluation” • M&E and the Investment Cycle • Types of Evaluation • Evaluation Criteria Training Resources for ODA Investment M&E in Vietnam

Review – The National System • Overview • The relevant legislation – Revised Decree 131 and accompanied Circular • Hanoi Core Statement • Principles • Elements • Monitoring System for ODA in Vietnam Training Resources for ODA Investment M&E in Vietnam

Review – The Communication process Training Resources for ODA Investment M&E in Vietnam

Review – The Logframe Matrix Logical Framework Matrix Training Resources for ODA Investment M&E in Vietnam

Summary monitoring framework Training Resources for ODA Investment M&E in Vietnam

Review - Indicators • Performance questions • Signposts of Change • SMART - Simple, Measurable, Attributable, Relevant, Timely • Quantitative and Qualitative • How much, What, How, Who, When, Where Training Resources for ODA Investment M&E in Vietnam

Review - The Data Journey Source: IFAD 2002 Training Resources for ODA Investment M&E in Vietnam

Review – Communication Audience Matrix Priority Code H = High M = Medium L = Low Derived from: IFAD (2002) Training Resources for ODA Investment M&E in Vietnam

Review – Results Based Management (RBM) • Managing “Outputs” vs “Outcomes” • “Administrative” or “Implementation” management • Focuses on managing inputs, activities and production of “outputs” • “Results based” management • Focuses on management towards the achievement of outcomes Training Resources for ODA Investment M&E in Vietnam

Tools and Methods So, what are tools and methods? Training Resources for ODA Investment M&E in Vietnam

What is a Tool ? • “A thing that helps you do your job or to achieve something” • Research tools such as questionnaires • Question form • Source : Oxford Advanced Learners Dictionary (2000) Training Resources for ODA Investment M&E in Vietnam

What is a Method? • “A method is a particular way of doing something” • A reliable and effective method of data analysis • A new method of solving the problem • Source : Oxford Advanced Learners Dictionary (2000) Training Resources for ODA Investment M&E in Vietnam

TOOLS What can tools demonstrate? Training Resources for ODA Investment M&E in Vietnam

Example – inputs (people) Training Resources for ODA Investment M&E in Vietnam

Example – inputs ($) Training Resources for ODA Investment M&E in Vietnam

Example of variance from plan Training Resources for ODA Investment M&E in Vietnam

Example – CUUP activities Training Resources for ODA Investment M&E in Vietnam

Bidding Efficiency Indicator (BEI) – by project Training Resources for ODA Investment M&E in Vietnam

Comparing BEI by Sectors - Spider Training Resources for ODA Investment M&E in Vietnam

Comparing Planned vs Actual implementation Training Resources for ODA Investment M&E in Vietnam

METHODS How to use a method Training Resources for ODA Investment M&E in Vietnam

Example – Doing a SWOT analysis List of Actions for follow-up after the SWOT analysis Training Resources for ODA Investment M&E in Vietnam

Monitoring & EvaluationIntermediate – National M&E System Section 2 The Relevant Legislation and Hanoi Core Statement Training Resources for ODA Investment M&E in Vietnam

Framework for M&E of ODA investments • National Strategic objectives for ODA are based on: • 10 year social and economic strategy • A 5 year development plan • The ODA Master Plan • Comprehensive Poverty Reduction and Growth Strategy • Focal point for M&E of ODA is FERD in the Ministry of Planning and Investment Training Resources for ODA Investment M&E in Vietnam

M & E Responsibilities • Legal basis in Decree 131/2006/ND-CP • Various levels of responsibility: • of Project management units • of Line Agencies • of Ministry of Planning and Investment • Various types of reporting • Monthly, quarterly, annual and terminal reporting Training Resources for ODA Investment M&E in Vietnam

Hanoi Core Statement (HCS) • Localises “The Paris Declaration” for Vietnam • The Partnership Commitments • Ownership • Alignment • Harmonisation and Simplification • Managing for results • Mutual accountability • Sets out the HSC indicators and targets for each commitment Training Resources for ODA Investment M&E in Vietnam

Good Practice in M&E • Good practice principles of M&E • Reporing and monitoring systemscountry owned and led • Donors aim to rely on country owned reporting and monitoring systems • Reporting and monitoring systems support country’s own information needs • M&E systems should be simple and harmonised • Information should be shared and transparent • Evaluation missions should be planned and implemented in partnership Training Resources for ODA Investment M&E in Vietnam

Principles of the Vietnam M&E system • Usefulness • Impartiality and independence • Credibility • Participation • Harmonisation • Scheduled monitoring and evaluation program • Professionally designed evaluations • Cost effectiveness • Report communicate & feedback results • Using results to manage Training Resources for ODA Investment M&E in Vietnam

Elements of the Vietnam M&E system • Glossary of M&E terms • Purpose and design • Indicators that are S M A R T • Measures • Tools and pro-formas • Analysis and interpretation • Reporting • Sharing information Training Resources for ODA Investment M&E in Vietnam

National Monitoring System-Progress National Agencies Feedback & Banchmarking Quaterly Portfolio PMT Quaterly Portfolio PMT Line Agency Line Agency Donor Donor Feedback& Benchmarking Quaterly Progress AMT thought Project Owner Quaterly Progress AMT thought Project Owner PMU PMU PMU PMU PMU PMU PMU PMU Training Resources for ODA Investment M&E in Vietnam

Monitoring flow chart Chủ DA Training Resources for ODA Investment M&E in Vietnam

ODA monitoring - PMU Training Resources for ODA Investment M&E in Vietnam

ODA monitoring – line agency Training Resources for ODA Investment M&E in Vietnam

ODA monitoring – MPI Training Resources for ODA Investment M&E in Vietnam

Monitoring & EvaluationIntermediate – Foundations Section 3 Teamwork, Team Building Training Resources for ODA Investment M&E in Vietnam

A group of people Whole > Sum Working together Synergy Cooperation Reporting to one boss Having one aim Flexibility Serving one ‘customer’ What is a team? – Some terms Training Resources for ODA Investment M&E in Vietnam

What is Team?? • Features of good teams – ‘whole > sum’ • A team is - a group of people working towards a common goal • Must definethe common goal of the team before you can define who is in the team • Who contributes to that goal? There can be many people. Training Resources for ODA Investment M&E in Vietnam

Who contributes to the common goal? “Goal of the P MU is to implement the Project on schedule and within budget” Training Resources for ODA Investment M&E in Vietnam

What is Team Building • “The process of enabling that group of people (The Team) to reach their goal” • It is therefore a ‘management’ issue! • So,,,,What are the stages of team building • To clarify the team goals • To identify those issues which inhibit the team from reaching those goals • To address thoses issues, remove the inhibitors and enable the goals to be reached Training Resources for ODA Investment M&E in Vietnam

Skills required for Team Building • Recognise the right issues • Address the issues in an appropriate way • Address the issues in an appropriate order Training Resources for ODA Investment M&E in Vietnam

Small teams Individuals Team Islands Better teamwork The Orgsanisation Different ‘scales’ of Team Building Training Resources for ODA Investment M&E in Vietnam

Team building in a ‘Project’ environment • Team composition is continually changing • Develop the skills of individuals to be effective team members • ‘Scale’ involved is one (1) person • Changing the skills and abilities of the individual at operating within a team (or within multiple teams) Training Resources for ODA Investment M&E in Vietnam

Team building in a ‘Management’ team • Team membership is static • How individuals relate can greatly impact team performance • Members leaving or joining can greatly change team dynamics • ‘Scale’ involved is 2 - 12 persons • Team building focus is on improving relationships between team members Training Resources for ODA Investment M&E in Vietnam

Team building between teams • ‘Team islands’ develop if teams do not relate well • ‘Scale’ involved is larger than for ‘individuals’ or ‘management teams’ • Team building focus is on improving realtionships between the teams Training Resources for ODA Investment M&E in Vietnam

Team building in organisations • Largest ‘scale’ is organisational culture change • Ability of ‘individuals to make an impact on organisation/corporate culture is very limited • Behaviours of organisations are almost independent of who actually works there • Team building focus is on changing behaviours and attitudes prevalent in the organisation Training Resources for ODA Investment M&E in Vietnam

Summary – What is team building?? • A team is a group of people working towards a common goal • Team building is a process of enabling the team to achieve that goal • The stages involved include clarifying the goal, identifying the inhibitors and removing them • The nature of the team building varies in terms of scale, and what you are trying to achieve Training Resources for ODA Investment M&E in Vietnam

Summary – Types of Team Building Training Resources for ODA Investment M&E in Vietnam

Team Building Skills • Building a team is one of the hardest skills for a manager to learn. • Team building does not naturally happen!! • Leaders must be aware of how their efforts can actively support an environment where team building is seen as a priority. Training Resources for ODA Investment M&E in Vietnam

Characteristics of high performance teams • Purpose • Gain commitment and “buy-in” across the team • Supervisors and managers are positive role models • Direct and honest communication about the team’s objectives • Respect that team behaviours take time to establish • Start small – persist in discussing benefits of teamwork and establishing shared goals • Communicate the team’s link to the unit’s mission statement and strategic plan Training Resources for ODA Investment M&E in Vietnam

Monitoring & E valuation Intermediate - Introduction