Geneva 6th/7th October 2011

1. “Learning from Existing Evaluation Practices on the Impacts and Effects of Intellectual Property on Development” Evaluation Section Internal Audit and Oversight Division (IAOD) World Intellectual Property Organization (WIPO) Geneva 6th/7th October 2011

2. Why do we need evaluation? • It contributes towards a UN system evaluation policy that promotes learning, accountability and transparency • Provides the Organization and MS with valuable analysis and information that can be used for: • Decision-making processes concerning the improvement of present and future activities; •  Policy formulation and review by Member States; and, • Evaluation is an organizational function focusing on institutional learning and accountability towards constituencies.

3. Is the Evaluation Section Independent? Director General WIPO General Assembly Director IAOD PBC IAOC Audit Section Evaluation Section Investigation Section

4. IAOD Organigram Nick Treen Director IAOD S. Nunez Secretary T. Efendioglu Head Internal Audit Head Evaluation C. Hilfiker J. Van Hecke Head Investigation (Temp. Assignment) Senior Internal Auditor (Vacant) J. Flores Senior Evaluator S. Wiggins Investigation Assistant S. Winter Intern S. Woess (Consultant Senior internal Auditor) P. Mehta (Intern)

5. How was the Evaluation Section created? • An Evaluation Framework is put in place through: • Revised evaluation policy, • Evaluation Section Strategy, Evaluation Section functioning only intermittently due to lack of staff Evaluation Guidelines, and Evaluation SectionWork Plans Evaluation Section consist of 1 Head of Evaluation, 1 Senior Staff and 1 intern Focus on core business Evaluation Section is created with 2 post. 1 post filled and 1 vacant Evaluation was non existent in WIPO Second evaluation intents First evaluation policy First evaluation intents Previous 2001 2002 2004 2007 2008 2009 2010 2011 Process of institutionalizing the Evaluation Function Evaluation is an ad-hoc activity Evaluation becomes effective! 2011

6. What has been done since 2007?  up to 2007: Monitoring and Independent Evaluation: • Program Performance Report (PPR) • Providing support to the development of indicators • Training staff in the development of Frameworks • Developping Program and Budget Narratives • Support RBM  From 2008: ES starts defining its core function: • Independent review of the PPR process • Self Evaluation Guidelines for Managers • Revision of first WIPO Evaluation Policy • Evaluation Guidelines • Evaluation Work Plans • Evaluation Strategy • Creation of an Evaluation Section Website • Dissemination of evaluative information • First country portfolio evaluation • First evaluation seminar

7. By which framework is the Evaluation Section’s work guided? Internal Audit and Oversight Charter UN Norms and Standards for Evaluation WIPO Evaluation Policy and Evaluation Guidelines Evaluation Section Strategy Evaluation Section Biennial Work Plans Evaluation Section Annual Reporting Topics, Objectives, Program Performance and Country Evaluations

8. Current work underway: Country Portfolio Evaluation (CPE) Kenya HOW DO WE SELECT A COUNTRY? • Consultation of Director General and Managers • Data analysis using specific criteria looking at 184 countries • Level of WIPO activity by country • Baseline information • International Context like UN Security Rating System, Economy Level, availability of a national IP strategy, etc. • IP Statistics at national and international level • IP Index 3. Geographical and strategic priority using evaluability and feasibility assessment

9. Current work underway: CPE Kenya Main Characteristics of CPEs • CPEs focus on the entire WIPO assistance to a country • CPEs address issues of strategic alignment, choices as well as performance and results • CPEs are utilization focused evaluations. They are designed to benefit WIPO management and IP offices and partners in the countries How is a CPE process being rolled out? • The Kenya CPE process started beginning 2010 with the planning and scoping of the evaluation including consultation of WIPO staff • An Evaluability Assessment was undertaken • Strengthening the evaluation process by selecting an evaluators team, setting up an LRG, undertaking an inception report • Report preparation • Dissemination • Preliminary findings reported to the DG • Evaluation includes management response

10. Where do we want to go Evaluation Policy and Strategy: • Continue to implement the current policy and strategy • Institutionalize evaluation • Deliver more evaluation findings and information • Revise strategy as needed 1 UNDERTAKING OF INDEPENDENT EVALUATIONS • To deliver independent, credible and high quality evaluations that identify what works to developing a balanced and accessible international IP system and what can be replicated and scaled up.

11. Creating a Common Understanding 2 CREATE COMMON UNDERSTANDING OF WIPO’S INDEPENDENT EVALUATION FUNCTION • To contribute to strengthen and enhance the independent evaluation function and evaluation capacities for the benefit of WIPO and its stakeholders

12. Types of Evaluations

13. Pursue Validation of Program Performance Reports • Accuracy and verifiability of the performance data • Sufficiency and comprehensive of reported data • Accessibility of data and the efficiency of its collection • Accuracy of the self-assessment of achievement • Clarity of reporting • Nearly two-thirds of the results validated, related to the relevance and value of the indicators • Performance measures are primarily utilized for purposes of accountability to Member States

14. Ongoing Kenya Country Portfolio Evaluation • Inception Mission Completed (September 2011) • Main Mission in October 2011 • Results available in December 2011 • Initial findings suggest that Kenya has received successful support and • Consequently is reaching the « critical mass » in terms of the sustainability of it’s IP system • Stakeholders have shown a keen interest in this evaluation

15. Pursue the Enhancement of the Evaluation Function (e.g. Evaluation Seminars) • If rated successful, we will repeat this type of seminars  your opinion at the end of the seminar will be much appreciated ( a feedback form is being distributed)