230 likes | 235 Views
This report presents results from a comprehensive evaluation of FAO's Outlook Studies program, including achievements, feedback from users and experts, strengths, limitations, and suggestions for future improvement. The study surveyed various stakeholders to assess the importance, knowledge, quality, and outcomes of outlook studies to improve decision-making in agriculture and forestry sectors.
E N D
Auto-evaluation of FAOoutlook studies work programme Adrian Whiteman FAO, Rome
Introduction • FAO has to auto-evaluate each work programme element every 6 years • Surveyed OS users and experts Oct-Dec 2004 • Present the results of the evaluation • - achievements • - guidance from WP
Auto-evaluation survey • Users (from various FAO databases) – internet, e-mail and paper questionnaire • Experts and policymakers – telephone interviews • FAO staff – telephone and face-to-face interviews • Citation analysis • Website statistics
Survey of experts and policy makers • 83 people approached: experts; opinion formers; contributors • 70 people contacted • One-third non-users; one-fifth only slight users (not getting to opinion formers – especially in government) • Some significant users: CIRAD; METLA; Forest Trends; CIFOR; World Bank; WWF; African Development Bank; Conservation International • 35 people interviewed in detail
Strengths and competitive advantages • Unrivalled database • Credible, unbiased, transparent and free • Long-term and multi-country analysis, not available elsewhere • Have the authority of FAO’s backing, especially in broader agriculture and land-use context
Shortcomings and limitations • Not well advertised and weak follow-up • Audience is unclear – need more focus • Too big and too long/detailed for policymakers • Not enough country-specific follow-up (especially in Africa) • Presentation is sometimes a problem • Overly cautious • Short shelf-life • (Experts/contributors) – data quality is an issue, sometimes a heavy demand on contributors
Citations – use of outlook studies • PUBLIC SECTOR: used to stimulate debate, explain policy and raise awareness of the sector • PRIVATE SECTOR: used to stimulate investment • ACADEMIC: used for research planning • In particular, outlook studies are used to debate environmental issues, then economic and social issues in the forestry sector
Survey of (37) FAO staff • Mixed response • Not used extensively, mainly used for information rather than analysis • Unclear focus • Poor marketing • Little follow-up in countries • Short shelf-life, need regular updates • Should work more holistically
Audience: national policy; international policy; investment – need better focus? Large studies every 10 years or shorter more regular studies? Process – top down or greater country capacity building? Marketing – getting the product onto desks! Other issues (e.g. future developments)? Comments, questions and guidance please! Especially: