Indicators to measure the effectiveness of the implementation of the Strategy State of the art

1. Karin Sollart Netherlands Environmental Assessment Agency Indicators to measure the effectiveness of the implementation of the StrategyState of the art

2. BackgroundStrategy (Vilnius March 2005) : to facilitate the introduction and promotion of education forsustainable development (ESD) in the UNECE region and thereby contribute to the realisation of our common vision.The aim of the Strategy: to encourage UNECE member States to develop and incorporate ESD into their formal education systems, in all relevant subjects, and in non-formal and informal education.

3. Objectives 1. Ensure that policy, regulatory and operational frameworks support ESD; 2. Promote SD through formal, non-formal and informal learning; 3. Equip educators with the competence to include SD in their teaching; 4. Ensure that adequate tools and materials for ESD are accessible; 5. Promote research on and development of ESD; 6. Strengthen cooperation on ESD at all levels within the UNECE region.

4. The process of developing indicators Establishment of Expert Group following Vilnius. Mandate is 'to develop indicators to measure the effectiveness of the implementation of the Strategy’. 1. Four meetings scheduled 2. Setting up a ‘framework’: using an evaluation model 3. Translating objectives into indicators: state of the art

5. 1. Four meetings of the Expert Group:Representatives from different countriesMeetings held: Ede (26-28 Sep) Geneva (31 Oct – 2 Nov)Meetings to come: Vienna (Mar 2006) The Hague (May 2006)?

6. An evaluation model that covers:a. The process of implementationb. The effectiveness of the implementation, as a qualitative feature of both the process and long- term effects of ESDand that helps to:c. Distinguish between different types of indicators in relation to different phases of the process of implementation

7. Policy framework Check list ……… y/n ……… y/n TYPE 1 Evaluation model used Direct/ Indirect Effects, Impact TYPE 0 Current situation Baseline Throughput Activities TYPE 2 Input TYPE 3 Output OutcomeTYPE 4 Outcome T=0 T=1 2006 2007 2015

8. On indicators….- Baseline data shows the existing situation in relation to an issue at a certain point in time- ‘Checklist indicators’ provide information on initial policy, legislation, regulatory and governance measures taken by a government in order to implement the Strategy - ‘Input indicators’ provide information on a broader spectrum of activities taking place in terms of the implementation of the Strategy - ‘Output indicators’ provide information on the result of these activities - ‘Outcome indicators’ provide information on the possible impact due to the implementation of the Strategy, in particular its qualitative aspect in terms of values, attitudes and choices in favour of SD

9. 3. Translating objectives into indicators: state of the art First draft of indicators prepared and submitted for comments to Steering Committee (December 2005) For each objective a group of indicators and underlying questions was determined. With regard to the issue of ‘indigenous people’ (not a separate objective), it was proposed that a description on how their knowledge is conserved, used and promoted, be considered as an indicator.

10. Draft list of indicators:see hand-out

16. At the next meetings the experts……will focus on consistency and validation and deletion of duplications in the draft. …will work further on the grouping of underlying questions in order to develop aggregated indicators.

17. Discussion……………………………..