1 / 35

General observations on status quo in EU 27

Monitoring and Indicators in 2014-2020 WORKSHOP 30 APRIL 2013 Ines Hartwig Impact Assessment & Evaluation Unit DG EMPL. General observations on status quo in EU 27. Number of indicators/priority varies considerably

darren
Download Presentation

General observations on status quo in EU 27

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Monitoring and Indicators in 2014-2020WORKSHOP 30 APRIL 2013 Ines HartwigImpact Assessment & Evaluation UnitDG EMPL

  2. General observations on status quo in EU 27 • Number of indicators/priority varies considerably • Some OPs include impact indicators others focus on financial or output indicators • Not all indicator sets link output with result • Some OP indicators cover large parts of a priority, others only niche type of activities/target groups • Monitoring systems often distinguish between Annex XXIII and indicators • In general data on performance seem to be of lesser importance than financial data.

  3. Moving towards result orientation in 2014-202 • Common indicators for outputs and results • Legal obligation to collect personal data on participants • Collect and store individual participants' data (micro-data) • AIR only admissible if all data is submitted • Suspension possible if there is a serious deficiency in the quality and reliability of the monitoring system or of the indicator data • MIS will be subject to EC audits

  4. Common ESF output indicators

  5. Common ESF result indicators Only for a sample of participants. Only reported in 2019 and 2023

  6. Micro data for every participatory record Example: common indicators Labour market Longer-term results education entities age disadvantage Immediate results

  7. How to set targets for common result indicators?

  8. Example: Participants gaining a qualification upon leaving Result target is often expressed in % The % requires a reference value, i.e. the relevant output data. Example: Target 1: 50% gaining a qualification upon leaving 50% of whom? Of all participants in the IP? No, 50% of the low skilled participants (ISCED 1 and 2) gaining a qualification upon leaving Target 2: 40% of the unemployed participants gaining a qualification upon leaving

  9. Programme-specific indicators • Developed in addition to common indicators • Set at the level of investment priority or specific objective

  10. SROP indicators: Priority 2 • Number of working age people (15-64 years) who participate in training financed in the framework of the priority • Number of people who participate in training serving the improvement of key competences supported in the framework of the priority • Enterprises affected by the trainings supported in the framework of the priority • Number of working age people (15-64 years) who successfully finish a training financed in the framework of the priority (pass final exam, acquire certificate) • Number of people who successfully finish a training which serves the improvement of key competences supported in the framework of the priority

  11. Comparing monitoring data, Priority 2

  12. SROP indicators: Priority 3 • Number of teachers accomplished a competence-based training in education methodology supported in the frame of the 3rd priority (head) • Number of teachers accomplished a competence-based training in education methodology supported in the frame of the 3rd priority (head) • Number of participants in non- formal learning events organized in cultural institutions and organizations supported in the frame of the 3rd priority (head) • Number of accumulatively handicapped students provided for an integrated education (head) (30,8 in 2010) • Ratio of 8th class students accomplishing not more than level 3 on the reading and text interpretation • Number of primary school task assignment locations training at least 80% handicapped students as a result of the activities implemented in the frame of the 3rd priority (pc)

  13. Comparing monitoring data, Priority 3

  14. Principles for sound indicators • Integrated set of indicators consisting of CI and programme-specific indicators • With a limited set of targets. Not all indicators need a target. But the most important ones do. • Indicators should cover the main scope of a priority (i.e. target group, type of activity etc.) • Targets should also cover large parts of a priority • Indicators should be simple, data to be collected in monitoring system • Indicators should have a clear definition

  15. Principles (2) • Output and result indicators – no impact indicators • Result indicators should be linked to participants/ supported entities, no macro-economic indicators • Result indicators need to be logically linked to output indicators. • Indicators should be expressed in absolute numbers (targets could be %) NO:Employment ratio (%) of working age YES: unemployed participants in employment upon leaving/6 months/12 months after leaving

  16. Steps in designing programme-specific indicators • 'Deconstruct' the programme with view to the following categories: • Target groups (people & entities) • Type of planned activities • Themes • Projects • Type of expected results • Prioritise within each category • Develop indicators e.g. by combining characteristics/ features from the various categories • Review intervention logic to ensure that the most important aspects are covered by indicators

  17. Programme-specific indicators - EXAMPLES -

  18. By combining different common indicators • Advantage: Data have to be collected anyway. Data only needs to be crossed. • Less administrative burden linked to data collection

  19. Programme Output Indicator: Young low skilled inactive participants Inactive, not in education or training Below 25 years With primary or lower secondary education

  20. Result indicator: young low skilled inactive participants gaining a qualification Inactive, not in education or training With primary or lower secondary education Below 25 years Participants gaining a qualification upon leaving

  21. Output indicator: low skilled older workers Employed, including self-employed Above 54 years With primary or lower secondary education

  22. Result indicator: low skilled older workers gaining a qualification Employed, including self-employed Above 54 years With primary or lower secondary education Participants gaining a qualification upon leaving

  23. Longer term result indicator: low skilled older workers gaining a qualification and improving their labour market situation Employed, including self-employed Above 54 years With primary or lower secondary education Participants with an improved labour market situation 6 months after leaving Participants gaining a qualification upon leaving

  24. Output indicator: high skilled unemployed Unemployed, including long-term unemployed With tertiary education

  25. Result indicator: high skilled unemployed in employment Unemployed, including long-term unemployed With tertiary education Participants in employment upon leaving

  26. By combining common indicators with programme specific characteristics/ features Advantages: indicators can take into account specific aspects of the programme.

  27. Output indicator: NEETS Inactive, not in education or training Participants between 16 and 25 years Unemployed, including long-term unemployed

  28. Result indicator: NEETs in education or training Inactive, not in education or training Participants between 15 and 24 years Unemployed, including long-term unemployed Participants in education/ training upon leaving

  29. Output indicator: start-ups of high skilled young people supported Below 25 years Start-ups With tertiary education

  30. Result indicator: start-ups of high skilled young people sustained 6 months after leaving Below 25 years Start-ups With tertiary education In self-employment six months after leaving

  31. Output indicatorDisadvantaged pupils Pupils below 16 years Migrant and minorities Other disadvantaged Disabled

  32. Result indicatorDisadvantaged pupils in education or training upon leaving Pupils below 16 years Migrant and minorities Other disadvantaged Disabled In education or training upon leaving

  33. Output indicator : Counselling youngsters (up to 18 years) with migrant background Below 19 years Counselling Migrants and minorities

  34. Result indicator : Counselling youngsters with migrant background who finished an internship upon leaving Below 19 years Counselling Internship Migrants and minorities

  35. Thank you • for your attention • Questions? • Comments? • Contact: Ines Hartwig • ines.hartwig@ec.europa.eu

More Related