Maximizing the Value of Transnationality: Innovation, Transnationality, and Mainstreaming Evaluation Workshop

1. ESF Innovation, Transnationality & MainstreamingEvaluation workshopBirmingham, 28 Sep 2010Getting value from transnationalityToby JohnsonAEIDL, Brusselstoby.johnson@poptel.org

2. Value of transnationalityCommission support • Learning for Change • 13 networks among ESF managing authorities: • inclusive entrepreneurship, social economy, youth, migrants & ethnic minorities, ex-offenders, age, asylum seekers • empowerment & inclusion, partnership, transnationality, administrative capacity-building, results-based management, gender mainstreaming • Common methodologies • 7 chapters: planning, consolidating, online networking, peer reviews, evidence, mainstreaming, evaluation

3. Value of transnationalityFlanders: 3 goals for transnationality • To stimulate and support innovations through exchange of research, technical and practical techniques and experience • To validate and disseminate knowledge and experience, as a result of which we can avoid duplication of investments • to increase the capacity of the participating administrations and organisations

4. Value of transnationalityFlanders: 4 types of transnational co-operation • ESF authorities: exchange of experience, practice and ideas concerning the preparation, implementation, monitoring and evaluation of all elements of the Lisbon process in general and those of the ESF in particular. • Organisations or geographical partnerships: cross-border matters concerning the development of the labour market, but can also relate to broader matters of cooperation. • Thematic networking concerning specific topics or problems. Several stakeholders or groups with a specific interest can cooperate on several topical themes. • Projects: cooperation such as the one organised under EQUAL in the period 2000-2006. + individuals?

5. Benefits for ESF trainees • enhanced vocational skills • language and communication skills • understanding training & employment situations in other countries •  re-evaluation of their own situation and maybe • higher motivation • higher ambitions • contacts to get work

6. Benefits for project staff • improved methods • new language, communication & problem-solving skills • raised self-confidence • a mirror: raised awareness of strengths & weaknesses of their national systems & own institution •  re-evaluation of their own situation

7. Benefits for project promoters- operational benefits • learning new ideas • expert opinions on one’s own products • extending & improving existing courses, materials & methods • pooling expertise to jointly create new products • finding new business partners • acquiring new skills • enhancing capacities through joint research

8. Benefits for project promoters- strategic benefits • build contacts • access to European networks & markets • stay at the cutting edge • benchmarking: contrast approaches in different countries • better understanding of policy developments • status & reputation as open-minded innovators • spin-off: ideas for future projects

9. Benefits for managing authorities • underpins reform in employment & social policy • cost-effectiveness: • transfer is cheaper than reinvention • impact is maximised (ICDL used in 148 countries) • speeds up social innovation

10. Value of transnational co-operation among EQUAL projects • better understanding of legal & institutional contexts • better dissemination of innovative results • ability to transfer social innovations • develop true European mindset • establish formal & informal networks • Ruth Santos, An investment in Europe’s present and future: the added value of transnational co-operation at project level under EQUAL. Ecotec, 2005

11. Extracting added value from transnationality • be clear with potential partners • define what you want to get out of it • define what you are able to put into it • link it to a change you wish to bring about • this defines what you need to learn Learning Networks Seminar, 28-29 June 2010, Brussels

12. Evidence-based policyIs it scientific? • public policy informed by rigorously established objective evidence • issues: • complex & changing environmental conditions are irreproducible • control groups are difficult to compare • ethics (guinea pigs) • policy cycle too short

13. What is “evidence”?Definition & usage • “that which can be seen” (Latin) • a physical trace of an event (law) • a fact that enables you to tell whether or not an assertion is true (science) • something that tells you whether or not a policy is working, or is likely to work if scaled up and mainstreamed (policy)

14. Collecting evidenceTypes of indicators • input or activity indicators • costs • output indicators • direct effects • result or output indicators • consequent changes in behaviour • impact indicators • wider socio-economic effects (usually too early to say)

15. Collecting evidenceRelationship among levels of indicators

16. Collecting evidenceCollection methods • hard evidence = statistics • labour market & social statistics on Eurostat • press articles • previous policy & evaluations • number of trainees, hours etc. • immediate results • soft evidence = opinion surveys • structured interview / call centre / focus group • card exercise / exit questionnaire / vox populi • online questionnaire • omnibus survey

17. Presenting statistical evidenceWhat is entrepreneurs’ experience of the business support services? (COPIE)

18. Presenting case evidenceScientific data collection • analytical case studies: • enforce comparability • show up weaknesses • many sections • can be compiled into a database • may be suitable for Wikipedia (neutral, notable, referenced & encyclopaedic in style) • use for working data Learning Networks Seminar, 28-29 June 2010, Brussels

19. Presenting case evidenceA good story Learning Networks Seminar, 28-29 June 2010, Brussels

20. Presenting case evidenceJournalistic case studies – content • catchy title • context & problem • main actors & key messages • describe the interesting parts of the activity • how key principles were applied (e.g. in EQUAL: empowerment, innovation, partnership, transnationality & mainstreaming) • use for final publication Learning Networks Seminar, 28-29 June 2010, Brussels

21. Presenting case evidenceJournalistic case studies – format • not too long • make it easy to select & skip: • headline • standfirst • crossheads • keywords • photos & diagrams Learning Networks Seminar, 28-29 June 2010, Brussels

22. Presenting argumentsPolicy brief Learning Networks Seminar, 28-29 June 2010, Brussels

23. Presenting argumentsPolicy brief contents • title • problem • relevance – to policy and to people • the solutions that have been tested • what made the difference • what underlying principles are proven • hard facts & figures • lessons learned • policy recommendation Learning Networks Seminar, 28-29 June 2010, Brussels

24. Elevator pitch – 6 steps to proving the value of transnationality • define what value you wish to obtain • design the project to deliver that value • define at the outset what change you wish to bring about • work out what evidence will demonstrate that change • collect the data (before & after) • present it effectively Learning Networks Seminar, 28-29 June 2010, Brussels