The ENTITLE Project Guidelines and Impact Assessment

1. The ENTITLE Project Guidelines and Impact Assessment With the support of the Lifelong Learning Programme of the European Union Helsinki August 18, 2009 Anne-Marie Schmidt Aarhus Public Libraries, Denmark

2. The ENTITLE project falls under: The EU’s Lifelong Learning Programme The Transversal Programme, Key Activity 4: Dissemination and Exploitation of Project Results Helsinki August 18, 2009 Anne-Marie Schmidt Aarhus Public Libraries, Denmark

3. A key activity of ENTITLE: • The production of Guidelines and Recommendations in support of continued development of the transversal role of libraries and their partners in supporting learning across children's, adult and vocational education, in the varying economic, social, cultural infrastructural and professional conditions across Europe. Helsinki August 18, 2009 Anne-Marie Schmidt Aarhus Public Libraries, Denmark

4. Another key activity of ENTITLE: • To provide an evidence-based framework for further and wider comparison and exploitation of these results within and between countries, especially where this relates to impact on learners, with potential for future use in the context of comparative research studies. Helsinki August 18, 2009 Anne-Marie Schmidt Aarhus Public Libraries, Denmark

5. Guidelines for lifelong learning in libraries have been worked out in several previous EU-projects For instance: • PuLLS • PULMAN • CALIMERA Helsinki August 18, 2009 Anne-Marie Schmidt Aarhus Public Libraries, Denmark

6. The 9 Original Guideline Categories: • Learning Management - cooperation with schools, increasing learner participation and learner support methods • Learning Management - staff competences and workforce development • Learning Management – funding • Learning Management - improving the diversity of provision • Learning Management - the development of an organisational learning and evaluation culture and practices in public libraries • ICT • Learning Environments/Physical Spaces • Learning Outcomes – measuring impact • Learning Outcomes Helsinki August 18, 2009 Anne-Marie Schmidt Aarhus Public Libraries, Denmark

7. Template Structure: • Policy Issues -A general statement of what the issue is -A description of what the broad trends are -Examples, which illustrate these statements • Good Practice -Statements illustrated by examples • European Experiences -Major EC funded initiatives • References Helsinki August 18, 2009 Anne-Marie Schmidt Aarhus Public Libraries, Denmark

8. New Guidelines 1. Strategies and Policies on Lifelong Learning and Public Libraries 2. Landscape 3. Planning and Managing Learning Services 4. Resourcing 5. Evaluation 6. Learning Environment Helsinki August 18, 2009 Anne-Marie Schmidt Aarhus Public Libraries, Denmark

9. 1.Strategies and Policies on Lifelong Learning and Public Libraries -UNESCO and IFLA policies -an entire guideline dedicated to overall strategies and policies 2. Landscape -the position of libraries in the lifelong learning landscape, which is constantly changing -theories and learning styles Helsinki August 18, 2009 Anne-Marie Schmidt Aarhus Public Libraries, Denmark

10. 3. Planning and Managing Learning Services -how learning services emerge -how libraries plan and manage new learning services 4. Resourcing -staffing and funding -options for funding -staff competences Helsinki August 18, 2009 Anne-Marie Schmidt Aarhus Public Libraries, Denmark

11. 5. Evaluation • -how libraries evaluate outcomes and impact of learning services 6. Learning Environment • -physical environment • -virtual environment; ICT, which today is omnipresent in libraries. Helsinki August 18, 2009 Anne-Marie Schmidt Aarhus Public Libraries, Denmark

12. New Guideline template structure: • Introduction - why is the topic of this guideline important? - key issues • Conclusions and Recommendations - conclusions that can be drawn from the guideline - recommendations based on those conclusions • Good Practice - description - examples in EU - mainly meant for library staff • References - sources and links Helsinki August 18, 2009 Anne-Marie Schmidt Aarhus Public Libraries, Denmark

13. Helsinki August 18, 2009 Anne-Marie Schmidt Aarhus Public Libraries, Denmark

14. Generic Learning Outcome http://www.inspiringlearningforall.gov.uk/ Helsinki August 18, 2009 Anne-Marie Schmidt Aarhus Public Libraries, Denmark

15. Key steps in the framework: • Developing your Story • Selecting SMART Indicators • Deciding on the right Data Collection Methods • Analysing Results • Presenting and Using Findings Helsinki August 18, 2009 Anne-Marie Schmidt Aarhus Public Libraries, Denmark

16. Plan for testing in Denmark • Testing in 4 different libraries on 4 dissimilar services • Forming summary and overview as well as abbreviated text about the Impact Framework to make it easier and more straightforward to learn to use • But: 3 out of 4 libraries still found it too extensive and time-consuming Helsinki August 18, 2009 Anne-Marie Schmidt Aarhus Public Libraries, Denmark

17. Tests in Denmark • One course for library users – especially senior citizens – in ”How to write and send text messages with a mobile phone” • One regional competence development course for library employees • One national competence development course for library employees Helsinki August 18, 2009 Anne-Marie Schmidt Aarhus Public Libraries, Denmark

18. Our experiences • Useful to consider the initial reason for establishing the evaluated service > puts the service into a greater perspective • Valuable that questions must be tailored to and aimed directly at the individual service > possible to examine whether a specific part of the service has the sought-after effect Helsinki August 18, 2009 Anne-Marie Schmidt Aarhus Public Libraries, Denmark

19. Helsinki August 18, 2009 Anne-Marie Schmidt Aarhus Public Libraries, Denmark

20. Helsinki August 18, 2009 Anne-Marie Schmidt Aarhus Public Libraries, Denmark

21. Helsinki August 18, 2009 Anne-Marie Schmidt Aarhus Public Libraries, Denmark

22. Our experiences • Much more comprehensive than our usual evaluations of library services • Difficult task to familiarise library staff with the framework due to complexity • Using the framework on a daily basis to evaluate library services may demand considerable time resources Helsinki August 18, 2009 Anne-Marie Schmidt Aarhus Public Libraries, Denmark

23. Our most important experience • When using the framework it is necessary to study the method carefully and become entirely familiar with it before beginning to fill in handouts Helsinki August 18, 2009 Anne-Marie Schmidt Aarhus Public Libraries, Denmark

24. Helsinki August 18, 2009 Anne-Marie Schmidt Aarhus Public Libraries, Denmark

25. Overall points for the impact framework • Very useful on a large scale because it provides a comprehensive method for evaluating learning outcomes in libraries • A condensed version for daily use in libraries would be easier to use for librarians and less time-consuming • Carry out thorough courses for staff who are going to use the framework Helsinki August 18, 2009 Anne-Marie Schmidt Aarhus Public Libraries, Denmark

26. Important points: • Ideal to incorporate framework into the library’s daily routine when planning, carrying out and evaluating library learning services Helsinki August 18, 2009 Anne-Marie Schmidt Aarhus Public Libraries, Denmark

27. Important points: • Perspective can be extensive if evaluation is carried out systematically - you can make a strong case about the impact of your service Helsinki August 18, 2009 Anne-Marie Schmidt Aarhus Public Libraries, Denmark

28. Important points: • Tailor questions directly to the individual service/course → measure specific effects → custom-made questions connect to your “story” Helsinki August 18, 2009 Anne-Marie Schmidt Aarhus Public Libraries, Denmark

29. PLease keep udpated at the website: www.entitlelll.eu Helsinki August 18, 2009 Anne-Marie Schmidt Aarhus Public Libraries, Denmark

30. Questions for discussion • Why evaluate learning services in libraries? Helsinki August 18, 2009 Anne-Marie Schmidt Aarhus Public Libraries, Denmark

31. Questions for discussion • Do you evaluate your learning services? • Which method(s) do you use? • Do you evaluate systematically? Helsinki August 18, 2009 Anne-Marie Schmidt Aarhus Public Libraries, Denmark

32. Questions for discussion • From what you have heard today about the Impact Assessment Framework, do you think you could use this method? Helsinki August 18, 2009 Anne-Marie Schmidt Aarhus Public Libraries, Denmark

33. Questions for discussion • Could this tool become a part of everyday routine in libraries when planning and implementing new learning services? Helsinki August 18, 2009 Anne-Marie Schmidt Aarhus Public Libraries, Denmark

34. Questions for discussion • Do you outline goals for what you want to achieve with your services and courses for users? Helsinki August 18, 2009 Anne-Marie Schmidt Aarhus Public Libraries, Denmark

35. Questions for discussion • In practice, how can we convince participants to take part in evaluation and to spend extra time to do it? Helsinki August 18, 2009 Anne-Marie Schmidt Aarhus Public Libraries, Denmark