LLP Key activity 1 : Policy Cooperation and Innovation, Studies and Comparative Research

1. External Evaluation of the KHLeuven FLLLEX project:The Impact of LLL Strategies on Professional Higher Education LLP Key activity 1 : Policy Cooperation and Innovation, Studies and Comparative Research Advisory Board meeting, 26 / 01 / 2010, Brussels byMagda Kirsch & Yves Beernaert, Educonsult

2. Objectives FLLLEX • Formulate policy recommendations after identifying & describing challenges & implications of incorporating LLL into Eur. HEI's planning to play a role in nat. LLL strategy. • Special focus on: • Degree of flexibility in HEI as to RPL • Adapting HEI management & services to new LLL demands • Policies in Eur. countries & their impact on stakeholders • Indicators for a successful implementation of LLL into HEI’s through a self-assessment tool for HEI's. • good practices, • bench-marking opportunity for the participating HEI’s • missing links between the Eur. & nat. policies, • current capacity of the HEI’s to achieve LLL goals

3. Deliverables • Description National policies for LLL implementation • Reviewing the implementation of LLL in EU HEI's • Survey of expectations of LLL'ers • Questionnaire for Lifelong Learners • Survey of businesses • Questionnaire for businesses • Survey of business training providers • Questionnaire for business training providers • Self-assessment tool for individual institutions • Training package FLLLEX • Train-the-Trainer sessions • Report of the self-assessments

4. Deliverables (consolidated) • FLLLEX project results (pre-conference doc.) • Summary internal reports WP 1 – 4 • Self-assessment tools and guidelines: WP 5 – 7 • Proposals for policy changes of panel of experts and advisory board • A ‘road-show’ package • LLL Seminar //Eurashe conference 2012 Riga • A report with policy recommendations • Publication with good practices • Final report (with external evaluation report)

5. Work packages • WP 1 Literature and Policy Research • WP 2 Survey expectations of LLL Learners • WP 3 Survey expectations of businesses • WP 4 Survey of the business training providers • WP 5 Development of a self-assessment tool • WP 6 Self-assessment of individual institutions • WP 7 Review of the self-assessment • WP 8 Dissemination seminar on LLL strategies • WP 9 Management: Management of FLLLEX

6. External evaluation • Relevance • Effectiveness • Efficiency • Impact • Sustainability • Both formative and summative external evaluation • Monitoring role of external evaluators !

7. General evaluation tools • A questionnaire for all partners twice during the project focusing on organisation and management and communication. • Intermediate report with proposals to improve organisation, management and communication, if necessary • Participation to meetings: checklist • Involvement in the preparation & and follow-up of general meetings • Advice on administrative & financial issues

8. Evaluation tools • Regular interviews / discussions with coordinator & team: interview grid • Checklist as to organisation &management • Advice to the coordinator on specific training. • Drafting of observation sheets for meetings to be attended • Evaluation tool for communication strategy within the project and towards the outside

9. Evaluation tools • Dissemination table • Analysis of the website and other communication tools such as Newsletters. • Evaluation of the strengths and weaknesses of the consortium • Evaluation of the links with key organisations

10. Specific evaluation activities WP1 & WP2 & WP3 & WP 4 • Support collection of information • Support development & use of questionnaires • Support efficient collection & treatment data WP5 • Support development of self-assessment tool and matrix of national polices • Support with advice as to QA in HEI

11. Specific evaluation activities WP 6 • Support on how to test self-assessment tool • Support to prepare training seminar for contact persons of HEIs • Attend & evaluate the training; questionnaire WP 7 • Support the selection of the experts: criteria • Create links EU clusters 2020, CEDEFOP etc.

12. Specific evaluation activities WP 8 • Evaluate the conference; draft evaluation form for the participants • Support development of pre-conference volume • Support the development of the road package • Evaluate the use of the road-package; • tool to evaluate use of road package

13. Specifc evaluation activities WP 9 • Attend some meetings • Check work progress within time allocated • Support the WP as to specific questions • Follow-up the organisation, management and implementation of the activities of this WP • Pass on information as to continuous monitoring and formative evaluation

14. Outcomes external evaluation • Draft intermediate external evaluation & monitoring reports • Presentation to and discussion with Advisory Board • Final version • Draft final external evaluation & monitoring reports • Presentation to and discussion with Advisory Board • Final version • A set of evaluation tools to be used in other project

15. Limits to the external evaluation • The time (days) allocated to the monitoring and evaluation • The budget allocated to the monitoring and evaluation

16. Thanks for your attention Questions? Good luck with the FLLLEX project