Quality developments in VET

1. Quality developments in VET An overview of the work of the European Forum on Quality in VET

2. Quality developments in VETEuropean Forum on Quality in VET Institutional frame • EU Commission DGEAC (Directorate B):coordination and overall responsibility • Advisory Committee on VET: adopted the Commission’s note on the “the role and mandate of the European Forum on the Quality in VET”. The Commission was reporting regularly on the results of the work. • DGVT meetings: to which the Commission was reporting regularly. • Forum: composed of around 30 representatives of the Member States, the European social partners and the European Economic Area. The ETF was also participating. • Cedefop: technical and scientific assistance to the Commission and setting up of the Technical Group of experts

3. Quality developments in VETAims of the Forum Aims • to improve knowledge and understanding of the diverse and complex quality practices in the Member States • to promote the exchange of information, experience and “good practices” • to promote discussion and reflection • to contribute to the three policy objectives: employability, coherence between offer and demand and improved access to training (with special attention to the vulnerable groups in the labour market) During its mandate, the Forum served as a platform for cooperation and to exchange of information between the Commission, the Member States, the social partners and Cedefop

4. Quality developments in VETWork programme Four thematic fields • Quality management approaches (at system level) • Self-assessment as a quality approach (at VET institution level) • Quality of mechanisms for the assessment and certification of learning outcomes (at individual level) • Indicators for a European strategy on quality in VET (at system level)

5. Quality developments in VETWork structure • Forum: general meetings • May 2001 • November 2001 • May 2002 • September 2002, European Conference Split in four subgroups on the four thematic fields assisted by the • Technical Group monitored by • Cedefop and the EU Commission

6. Quality developments in VETThe Forum’s quality frame and its logic I • The Forum concluded that the quality approach underlying the "quality circle" is the best to use at European and national levels because it addresses all important interrelated issues to be taken into consideration when defining a policy for promoting quality in initial and continuing vocational education and training. • The logic underlying the "quality circle" can be followed independently of the specific quality management model in any Member State. In principle, the quality circle can apply to any process system or approach.

7. Quality developments in VETThe Forum’s quality frame and its logic Purpose Definition of VET goals and standards Key actors Feedback mechanisms and procedures for change Degree of complexity Implementation Assessment and evaluation

8. Quality developments in VETThe Forum’s quality frame and its logic Purpose Definition of VET goals and standards Key actors Degree of complexity Implementation Assessment and evaluation Feedback mechanisms and procedures for change

9. Quality developments in VETThe Forum’s quality frame and its logic II • Purpose:There is a wide range of strategic purposes ranging from accreditation and control to the improvement of performance and results. The question for policy-makers is how to achieve the right balance between the two. • Definition of VET goals and standards:Any strategic purpose should be translated into clear goals. Closely linked to goals are standards, certificates and accreditation. All these are defined by various actors who may represent different interests. It is therefore important to decide who takes decisions and how they are implemented. Goals may be decided at central level or at a local one, depending on the traditions in each country, sector, etc. Goals can be very specific and concrete or broadly defined. • Key actors: A wide range of key actors may be involved in any policy on quality in VET: the state, region, local authorities and institutions, the social partners/professional bodies, students, parents, firms, etc. They all assume different roles and responsibilities and represent varying interests. Generally speaking it is important that the key actors participate in the design and in the control procedure of the system. • The existence of good feedback mechanisms and open communication channels between actors can guarantee their effective participation.

10. Quality developments in VETThe Forum’s quality frame and its logic II • Degree of complexity:Quality management approach differ according to their degree of technicality, design and difficulty. The use of indicators, and especially a combination of soft and hard ones, makes the use of information within the system less complex, but it represents a major challenge in terms of the reliability and validity of measurements. • Implementation:Decisions on the previous points should be followed by implementation. Generally speaking there are three methods to make things happen: • the "hard" way - forcing people to adopt quality; • the "soft" way - gradually motivating people through awareness building, coaching and training and • the "indirect" way - by providing incentives. The leading and exemplary role of the management and its capacity to motivate people is of paramount importance for a successful implementation of any quality approach which aims, inter alia, to make changes.

11. Quality developments in VETThe Forum’s quality frame and its logic II • Assessment and evaluation:Activities in the training/education systems are related to the goals through assessment and evaluation, ranging from self-assessment to centralised control. Concerning QMAs in VET, assessment looks at the effects/outcomes, the efficiency and effectiveness of their use. With regards to assessment, important questions relate to responsibility, methodology, frequency, form and actors. Even in the case of extensive use of self-assessment, as in the UK, Finland and the Netherlands, it is combined with inspections/control. • Feedback mechanisms and procedures for change:To secure quality, the assessment results should be both analysed and acted upon with concrete measures. Feedback relies on the communication of aims, processes, results/valid exchange of information among the parties involved. The procedures for an effective feedback should be planned with the rest of the QMAs and constitute an organic part of it. Although the most important step to ensure change, feedback is generally the most difficult activity to implement.

12. Quality developments in VETMain results of the Forum ’s work 1. Reports 2. Development of supporting instruments 3. Development of information instruments (activities in progress)

13. Quality developments in VETMain results of the Forum ’s work 1. Reports: Intermediary report • “Quality developments in VET”  Thematic reports • “Quality management approaches in VET” • “Self-assessment as a quality approach in VET institutions” • “Quality of mechanisms for the assessment and certification of learning outcomes” • “Indicators for a European strategy for quality in VET ” (in the process of finalisation)

14. Quality developments in VETMain results of the Forum's work: reports Intermediary report:was drawn up on the basis of the most important outcomes of the four thematic reports and with a view to answering the key issues concerning the definition of policies to enhance quality in VET. It therefore contains proposals addressed to European actors, to the national training systems and to VET institutions. Quality management approaches in VET: this report provides an overview of the wide variety material gathered which is presented under the heading of quality management approach, the Member States and the typology of financing and regulations. QMAs at all levels of VET, and both in the public and private sectors and initial and continuing VET, are covered. The report formulates a series of recommendations for the key strategic decisions underlying the different QMAs analysed.

15. Quality developments in VETMain results of the Forum's work: reports Self-assessment as a quality approach in VET institutions:This report focuses on the possible uses of self-assessment as a quality management tool to be developed by a VET institution. It provides arguments for and a general frame to describe national/regional or local self-assessment practices. It contains also analysis of the systemic conditions for organising a coherent management of VET institutions by means of self-assessment. Self-assessment forms an integral part of quality management systems, that is why there was a separate working group on this theme. The group defined the conditions for the implementation of self-assessment and went on to analyse methodologies that combine self-assessment and external evaluation or other forms of assessment. Self-assessment is often introduced or encouraged by national/regional authorities to promote quality within the VET institutions in a more or less compulsory way. It may also be adopted freely by the VET institutions to evaluate and ameliorate their performance in relation to the context they operate or their market position.

16. Quality developments in VETMain results of the Forum's work: reports • Quality of mechanisms for the assessment and certification of learning outcomes:This report presents an overview of the existing quality dimensions so that each Member State can analyse its own practices. It refers to the acquisition of learning in formal systems, and in non-formal and informal situations. It identifies the main quality dimensions for the enhancement of the efficiency and legitimacy of the assessment and certification systems of learning. It also identifies the main questions to address on this subject. • Indicators for a European strategy on quality in VET:Following analysis of more than 200 indicators, together with the examples provided by the members of the Forum, the report identifies the indicators capable of supporting the three European policy objectives. It contains also proposals for European cooperation on the development of indicators to support the improvement of quality in VET. • Finally, a separate document has been prepared listing the dimensions criteria and the above mentioned quality indicators, defined by the four subgroups of the Forum and contained in the respective four thematic reports. This report has been sent electronically to you by the Commission.

17. Quality developments in VETIndicators for a European strategy for quality in VET The work on indicators In our work we concluded that indicators should be related to the quality cycle and follow its logic. Despite the raise of awareness concerning the importance of indicators as instruments for guidance and quality promotion in VET, only a restricted number of Member States uses a coherent set of indicators to this effect. The subgroup of the Forum on indicators proceeded first to the translation of the European political objectives (employability, coherence between training offer and demand and access to training of the most vulnerable groups) into measurable objectives. The Forum defined a set of indicators following the examination of quality indicators in use either in the Member States or by the OECD, Unesco, Eurostat, Eurydice and other institutions. It then defined a coherent set of indicators consisting of indicators related to context, input, process, output and results. Some of these indicators are based on quantitative data (hard indicators) whereas others on qualitative information (soft indicators).

18. Quality developments in VETIndicators for a European strategy for quality in VET The work on indicators: steps • Translation of the three European policy priorities into concrete objectives • Definition of a coherent frame of indicators • Identification of a limited number of indicators based on “good practices”

19. Employability Competences and attitudes (acquisition of) Completion of VET/dropping-out (avoidance of) Transition to employment Quality of employment/employment in new sectors Quality developments in VETIndicators for a European strategy for quality in VET Translation of the European policy priorities into concrete objectives

20. Matching supply and demand Information/awareness Responsiveness to demand Adaptability Innovation Quality developments in VETIndicators for a European strategy for quality in VET Translation of European policy priorities into concrete objectives

21. Access to VET Broader access to everyone who can benefit Basic competences for all Provide opportunities for vulnerable groups: setting-up of special schemes/services Assure the permeability of the VET system to vulnerable groups Quality developments in VETIndicators for a European strategy for quality in VET Translation of European policy priorities into concrete objectives

22. Quality developments in VETIndicators for a European strategy for quality in VET Proposals for indicators for each of the objectives of the three policy priorities Context indicators applicable to all policy priorities

23. Quality developments in VETIndicators for a European strategy for quality in VET Proposals for indicators for each of the objectives of the three policy priorities Objective 1: competences (basic, ICT, social, personal, technical) Employability

24. Quality developments in VETIndicators for a European strategy for quality in VET Proposals for indicators for each of the objectives of the three policy priorities Objective 3:transition to employment Employability Objective 2:completion of VET/avoidance of dropping out

25. Quality developments in VETIndicators for a European strategy for quality in VET Proposals for indicators for each of the objectives of the three policy priorities Objective 4: quality of employment(stability, income, desired working time)/employment in new sectors Employability

26. Quality developments in VETIndicators for a European strategy for quality in VET Proposals for indicators for each of the objectives of the three policy priorities Matching offer and demand Objective 2:responsiveness (reaction to knowledge about recognised demand) Objective 1: information (knowledge about demand acquired and transmitted)

27. Quality developments in VETIndicators for a European strategy for quality in VET Proposals for indicators for each of the objectives of the three policy priorities Objective 3: adaptation/innovation Matching offer and demand

28. Quality developments in VETIndicators for a European strategy for quality in VET Proposals for indicators for each of the objectives of the three policy priorities Objective 1: broadening access (everyone who can benefit) Better access

29. Quality developments in VETIndicators for a European strategy for quality in VET Proposals for indicators for each of the objectives of the three policy priorities Better access Objective 2:opportunities for vulnerable groups Objective 3: permeability

30. Quality developments in VETMain results of the Forum’s work 2. Development of supporting instruments Synergies with the Leonardo da Vinci programme: The 2nd call for tender (2003-04) takes more specific account of the quality dimension in VET. A close relation has been established with the “Study visits” programme run by Cedefop on behalf on the European Commission and a synthesis note on the outcomes of the 7 study visits on quality in VET has been drawn up by one of the experts of the Technical Group. Setting up of networks or national fora on quality in VET: Some of the Member States have set up mini-fora or networks to discuss and collect material on quality in VET and to diffuse the Forum’s results in their own countries. In general, these “light” structures of cooperation comprise the relevant ministers, the social partners and the representatives of the VET sector.

31. Quality developments in VETMain results of the Forum’s work 3. Development of information instruments Web site (http://www.trainingvillage.gr/etv/quality) Glossary Report“Quality in initial and continuing training: aspects and challenges in certain member countries”(Cedefop) Inventory of quality indicators (activities in progress)

32. Quality developments in VET Key concepts 1 Quality • Fulfilment of goals • Relation between experience and expectations

33. Quality developments in VET Key concepts 2 Quality management approach • Any integrated set of policies, procedures, rules, criteria, tools and verification instruments and mechanisms that together ensure and enhance the quality of the training offer.

34. Quality developments in VET Key concepts 3 Self-assessment • A dynamic and progressive process of assessment adopted by a VET institution, under its own control and responsibility, to improve its performance in relation to fixed training goals (mostly national).

35. Quality developments in VET Key concepts 4 Assessment and certification mechanisms • Can be defined as all systematic procedures regularly used by Member States in order to control learning results in relation to identified goals. Learning may be assessed and certified through diplomas, attendance sheets, official documents, etc. It can take place in a formal/non-formal context learning, or can be the result of personal experience (informal learning). • Assessment mechanisms help to make learning visible, to enhance qualifications and to capitalise on them. Certification mechanisms allow learning to be valued in order to obtain a job, to engage in professional activity, to enter training or to realise other personal plans.Certification mechanisms derive from assessment practices.

36. Quality developments in VET Key concepts 5 Indicators • Characteristics or attributes that can be measured to assess a certain action such as: the achievement of an objective, the mobilisation of resources, the attainment of an effect, the attainment of quality or the impact of a context variable. Indicators can be either quantitative or qualitative.

37. Quality developments in VET Key concepts 6 Quality standards • Technical specifications which are measurable and have been drawn up by consensus and approved by an organisation recognised at regional, national or international level. The purpose of quality standards is optimisation of the inputs and/or outputs of learning.