5 th General Meeting M arch 19 – 22, 2007

1. 5th General MeetingMarch 19 – 22, 2007 COMPLETE Leonardo Project RO/04/B/F/PP - 175016 “New Strategies of COMPetence Acquisition for Lifelong Learning in Energy – Transport - Environment Engineering” Quality indicators

2. Activities 1st year 2nd year 3rd year I II III IV I II III IV I II III IV 1.5. Quality evaluation 2.7. Quality evaluation of the training programme 4.7. Quality evaluation. 5.5. Assessment and quality evaluation 6.3. Quality procedures development Activities plan......

3. Activities Partners P1 P2 P3 P4 P5 P6 P7 P8 P9 1.5. Quality evaluation 2.7. Quality evaluation of the training programme C 4.7. Quality evaluation. C 5.5. Assessment and quality evaluation C C 6.3. Quality procedures development C Partners’ involvment......

4. Strasbourg meeting requirements...... “The next point of the agenda is the Quality evaluation of the e-products and programs. Olivier Nass says there are general guidelines and indicators contained in the project but the evaluation of the e-products and programs is based on competencies acquired by students and can be appreciated only after the products are developed and implemented. He explains that there are not defined criteria of evaluation for the e-products, criteria that must be based on the list of competencies to acquire. Alessandra Millevolte says that she will send the evaluation criteria for WP III’s products (guide, website, platform)”. (October, 2006)

5. Quality indicators and methods of measurements Location: Laboratorio delle Idee February 2007 Team: Alessandra MILEVOLTE Elena HELEREA Daniela FLOREA Massimo MUSTICA Dinu COVACIU

6. Objectives Quality indicators Unit of measure Measurement methods Accepted level Recorded documents 1.1. Involve-ment of the partnership at local level Degree of involvement of people in the project manage-ment % of persons involved related to the total number of the local management team Number of local meetings x number of people involved in the local committee 60% ·List of the persons involved in the local committee ·Local meetings minutes % of local meetings organized related to the total previewed Number of local meetings organized/total local meeting previewed 66% ·Local meetings minutes WP I – Objective 1.1.

7. 1.2. Involve-ment of the partnership at transna-tional level Objectives Degree of involvement of partners in the project management Quality indicators Degree of participation of the partners in the general meetings Unit of measure Number of general meetings x number of partners (institutions) involved in the local committee Measurement methods Accepted level 60% Recorded documents ·General meetings protocols ·List of partners ·List of general meetings Degree of achievement of the mobility plan % of mobility travels related to the total proposed in the mobility plan Number of travel performed /total travel planned 80% · Mobility plan · Certificate of attendance · Report of activities WP I – Objective 1.2.

8. Objectives 1.3. Respect of the activity plan Quality indicators Degree of achievement of the activity plan Unit of measure Number of days of delay in achieving the activities in each WP Measurement methods Comparison between the activity plan and performed activity Accepted level 45 Recorded documents ·GANTT diagram ·General meetings protocols ··Internal report of validation of the activities carried out by the Work Group WP I – Objective 1.3.

9. Objectives 1.4. Respect of the budget Quality indicators Degree of achievement of the expences plan Unit of measure Cost performance index Measurement methods ACWP/BCWS Accepted level Recorded documents Degree of the effectiveness/efficiency WP I – Objective 1.4.

10. Objectives 1.5. Realization of the dissemina-tion program Degree of achievement of the dissemina-tion plan Quality indicators Unit of measure % of realization of the activities /products planned in the dissemination program Measurement methods Number of dissemination materials and events realized compared with those planned in the dissemination program 70% Accepted level Recorded documents ·Dissemination plan for each year ·List of dissemination materials ·Dissemination products and reports Degree of accomplish-ment of dissemina-tion at internatio-nal level % of activitiesproducts realized at international level by all the partneship Number of activitiesproducts realized at international level, related to the total number of the activities/products realized 10% ·Dissemination plan for each year ·List of dissemination materials ·Dissemination products and reports ·List of dissemination activities at international level WP I – Objective 1.5.

11. Objectives Quality indicators Unit of measure Measurement methods Accepted level Recorded documents 2.1. Designing the training programs “Interactive methods for teaching-learning-evaluation process” according to training programs objectives Level of correspondence between curricula and training programs objectives Number of modules/subjects/contents related to each training program objective Direct observation 1 module/2 contents per each objective ·List of training program objectives ·Curricula Internal validation report WP II – Objective 2.1.

12. 2.2. Achieving the objectives of the training programme Objectives Adequateness of selection process Quality indicators % of people selected presenting the requested characteristics related to the total of people selected Unit of measure Comparison between the number of people selected presenting the requested characteristics related and the total of people selected Measurement methods 80% Accepted level ·Procedure ·List of candidates ·Selection report ·List of participants Recorded documents Degree of acquisition of knowledge and skills Average mark obtained to the final test Evaluation of the final test (mark) 7 ·Tests ·Graduation certificate ·Attendance certificate ·List of graduates Level of trainees’ satisfaction about the training programme qulity Average mark obtained in the questionnaires Questionnaire 70% satisfied ·Question-naires ·Results report WP II – Objective 2.2.

13. Objectives 3.1. Hard and software resources upgrade and/or acquisition in order to accomplish the project aims Degree of realization of the acquisition plan Quality indicators % of realization of the acquisition plan Unit of measure Comparison between the list of the initial needs of the equipments proposed and the list of the equipment really bought/rent Measurement methods 80% Accepted level Recorded documents ·List of equipments proposed ·List of the equipments bought/rent Number of days of delay in acquisition Comparison between the hardware plan acquisition in the project proposal and the dates of real acquisition 30 ·Hardware plan acquisition ·Invoices Degree of compatibilities between acquired/produced hardware and software and realized web site and ePlatform % of software installed related to the plan Direct evidence 100% ·Installation report Number of applications delivered Direct evidence 5 ·Applications list Number of users served by the e-platform Automatic counting the registered users 150 ·Report of users from application data bases WP III– Objective 3.1.

14. Objectives 3.2. Web site and E-learning platform design and developing according to the requirements Level of accomplish-ment of the requirements Quality indicators Unit of measure % of require- ments accom- plished Measurement methods Direct evidence 100% Accepted level Recorded documents Report of validation assessment of the requirements: ·to have all the instruments supporting the interactive methods ·to respect the learning standard SCORM 2004- (demo installation from ADL web page and description of manual of SCORM 2004) · to be complaint to the open standards -availability of the software (an “open source”) The level of users’ satisfaction Average mark obtained in the question- naires Questionnaire 70% satisfied ·Questionnaires ·Results report ·Guides for e-learning platform and e-products WP III– Objective 3.2.

15. Objectives Quality indicators Unit of measure Measurement methods Accepted level Recorded documents 4.1. Designing the content and the structure of the e-product in conformity with the needs identified Level of correspondence between COMPLETE e-courses contents and syllabi % of correspon-dence between moodle courses contents and syllabi Direct evidence 85% ·Catalogue of e-products ·Syllabi e-products (COMPLETE e-courses): 1. collection of e-resources 2. e-learning course 3. collection of PjL 4. collection of PbL 5. collection of activities WP IV– Objective 4.1.

16. 4.2. Development of e-products in conformity to the activity plan Objectives Level of realization of e-products Quality indicators % of realization of the e-products proposed Unit of measure Comparison between the number of realized e-products and the total number of e-products proposed Measurement methods 80% of e-learning courses and 20% of COMPLETE e-courses to have all the features Accepted level ·List of proposed e-products ·List of realized e-products ·Quality evaluation reports Recorded documents WP IV– Objective 4.2.

17. Objectives 4.3. Testing e—products The level of beneficiaries’ satisfaction Quality indicators Unit of measure Average mark obtained in the question-naires Measurement methods Questionnaire 70% satisfied Accepted level Recorded documents ·Questionnaires ·Results report Number of resources edited by the trainees based on the e-products Direct evidence 5 ·List of resources edited on e-platform by the trainees and accepted by trainers’ teams WP IV– Objective 4.3.

18. Objectives Quality indicators Unit of measure Measurement methods Accepted level Recorded documents 5.1. Designing the training programs according to the training programs objectives Level of correspon-dence between curricula and training programs objectives Number of modules/subjects/contents related to each training program objective Direct observation One module/2 contents per each objective of the training program ·List of training program objectives ·Curricula ·Validation reports WP V– Objective 5.1.

19. Objectives 5.2. Achieving the objectives of the training program Quality indicators Adequateness of selection process Unit of measure % of people selected presenting the requested characteristics related to the total of people selected Comparison between the number of people selected presenting the requested characteristics related and the total of people selected Measurement methods 80% Accepted level Recorded documents ·Procedure of selection ·List of candidates ·Selection report ·List of participants Degree of acquisition of knowledge and skills Average mark obtained to the final test Evaluation of the final test (mark) 7 ·Tests ·Graduation certificate ·Attendance certificate ·List of graduates Level of trainees’ satisfaction about the training programme quality Average mark obtained in the questionnaires Questionnaire 70% satisfied ·Question-naires ·Results report WP V– Objective 5.2.

20. Objectives Quality indicators Unit of measure Measurement methods Accepted level Recorded documents 6.1. Organisation and development of LLL Centre in ETEE Capability of the LLL Centre in ETEE Number of teaching staff Direct evidence 30 Organization chart ·List of services ·List of human resources Number of courses provided Direct evidence 3 ·List of courses Number of training places Direct evidence 12 ·Chart of the location Existence of procedures and regulations Direct evidence Presence ·Status Organization chart Development and maintenance of the centre after the project ends. Existence of a marketing plan Direct evidence Presence ·Marketing plan ·Protocols among the partners WP VI – Objective 6.1.

21. Objectives 6.2. Development of quality assurance procedures Existence Quality indicators N.A. Unit of measure Direct evidence Measurement methods Presence Accepted level Recorded documents Quality procedures quality tools 6.3. Development of links with the social-economic environment Existence and representati-veness of the Beneficiary Advisory Group (BAG) Existence of representatives in ETEE field Direct evidence Presence List of members Activity plan Meeting minutes WP VI – Objective 6.2-6.3

22. Thank you!