Internet-based Performance-centered Learning Environment for Curriculum Support (IPLECS)

Catalina Martínez-Mediano and Nuria Rioperez cmarme@edu.uned.es MIDE I - Faculty of Education - UNED (SpanishUniversity for Distance Education) Internet-based Performance-centered Learning Environment for Curriculum Support (IPLECS)

CONTENTS • IPLECS • IPLECS Objectives • The project approach: PSS • Application of Performance-centered Approach in m-Learning (mPSS) • The evaluation projects strategies • The evaluation projects results • Conclusions

1. IPLECS • Internet-based Performance-centered Learning Environment for Curriculum Support (IPLECS) is a virtual campus platform for performance-centered reusable learning materials to apply in performance-centered settings to support university curriculum in physic-engineering education.

1. Previous works • IPSS_EE(Internet-based Performance Support System with Educational Elements) provide online access to the full range of information and guidance. • Performance-centred learning • Self-directed learning • Based on tasks • DIPSEILis a project, that add to IPSS_EE, • a distributed system • for individualized learning

2. IPLECS Objectives • Design a Master Degree, within the EHEA on Information and Communication System (ICS), • Apply the ICS master, by means of the DIPSEIL-IPLECS platform, in Plovdiv University, Bulgaria, • Evaluate the ‘ICS master’ in its design, during their application and in their results. • with the collaboration of 6 European universities (Plovdiv U, TUS Sofia, CIME-INP Grenoble, DEIS, Cork, OTC-OU Netherland, DIEEC-EDU-UNED, Madrid,

3. The project approach: PSS • Based in the ‘Principles of Electronic Performance Support System’ (EPSS), but evolved to the Higher Education System. • The EPSS concept includes the idea to provide information and help to the learner • just-in-time, • just-enough, and • just-at-the-point-of needed And needs computer support for an effective and efficient job performance.

3.1. The PSS concept in IPLECS • The concept of performance support system (PSS) in education, should consider the specific goals of higher education: • Students should be supported to perform the task, but also to understand the underlying processes and concepts.

4. PSS Workflow Modelto guide the curriculum design • The PSS Workflow Model is based in: • State a reference situation in which the students will use what they are going to learn • Formulate a few learning goals and clear and specific objectives oriented to competences • Create learning tasks, providing to the students: • Background information, • Examples, • Procedures and • Feedback, • Summative evaluation.

5. The evaluation projects strategies The evaluation strategy of the IPLECS and mPSS projects aims to study the total purposes, specially: • The coherence between every course in the ICS curriculum with the PSS Workflow Model (adequacy indicators), by means of the ‘PSS Validity Scale’ • The Students’ attitude to learn by computer, by one specific Questionnaire. • The usability and functionality of the platform (efficiency indicators), by means of the‘Computer System Usability Questionnaire’ • The ‘ Effect of PSS curriculum on students’ learning achievement in competencies’(efficacy indicators), by means of tests • The ‘Satisfaction with the curriculum and the IPLECS platform (when the course has finished) by means of Questionnaires, focus groups, interviews).

5. The evaluation projects strategies • To summarize: • Planned, enacted, experienced curriculum • Teachers’ and students’ experiences • By means of Quantitative and qualitative instruments and data analysis

6.The evaluation projects results6.1. The PSS Validity Scale (adequacy)

6. The evaluation projects results6.2. The attitude to learn by computer • Attitude is considered one variable that should be controlled, because one positive attitude or a negative one affects to our research purpose. • The questionnaire, of 20 items, Likert scale (1-5 less to maximal agree), was answered by 10 students. • The items with higher punctuation (4.5): • I enjoy working in internet environment; • I find very positive the idea of using computers and Internet by study different subject matters. • The items mean: 4.26 showing a positive attitude.

6. The evaluation projects results6.3. The Computer System Usability Q. • A questionnaire on usability and functionality of the IPLECS platfom, of 19 items, Likert scale, 1-7, maximal disagree to maximal agree with the item. • The items better valuated: • It was easy to learn to use the system (6.60) • The organization of information on the system screens is clear • I am able to efficiently complete my work using the system • Mean=5.94, S.D.=0.267, show a positive valuation and agreement between the students.

6. The evaluation projects results6.4. Effect of PSS curriculum on students achievement in competencies’(efficacy) Two subjects have been evaluated: 1. Introduction to Information and Telecommunication Systems

6. The evaluation projects results6.4. Effect of PSS curriculum on students’ achievement in competencies’(efficacy) 2. Advanced Electronics for Information and communication Technology

6. The evaluation projects results6.5. Satisfaction with the ICS curriculum and the IPLECS platform • The 'Reflective Questionnaire' on the general instructional design is applied in every course. • The questionnaire was integrated by 29 items, Likert scale, from 1 to 5, maximal disagree to maximal agree with the items. • We can see the resume of the descriptive statistics in two courses evaluated by the students.

6. The evaluation projects results6.5. Satisfaction with the PSS curriculum and the IPLECS platform

7. Conclusions • The PSS validity scale gives a heterogeneous results on the ICS courses in some items, but, in general the results show that the courses are aligned with the PSS Model. • The students’ attitude to learn by computer, is very positive and homogeneous. • The usability and functionality of the platform, present good evaluation on the screens organization and its easy learning. …

7. Conclusions • The ‘ Effect of PSS curriculum on students’ learning achievement in competencies’, in the subjects evaluated, have been very positive, with a very good marks. • The ‘Satisfaction with the PSS curriculum and the IPLECS platform on the courses evaluated, show a high satisfaction.

Lessons learned and improvement necessities • In order to get a better adequacy to the instructional purpose of the DIPSEIL and PSS models is necessary that the curriculum developer and the instructional group design make and effort to work together. • Some changes should be done in the different instruments to collect information, to refine they. • We need to analyze information collected by focus groups and interviews, add their results to our report.

THANK YOU !! .

Internet-based Performance-centered Learning Environment for Curriculum Support (IPLECS) Catalina Martínez-Mediano cmarme@edu.uned.es MIDE I - Faculty of Education- UNED (SpanishUniversity for Distance Education)

Internet-based Performance-centered Learning Environment for Curriculum Support (IPLECS)