1 / 23

OUM SEMINAR SERIES

OUM SEMINAR SERIES. LATIFAH ABDOL LATIF 29 MARCH 2016. Course Evaluation of Online Courses. Instrument: Survey Administration: Data Analysis:

steveng
Download Presentation

OUM SEMINAR SERIES

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. OUM SEMINAR SERIES LATIFAH ABDOL LATIF 29 MARCH 2016

  2. Course Evaluation of Online Courses • Instrument: • Survey Administration: • Data Analysis: • Data were retrieved from the Survey Monkey portal on 28 Sept 2015. The original data file downloaded from the Survey Monkey portal comprised 734 cases. Only 397 were used for final data analysis; • Data cleaning and data analysis were carried out using SPSS Statistics 22; • Text responses were not included in the analysis (requires SPSS Text Analytics software)

  3. Demographic Variables

  4. Time spent logging in online learning

  5. Reliability of Instrument • A reliability analysis was undertaken to determine the internal consistency of the 2 rating scale constructs in the study, i.e. (I) 7 items under “My e-Tutor” construct, and (II) 17 items under “Course Learning Outcomes” construct. Table 1 shows the reliability coefficients (Cronbach alpha). • The high values of Cronbach Alpha indicate well-constructed scale items and the respondents did not face problems in interpreting the questions. This also shows the relatively good questionnaire construction techniques used and the good understanding of respondents.

  6. RESULTS

  7. The 9 Items on Online Course evaluation • Looking at questions 15 – 23 which evaluates the fully online courses; • 15 out of the 35 courses were analysed (to ensure no. of respondents >4); • Average of the exam mean scores for Sept’14, Jan’15 and May’15 were used for each course;

  8. MEANS FOR THE 15 ONLINE COURSES

  9. Course Evaluation Items: Q15-23

  10. Course Evaluation Items: Q15-23

  11. Online Course Evaluation

  12. Online Course Evaluation

  13. Results Courses with lowest exam mean score & lowest in Quality of Teaching and Overall Satisfaction: • BBPM2103: MARKETING MANAGEMENT I • CBKI4103: KNOWLEDGE MANAGEMENT • CBAD2103: SYSTEM ANALYSIS AND DESIGN Courses lowest in Overall Satisfaction: due to Quality of teaching, Assessment, Clarity of LO, etc. : • MPW1153: MORAL EDUCATION • MPU3223: ENTREPRENEURSHIP • MPW2153: MORAL EDUCATION

  14. Background 1. In OUM, evaluation of COURSES has not been carried out consistently throughout the faculties.; 2. However, for all PROGRAMMES offered, an external examiner is invited to carry out an evaluation of the programme, after going through almost a full cycle; 3. This is a onetime evaluation which does not allow for formative feedback wherein improvements can be instituted along the students’ study cycle; 4. ITLA monitors and evaluates tutors’ performance through a tutor evaluation exercise. However, the results are not integrated with students’ feedback on the course that they are taking; 5. This makes it difficult for OUM to introduce specific intervention in improving the course as the evaluation of the tutors and the courses are not done in an integrated manner.

  15. Why implement this system-wide evaluation? Implementing this university wide survey will help OUM in the following ways: • for curricular and pedagogic review & reform and decision making. Data can be also be used to help institutions identify, promote, and demonstrate effective T&L; • for quality improvement and also managing academic performance, professional development of tutors, academic performance rewards, promotion processes and as key performance indicators for academics (in the aspect of T&L); • the qualitative data can be used by academics as feedback to support and improve their academic practice (T&L);

  16. Research Questions 1. What are the student’s perceptions of their learning experiences in fully online courses? 2. What tutor attributes do students perceive that help them learn? 3. What tutor attributes do students perceive that hinder their learning?

  17. Course Evaluation Quantitative items : 1-11 Using the 1-4 Likert-Type scale: (1: Strongly Disagree; 2: Disagree; 3: Agree; 4: Strongly Agree) 1. The learning outcomes in this course are clearly identified. The learning outcomes are what you are expected to know, understand or be able to do in order to be successful in this course.  2. The learning experiences in this course help me to achieve the learning outcomes. The learning experiences could include: face-to-face tutorials, laboratories, clinical practicums, learning tasks/activities, online forum, online interactions, etc  3. The learning resources in this course help me to achieve the learning outcomes. Learning resources could include print modules, multimedia and online study materials, and equipment available in laboratories, clinics or studios, digital library materials, etc  • The assessment tasks in this course evaluate my achievement of the learning outcomes. Assessment tasks are those which are rewarded by marks or grades or feedback. Assessment tasks directly assess your achievement of the learning outcomes. • Feedback on my work in this course helps me to achieve the learning outcomes. Feedback includes written or verbal comments on your work. 

  18. Course Evaluation 6. The workload in this course is appropriate to the achievement of the learning outcomes. Workload includes reading, researching, group activities and assessment tasks.  7. The quality of teaching in this course helps me to achieve the learning outcomes. Quality teaching occurs when knowledgeable and enthusiastic teaching staff interacts positively with students in well-organised teaching and learning experiences. Items 8-11 ask students to report on their motivation, enthusiasm and commitment in the learning experiences and their overall satisfaction with the course. 8. I am motivated to achieve the learning outcomes in this course. Being motivated means having the desire or drive to learn, to complete tasks and to willingly strive for goals.  9. I make best use of the learning experiences in this course. I prepare for and follow up on the learning experiences offered in this course.  10. I often think about how I can learn more effectively in this course. I take time to think about how I can learn more effectively.  11. Overall, I am satisfied with this course. Overall, this course provides a quality learning experience.

  19. Course Evaluation Qualitative items  12. What are the most helpful aspects of this course?  13. How do you think this course might be improved?

  20. Tutor Evaluation Quantitative Items: 1-7: using the 1-4 Likert-type Scale 1: Strongly Disagree; 2: Disagree; 3: Agree; 4: Strongly Agree for each item. [The Tutor's name]: ………………………………… • Is knowledgeable in the subject areaThe tutor has a good understanding of the subject. • Is enthusiastic in teaching the course The tutor makes the subject interesting and conveys his or her enthusiasm for the subject. 3) Is well organisedThe tutor has material prepared on time, is punctual and structures activities in ways that help learning. 4) Communicates clearlyThe tutor is easy to understand in face-to-face, online, written and other formats and explains concepts clearly.  5) Is approachableThe tutor encourages students to ask questions and seek help.

  21. Tutor Evaluation 6) Provides useful feedbackThe tutor provides timely and helpful feedback so you can learn. 7) Is an effective tutorOverall, this tutor helps you to learn. Qualitative items 8) Please comment on the tutor's teaching strengths. 9) Please comment on how you think the tutor might improve the teaching and learning in this course

  22. Thank you

More Related