Student Feedback Process and tips on increasing response rates

1. Student Feedback Process and tips on increasing response rates Shea Wang, Ph.D. Interim Faculty Evaluation Coordinator August 27, 2014 2014 Faculty Development Day

2. Roles related to Student Feedback • Faculty Evaluation Coordinator • develop resources • administer the student feedback system • first point of contact for information or assistance • The Faculty Evaluation Committee • steering committee for the student feedback system • make decisions with respect to implementing C5065

3. The faculty Evaluation committee • Mandate • “providing advice, support and recommendations in respect to the implementation of the instructional aspects of the Faculty Evaluation Policy (C5065), including approval of an overall framework and processes” • Composition • 9 faculty members, 3 administration members, 3 students, Faculty Evaluation Coordinator, 1 representative from Non-Instructional Faculty Evaluation Committee, 1 IT representative, 1 senior member of HR • More information: • http://www.macewan.ca/wcm/ExecutiveandGovernance/AcademicGovernanceCouncil/Sub-Committees/FacultyEvaluation/index.htm#1

4. Background: Transition from CoursEval to Blue • The Faculty Evaluation Committee passed a motion in Feb. 2013 to implement eXpolrance Blue/Evaluation as the core application to administer student feedback for faculty evaluation. • Pilot in the fall 2013 in FFAC. • Full implementation in the winter 2014.

5. Student feedback process Before(CoursEval) Now(Blue) Opt out courses Make changes directly in the system Instructors add questions in the system ITS and the Faculty Evaluation Coordinator configure the system, chairs opt out courses, instructors add additional questions, and the Faculty Evaluation Coordinator creates and releases the results. • Opt in courses • Make changes on spreadsheet • Additional questions -> Faculty Evaluation Coordinator->ITS • ITS configures the system, inputs all the courses that are identified by the department for evaluation, and releases the results; the Faculty Evaluation Coordinator works with chairs to finalize courses, troubleshoots, and runs additional data analyses.

6. Student feedback process All courses are opted in, except for courses with less than 7 enrolled students.

7. Student feedback process

8. Student feedback process – SVM

9. Student feedback process - SVM Do not leave the course opted in while all the instructors are opted out.

10. Student feedback process - QP

11. Student feedback process (SV) https://survey.macewan.ca/BlueEval/default.aspx https://myportal.macewan.ca/group/staff/faculty-evaluation Or Blackboard

12. 2014 Student feedback results • Where to find previous CoursEval results? • https://eval.macewan.ca/login.htm • Where to find Blue Evaluation results? • myPortal.MacEwan.ca>Applications>Faculty Evaluation • https://survey.macewan.ca/BlueEval/default.aspx • Choose Eval_Users as the data source • Click on Dashboard For more information: https://facultycommons.macewan.ca/services/faceval/student-feedback

13. Ideal response rates • A minimum percentage of students, depending upon the size of the class, must be present to do the ratings for the information to be considered representative and reliable

14. Acceptable response rates

15. 2014 Student feedback results • Response rates

16. Do online evaluations have lower response rates than paper? Constructive, informative, and encouraging instructor-student engagement around the course evaluation process is very important in maintaining or improving response rates (Norris & Conn, 2005; Johnson, 2002; Anderson et. al., 2006; Ballantyne, 2003).

17. Tips (see handout for more information) • Early reminder – 2 to 3 weeks prior • Reminders into term - check response rates • Make it an assignment • Give instructions • Stress the importance • Detail how the university and you use feedback • University of Oregon • Demonstration of how to • Provide the URL link • Remind students of the deadline • Explain the importance • Emphasize the anonymous nature • Reassure students that their responses will be taken seriously • Provide class time • (Nulty, 2008) Cont'd.

18. Tips • Explain the importance of students’ feedback • Reassure students that 1) responses are anonymous and 2) you will not see the results until after final grades are submitted • List “Complete student feedback survey” on syllabus as an assignment • Email reminders • Remind students of options to fill out surveys (smartphones, tablets, computers, and laptops) • Conduct your own midterm feedback • Give instructions on how to • Provide class time or schedule a time in a computer lab if necessary • Use your own creativity! • MacEwan University

19. The crucial factor in achieving high response rates is faculty involvement

20. Reports

21. Reports

22. Final words about Student feedback • Student feedback is important, but is NOT the only component of faculty evacuation • Peer reviews, teaching dossiers, and annual reports • Continue exploring the functionality of Blue to make it work best for faculty, administration, and students

23. Contact us! • https://facultycommons.macewan.ca/services/faceval/student-feedback • Shea Wang, Ph.D • Interim Faculty Evaluation Coordinator • wangx68@macewan.ca • 780-633-3591