Briefing session on Online Student Evaluation of Teaching and Learning for Teachers

1. Briefing session on Online Student Evaluation of Teaching and Learningfor Teachers Prepared by Social Sciences Research Centre of The University of Hong Kong 1

2. SETL process • SETL form covers course, teachers, tutors and demonstrators • Uses SIS database record of course/teacher/tutor/demonstrator • All teachers/tutors/demonstrators must have staff ID (HKU requirement and needed for staff review) • All courses with enrollment of at least 2 students must undertake SETL (unless VP(T&L) agrees – limit is 5 students for paper), although the teacher/tutor/demonstrator parts are only done if there are such persons for the class • Must use standard forms unless VP approves • Tutor means person running tutorials, demonstrator means person responsible for lab or field sessions (role descriptions) 2

3. Online SETL process • This year, online process covers all undergraduate (including Common Core) and taught postgraduate courses following the normal semester teaching schedule • Separate online forms for course, teacher, tutor, demonstrator as needed. Up to 25 teachers can be evaluated, but only 1 tutor or demonstrator selected from a list (or evaluated as a group) • Cannot change teacher names in system, which come from Human Resources • Online yields lower response rates, but better open-ended responses, which is good for improvement • To ensure good response rates, need to ensure that students are given time at the end of a class to complete the form (although they can complete any time before the deadline) 3

4. SETL Workflow Prepared by Social Sciences Research Centre of The University of Hong Kong 4

5. SETL Workflow • SIS list of courses with teacher/tutor/demonstrator names and indication of whether online or paper process will be sent out to departments on or before 9 Oct, so departments can check for errors and missing information (Please refer to Course List, Teacher List, Tutor List and Demonstrator List). • SIS system will re-open for any data amendments between 9 and 23 Oct • The final SIS list of courses with teacher/tutor/demonstrator names will be sent out to departments on or before 2 Nov for the final check. If any errors occurs, please contact SSRC through email setl@ssrc.hku.hk immediately (on or before 6 Nov). 5

6. SETL Workflow • For the Department Items (max. 5 extra questions) for both on-line and paper evaluation forms, please contact and confirm with SSRC staff, Ms. C.C. Ho at 3917-1623 or hocc@hku.hk on or before 23 Oct. • For the paper evaluation forms, the departments should inform SSRC for printing at least 2 weeks before the evaluation date. Departments collects the blank forms plus a survey package and carries out the evaluation. • For the on-line evaluation, SSRC will send out 3reminder emails on 9November, 30 November and 4 December 6

7. Instructions for Online SETL Before administration • The teacher concerned should inform the students in advance the date of the online evaluation (soon after Nov 9), and that the students are encouraged to bring a mobile internet device (such as laptop, tablet or smartphone) to class at the scheduled time. 7

8. Instructions for Online SETL On the day of administration • Similar to the paper exercise, the SETL questionnaire should NOT be administered by the course teacher, but Faculty/department staff. • The teacher should briefly explain the objectives of the student evaluation and then leave the room leaving it to Faculty/department staff to oversee the process. 8

9. Instructions for Online SETL Faculty/Department staff should • read out: “Please go to the weblink http://setl.hku.hk where you should see a list of all forms that you need to complete. Your evaluation will be saved anonymously, without any identification. There are separate forms for the course, teacher (and if appropriate) tutor and demonstrator. There are instructions, an FAQ link and a link for you to report any missing courses at the weblink.” 9

10. Instructions for Online SETL Students should • Access the SETL system via the weblink http://setl.hku.hk/ where there are instructions, FAQ and a list of forms for completion (separate links for the course, teacher, tutor, demonstrator forms) • Complete the forms for the class between Nov 9 and Dec 7 • if they cannot find the course that they have enrolled in, send an email to SSRC using the link on the page so SSRC staff can rectify this promptly 10

11. SETL Workflow • For the paper evaluation forms, departments should deliver to SSRC all completed forms, completed cover sheet on the top of each envelope and a completed packing list (Excel file) • Departments collect their evaluation reports, CD and completed forms (for paper evaluation forms only) upon notice from SSRC on or after 22 January 2016 (after the examination result release date 21 January 2016) 11

12. Instructions for Online SETL • I will now demonstrate Online SETL, so you can see how the process works in practice: http://setl.hku.hk 12

13. SETL results Will show up in APA for teachers and also in the online reporting system for all HKU staff. http://setl.hku.hk/report 13

14. I am happy to answer questions. You can find the SETL guide on the SSRC website under the SETL heading:http://www.ssrc.hku.hk/files/SETL_SSRC_Guide.pdf Prepared by Social Sciences Research Centre of The University of Hong Kong 14