200 likes | 322 Views
The move to flexible delivery mode unit of study evaluations. by Talitha Bennett and David De Bellis Flinders University. Overview. Introduction Administration Survey Volume Take Up Rates Response Rates Level of Response Feedback. Intro. Overview of Flinders
E N D
The move to flexible delivery mode unit of study evaluations by Talitha Bennett and David De Bellis Flinders University
Overview • Introduction • Administration • Survey Volume • Take Up Rates • Response Rates • Level of Response • Feedback
Intro • Overview of Flinders • Paper system SETs 1991-2008 • New system from 2009 (UNSW) • Choice of paper or on-line • Got through it :) • Review of first half of 2009
Survey Pre-registration • One topic and teacher evaluation • Different spec for each AOU • Automatic generation of surveys • Alleviate admin burden on (academic) staff
Support • Power users in each AOU with the ability to set up surveys for Academic Staff • Centralised support from Planning Services Unit
Training • Half day workshops • One hour lecture/demos • 1-1 training in report retrieval for Heads of School • Special training sessions as requested by individual areas
Survey Volume TOPIC EVALUATIONS 450 to 1,150 (156%)
Survey Volume TEACHER EVALUATIONS 868 to 1780 (105%)
Take Up Rates 88% SURVEYS ON-LINE
Response Rates TYPICAL DROP OF ~ 20%
Response Level Overall I was satisfied with the quality of this topic • TOPIC EVALUATION • SAME 156 TOPICS • P 2008 v OL 2009 • MORE POLARISED BUT OVERALL IMPROVED?
Response Level • TEACHER EVALUATION • SAME 57 TEACHERS • P 2008 v OL 2009 • AGAIN MORE POLARISED BUT OVERALL IMPROVED? Overall, this person is effective as a university teacher
Response Level • EHLT TOPIC EVALUATION ATYPICAL • SIGNIFICANTLY LOWER RATINGS • NEED TO LOOK AT TOPICS
Conclusions • Volume of Surveying has more than doubled • 88% Take Up Rate for On-line surveys • Response Rates have behaved typically & dropped by ~ 20% • No wholesale degradation of response level
Staff • Central support was appreciated • User manual or on-line help • Saving time and paper • Response Rates
Students • Short student interviews video