150 likes | 259 Views
CEQuery Application. Julie – Ann Pegden Curtin University. 2:30 – 3:45. Post CEQuery comments analysis. Julie-Ann Pegden . Final product... . 2 step process. Step 1 – CEQuery scores the comments
E N D
CEQuery Application Julie – Ann Pegden Curtin University 2:30 – 3:45
Post CEQuery commentsanalysis Julie-Ann Pegden
2 step process • Step 1 – CEQuery scores the comments • Step 2 – IBM SPSS Text Analytics for Surveys further categorises comments and produces the diagram
Background - eVALUate • Curtin’s online system for gathering and reporting student’s perceptions of their learning experience • Unit survey comprises 11 quantitative items and 2 qualitative items: Please comment on the most helpful aspects of the unit Please comment on how you think the unit might be improved
How we use CEQuery in eVALUate Report at multiple levels: • University • Faculty • Teaching school/dept • Course • Unit • Or by other demographic breakdown (eg. grade, campus, year of study, mode of study, unit size, etc.)
How we report CEQuery results • Routine eVALUate reporting • Course review • Adhoc basis by request (eg. by unit/course coordinators)
What do we do post CEQuery? • More indepth/fine grained analysis of comments from single domain or sub-domain or a combination of subdomains • Supplementary to the CEQuery results • Focus on the needs improvement sub-domain(s) with the highest counts and/or ratio of comments
Why is it worthwhile? Time saving (eg. units with high enrolments - rather than reading a multitude of both BA and NI comments, a busy unit coordinator gets to see the main issues “at a glance”). Gives the issues as well as the extent of the problem (theme counts)
Requirements? Same Best Aspects and Needs Improvement open-ended questions as CEQ Minimum number of comment hits before it would be worth creating a visualisation – 100? Software - SPSS Text Analytics for Surveys (site licence?)
Considerations... • Confidentiality/sensitivity issues: • No raw comments are reported - themes only • How much time to spend carrying out the analysis? • Dictionary – modified for unit level use
Julie-Ann Pegden Curtin Teaching and Learning J.Pegden@curtin.edu.au