200 likes | 326 Views
A framework for facilitating feedback best practises based on a study of staff and students. Dr. C. Higgins. Dr. S. Beesley. S. Nutbrown. The problem - NSS Scores for feedback. Particular Questions in that group. {. Feedback related. The importance of feedback.
E N D
A framework for facilitating feedback best practises based on a study of staff and students Dr. C. Higgins Dr. S. Beesley S. Nutbrown
Particular Questions in that group { Feedback related
The importance of feedback • First 42 student respondents, 77% said “Important” or “Very Important”.
Plan Survey Students Survey Staff Develop framework based on results. Analyse Results Iterate Focus Groups Consider surrounding literature Existing Systems
Methodology - Triangulation Questionnaire Interviews Focus Groups
Pilot Survey • Make sure we are asking the right questions. • Includes staff and student survey.
Students – Some questions, what we want to find out. • How can feedback be improved? • What do you think feedback is for? • What’s the most important part of feedback? • What do you do with feedback?
Staff – Some questions, what we want to find out. • Mirrored questions • How can feedback be improved? • What do you think feedback is for? • What’s the most important part of feedback? • What do you do with feedback?
Pilot Survey Results • 17 Students and 6 members of staff completed the pilot survey. • Why do you think you are given feedback? (Students): Improvement! (14/17) • What are the most important aspects of feedback? (Students): What was done badly and how to improve in the future. • How would you like to receive feedback? (Students): Online (12/17) • How can feedback be improved? (Students): Faster turnaround, improved handwriting, online notification, standardisation between modules.
Pilot Survey Results • 17 Students and 6 members of staff completed the pilot survey. • Why do you think you are given feedback? (Students): Improvement! (14/17) • What are the most important aspects of feedback? (Students): What was done badly and how to improve in the future. • How would you like to receive feedback? (Students): Online (12/17) • How can feedback be improved? (Students): Faster turnaround, improved handwriting, online notification, standardisation between modules.
What can we do? (Based on Pilot results so far) • Only pilot results, however: • Online delivery of feedback and grades (preferred) • Comment on both what was done well and what was done badly • Improve the turnaround time • Provide some method of standardisation between modules. • How can an electronic system help?
Considerations • Automated tools. eg Functionality Tests • Semi-Automated tools. eg Selections, similar to Turnitin • Feedback assistance. eg A method of helping to produce quality feedback • Online delivery. eg A flexible output to allow for upload to VLEs, or visualisations. • Requirements: Improve feedback turnaround time whilst ensuring to comment on both positive and negative parts of the work. Deliver the results online.
Tree structure - Combining automated, semi automated and manual marking.
Tree structure - Combining automated, semi automated and manual marking.
Resulting feedback • What was done well • What was done badly • Where to improve • How to improve (action) • Flexible – Currently given as flat text, but could provide full tree, or visualisations for each combination tool.
Future work Wider survey of students CourseMarker Experience Analysis of initial results (Surveys from markers / students) We are here Pilot survey of Students Framework Prototype Use in different disciplines Planned Focus groups Surrounding literature Exploration of new tools, new methods (e.g CBR) Existing Systems Surrounding research