1 / 20

Pecha Kucha Presentation Alan Brown CHEP Annual Conference January 2013

“There are known knowns . These are things we know that we know. There are known unknowns. That is to say, there are things that we know we don't know. But there are also unknown unknowns. There are things we don't know we don't know.” Donald Rumsfeld, February 2002 .

zeno
Download Presentation

Pecha Kucha Presentation Alan Brown CHEP Annual Conference January 2013

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. “There are known knowns. These are things we know that we know. There are known unknowns. That is to say, there are things that we know we don't know. But there are also unknown unknowns. There are things we don't know we don't know.” Donald Rumsfeld, February 2002

  2. The use of regular multiple choice quizzes to enhance the development of students self-assessment and self-feedback skills PechaKucha Presentation Alan Brown CHEP Annual Conference January 2013

  3. 4 types of student? A thirteenth-century Persian poet, IbnYamin said there are four types of men: • One who knows and knows that he knows... His horse of wisdom will reach the skies. • One who knows, but doesn't know that he knows... He is fast asleep, so you should wake him up! Source: Wikipedia, 2013

  4. 4 types of student? • One who doesn't know, but knows that he doesn't know... His limping mule will eventually get him home. • One who doesn't know and doesn't know that he doesn't know... He will be eternally lost in his hopeless oblivion! • Our first job is to get students away from 4 Source: Wikipedia, 2013

  5. Fluid Mechanics in Year 1 • Brand new subject • Not on ‘A’ level physics or maths syllabus • Several new concepts • Pressure • Viscosity • Density

  6. Fluid Mechanics in Year 1 • Several ‘Old’ concepts • Forces • Velocity and Acceleration • Momentum • But these don’t look the same as in physics Assessments historically based on applied mathematical problems

  7. The problem • Enable students to find out what they know and do not know • This is the role of Feedback • Several new concepts requires lots of rapid feedback • I taught this module to 88 students

  8. The solution • Multiple choice quiz questions each week on Blackboard • Based on the previous week’s material • The adaptive release system is used to enforce the quiz questions

  9. Any attempt at the questions allows access to the next set of resources • Answers and feedback are given instantly • The questions are designed to test conceptual knowledge, not learned definitions • Class test uses similar types of multiple choice questions

  10. Result 1: Class test marks • Scores in the class test were similar to the previous year (applied maths problems) • Quiz designed to test the understanding of the new and old concepts • misunderstandings much easier to spot and correct than using applied mathematics type questions

  11. Result 1: Class test marks Feedback to correct conceptual misunderstandings given 1 week after the test

  12. Result 2: Predicting performance • Are students more aware of their own knowledge? • Students were asked to predict their grade: • Before they sat the test • After they sat the test • After they had seen all the answers

  13. Result 2: Predicting performance • With MCQs the students were much better at predicting their marks With MCQs Without MCQs

  14. Result 3: Engagement • Out of 88 students • 4 attempted none • 7 attempted 1 or 2 • 15 attempted 3 or 4 • 62 attempted 5 or more

  15. Result 3: Engagement • Student feedback on the MCQ system : • 87 % of respondents found the MCQs helpful or very helpful, • 5 % said they were unhelpful • Many students answered multiple times

  16. What have I learned • New concepts are difficult to learn • Students need to start from a position of self-knowledge • Applied mathematics is not an effective way of assessing conceptual knowledge • Most students will engage with feedback opportunities

  17. What I will do next • Check MCQ answers to try and determine misunderstandings earlier • Don’t wait until the class test • Refine teaching based on misunderstandings from last year • Enhance the automated feedback in the MCQs • Use MCQs to monitor engagement

  18. Conclusions • Rapid feedback should enhance students self-knowledge • MCQs used to give rapid automated feedback to 88 students on a weekly basis • Adaptive release gives an incentive without marking and assessment

  19. Conclusions • Students are better able to predict their marks • Students were overwhelmingly positive about the quiz questions • Engagement easy to assess • Hopefully fewer “Unknown Unknowns”

More Related