160 likes | 367 Views
Platypus. A System to Support Online Peer Review & Rapid Feedback via a Highly Shuffled Process EAIT Faculty Teaching & Learning Development Program February 11, 2014. How Do We Design Assessment Now That It Is Online?. What can a computer do well that we do poorly?
E N D
Platypus UQ Robotics ·IxD A System to Support Online Peer Review& Rapid Feedback via a Highly Shuffled Process EAIT Faculty Teaching & Learning Development Program February 11, 2014
How Do We Design Assessment Now That It Is Online? UQ Robotics · IxD • What can a computer do well that we do poorly? • Grading (Feedback): • Students care a lot • Very important for learning(Deliberative Feedback) • Not the tutor’s favourite activity
Question-Based Shuffling Workflow Model UQ Robotics · IxD
Platypus: A Question/Answer Based System UQ Robotics · IxD
Platypus Example (METR 4202) UQ Robotics · IxD
Peer Feedback: Active area of learning research UQ Robotics · IxD
Some “Principles of Peer Review” Source: Colorado State University’s “Using Student Peer Review” Guide UQ Robotics · IxD • Excellence. Does this answer the question? • Is the answer complete, yet succinct and insightful? A good answer should have an excellent signal to noise ratio. Good feedback should too. Please resist irrelevant discussion. That is, Don't repeat yourself . • Clarity. Does it communicate the idea? • Is it written effectively? The solution should provide details, be understandable, have clear comments and, of course, be technically correct. It should allow you to use the idea instead of inventing it again. • Impartiality • All submitted solutions must be treated equally and valuated on their merits, irrespective of their origin. • Transparency • Decisions (particularly review scores) should be based on a solution rubric and/or course rules. • Efficiency and speed • Try to provide feedback as quickly as possible, for that is the point. You are allowed to add more feedback if you like later. • Leadership • Where possible, try to look beyond the rote answer and provide feedback on their process, trying to see past common errors. • Confidentiality and Integrity • Simply put, produce an earnest, quality review. Be honourable. You know what’s “right.” Just listen deep. The rules are in your subconscious.
Requires Good Rubrics UQ Robotics · IxD Consider the following Question:
Requires Good Rubrics [2] UQ Robotics · IxD
Requires Good Rubrics [3] UQ Robotics · IxD
Requires Good Rubrics [4] UQ Robotics · IxD
It’s Open… UQ Robotics
SQL + CakePhP UQ Robotics · IxD
Future Work UQ Robotics · IxD • Richer Inputs • [Matlab] Figures • Simple Diagrams/Sketches Rich media in general • Alternate Question Types • Lab Reports, etc. • User-Defined? • Team Submissions/Review • Visualization Tools
Future Work UQ Robotics · IxD A Better Equation Editor We are still looking
Come Join Us! Thank You ! UQ Robotics · IxD PitchR Grant Due to EAIT on 14/2/14 (I ♥ Deadlines!)