130 likes | 255 Views
QA on AutoTutor 2004 paper. CPI 494, March 31, 2009 Kurt VanLehn. What did AutoTutor look like?. Animated agent + dialogue box; voice; Input from student = typed response; may be a couple of words Technology for voice = MS voice (Alan Black; LTI – Festivox)
E N D
QA on AutoTutor 2004 paper CPI 494, March 31, 2009 Kurt VanLehn
What did AutoTutor look like? • Animated agent + dialogue box; voice; • Input from student = typed response; may be a couple of words • Technology for voice = MS voice (Alan Black; LTI – Festivox) • There was version that understood speech, sortof • Gestures = Facial, hand waves inward, • Was version that pointed • Can switch faces; no big diff on gains & motivation • Absent agent may not make a different • Voice first then text
What was AutoTutor’s “script”? • Give overall question; first student turn = usually not complete or correct; • Tutor picks an aspect of the correct, complete answer and tries to get student to say it. • Tutor pump/prompts; • T hints; • T assert • Repeat for each missing aspect • Follow the student vs. own ordering • conceptual prereqs • Also answes the student’s questions
What is AutoTutor trying to teach? • Drive stueent with hints to articulate all the aspects of the ideal answer • Its main questions are deep • Constructivist practice; learn by (self-) questioning • Transfer studies? • Types of knowledge • Facts? Concepts? Procedures? Principles? • Facts are too shallow to benefit from AT vs. drill • Concepts OK • Princpiles, especially how to apply them • Could be procedure, but not perhaps the best;
How is AutoTutor different from human tutoring on the same content? • AutoTutor is based on shallower understanding of the student. Based on pattern match (LSA) between its ideal answer aspects and the student’s response. • Human’s do not use super sophisticated tutoring • Humans often do same remediation cycle • By-stander turing test
Is AutoTutor’s dialogue natural? • By stander test • May be is • Hand out dialogues later • Logic is screwy
In terms of learning gains, was AutoTutor effective? • All conditions similar on shallow questions • AutoTutor beat no-tutor and textbook on deep qustions and cloze questions • Interaction plateaus • Motivation unknow resutls…
How did AutoTutor analyze the student’s responses? • LSA • Bag of words (unordered list with duplicates allowed)
In terms of step-based tutoring, what are AutoTutor’s steps?
In terms of step-based tutoring, what feedback and hints exist for steps?