330 likes | 342 Views
GA is a grammar tutoring system designed for non-native English learners and TOEFL test takers. It utilizes intelligent tutoring technology to provide personalized, effective one-to-one tutoring sessions. The system follows established theoretical principles, including clear articulation, expert knowledge modules, and immediate error feedback. Through a structured approach and Anderson's design principles, GA offers a tailored learning experience. Version 2 introduces a rolling question approach to address difficulties and improve user engagement.
E N D
THE GRAMMAR TUTOR Ben Parent Haibei Zhang Huong Huang Jasdeep Singh
Introduction • GA is a grammar tutor for non-native English learners / TOEFL test takers • One-to-one tutoring has been proven to be effective • Transfer
Theoretical Background • Intelligent tutoring system (ITS) is a computer program that simulates human, one-to-one tutoring
Theoretical Background • Learning by being told: • Clear articulation • Clear diagnosis
Theoretical Background • Structure: • Expert knowledge module • Student knowledge module • Tutoring module • User interface
Theoretical Background • Design principles of Anderson tutors: • Production rules • Immediate error-feedback • Path-control actions
r r Pre-test* Pre-test Next question w r w r Level 0 Level 0* w r w Level 1 w r Level 2 “r” denotes “production rule based on a right answer” “w” denotes “production rule based on a wrong answer” ”*” indicates “correct answer detected, any more wrong answers are considered typos.” w Theoretical Background • An example structure: Miss. Lindquist:
Initial Design Concerns • Mimic TOEFL-style questions • Test one knowledge point per question • Fit into our model-tracing, multiple-choice scenario • “Grammar & Structure” Section
3-Part Structure • Pre-Test • Error-Logging Screen • Tutoring • Consistent with Anderson’s three main tenets of the model-tracing strategy • Production rules, Immediate error-feedback, Path-control actions
Version 1 screen shot • Log-in screen and welcome screen
Pre-Test • Short group of questions (20-30) drawn from all knowledge points • Designed to identify and make explicit the most common error category
Version 1 screen shot Pre-test question
Error-Logging Screen • Compares user’s answers with correct answers • Identifies main area of difficulty • Logs pre-test score for later review by either user, teacher or designer
Version 1 screen shot Error-Logging Screen
Tutoring • Each package designed to tutor one knowledge point • Consists of short lesson and a problem set • 3 levels of difficulty
Version 1 tutoring structure Brief Lesson Level 3 r r w r w Level 2 Level 3 r r r w w Level 1 Level 3 r w Level 1 Congratulations w Level 1 “r” denotes “right answer” “w” denotes “wrong answer” w Resources
Problems • Enormity of domain (grammar) with thousands of production rules • Not like Ms. Lindquist, which works in a very specific domain (symbolization) • Many rule exceptions, which are simply declarative knowledge points • Possible solution: limit knowledge points covered to “most difficult”
Problems • Informant design needed • Informant design necessary to determine “most difficult” points • Informant design would be necessary to develop an effective hinting structure
Problems • Program tutors only one knowledge point before exiting user • Virtually inconceivable that a user would need tutoring on only one knowledge point
Version 2: current design • Decision to limit knowledge points to “most-difficult” • Some informant design done • Pre-test elimintated
Version 2: current design • “Rolling question” approach that tests user on all knowledge points • determine a hierarchy of difficulty for the user (among knowledge points), • Focuses user first on the knowledge points he/she has the most difficulty with.
Rolling Question Approach • Top question level most difficult • User stays at top level until question answered wrong • # of correct questions record, once five of one category answered, that knowledge point drops out • When user gets a question wrong, he/she immediately drops into tutoring
First question n’th question Last question D Start Exit Level 0 C A B You chose A Why? You chose B Why? You chose C Why? Level 1 R1 R2 R3 R1 R2 R3 R1 R2 R3 AR1 AR2 AR3 BR1 BR2 BR3 CR1 CR2 CR3 Level 2 AR1Q AR2Q AR3Q BR1Q BR2Q BR3Q CR1Q CR2Q CR3Q Level 3 ABC ABC ABC D D D Congrat. Resourse Congrat. Resourse Congrat. Resourse Level 4 Version 2 tutoring structure
Version 2 screen shot • Welcome screen
Version 2 screen shot • Initial question
Version 2 screen shot • If your answer is wrong …
Version 2 screen shot • Hinting screen
Version 2 screen shot • Now, try another simpler question
Version 2 screen shot • Congratulations, you get it correct!
Version 2 screen shot • Auxiliary function: user activity log
Version 2 screen shot • Auxiliary function: save/open user profile
Version 3 tutoring structure • Blah…