150 likes | 316 Views
Comparison of Effectiveness of Computer-Graded vs. Instructor-Graded Homework Assignments in an Elementary Spanish Course. Lt Col Richard Dabrowski, USAF Spanish/Portuguese Division Chief US Air Force Academy. Spanish Program at USAFA. Incoming Cadets
E N D
Comparison of Effectiveness of Computer-Graded vs. Instructor-Graded Homework Assignments in an Elementary Spanish Course Lt Col Richard Dabrowski, USAF Spanish/Portuguese Division Chief US Air Force Academy
Spanish Program at USAFA • Incoming Cadets • 844 out of 1262 took Spanish placement test [67%] • 80 placed at intermediate level or higher • 12 validated language requirement • Academic Courses [Fall 2010 enrollments] • Elementary [339] • Intermediate [177] • Advanced Composition [93] • Culture/Civilization and Current Events [35] • Literature [8]
Spanish Program at USAFA • Study Abroad Opportunities • Summer Immersion • Six countries [10 cadets each location] • One month • Spring Break Trips • Cultural Immersion • Academy Exchange Programs • Spain/Chile • Semester Abroad • Mexico [moratorium due to drug cartel violence]
Spanish Program at USAFA • No Foreign Language Majors at USAFA • 57 Spanish Language Minors in 2010 • 33 received 1+ or higher in both listening and reading on the DLPT • 17 received 2 or higher in both listening and reading • 4 received 3/3 on the DLPT • Not all success can be attributed to our Spanish program as numbers include heritage speakers, returned LDS missionaries, and others with extensive prior exposure to language.
Research study • Question: Any difference in results between instructor-graded and computer-graded exercises? • Instructor-graded exercises were time-consuming, often delays returning work to students, not read • Computer-graded exercises gave immediate feedback, however feedback was limited, technical difficulties • Specific circumstances of students of Spanish at USAFA favored computer-graded exercises, but with some doubt if this approach ‘cheated’ cadets of the richness of instructor feedback
Research study • Subjects: 226 cadets in first-semester/first-year Spanish divided into 14 sections. • 115 cadets in 7 sections had computer-graded exercises • 111 cadets in 7 sections had instructor-graded exercises • All cadets took the same chapter test at the end of the study period [three weeks] • All cadets requested to fill out satisfaction survey [146]
Results • Almost identical average scores • 158.68 out of 200 points for instructor-graded group • 158.48 out of 200 points for computer-graded group • Variation among sections • IG from 150.67 to 170.82 • CG from 145.58 to 170.94 • Same instructor results • ‘Instructor A’ for IG 162.13; IG 151.61; CG 145.58 • ‘Instructor B’ for IG 158.23; CG 158.90 • ‘Instructor C’ for IG 170.82 ; CG 156.29
Satisfaction Survey • Only 146 responses (65%) • Overwhelming preference for computer-graded exercises • 103 preferred only computer-graded exercises • 35 wanted a hybrid of CG and IG exercises • 8 preferred only instructor-graded exercises • Revelation that many cadets never or rarely read the instructor feedback
Comments • What do you like most about MySpanishLab? • Ease/Availability (24/146 = 16%) • Feedback (41/146 = 28%) • Learning (44/146 = 30%) • Specific Features (19/146 = 13%) • Miscellaneous
Comments • What do you like least about MySpanishLab? • Quantity (49/145 = 34%) • Timing/Time Spent (14/145 = 10%) • Quality (10/145 = 7%) • Learning (12/145 = 8%) • Specific Features (53/145 = 37%)
Lessons Learned • Find way to require cadets to read instructor feedback • Improve response rate on satisfaction survey • Ensure full cooperation of faculty • Explore what additional data can be collected from study • This fall semester, study will be expanded to both elementary and intermediate levels
Questions? richard.dabrowski@usafa.edu