Student reports during MapleTA electronic homework

1. Student reports during MapleTA electronic homework Christopher S HlasUW-Eau Claire, Mathematics Educationhlascs@uwec.edu Robert G Cypher UW-Eau Claire, student researcher

2. Overview • MapleTA • Flow theory • Calculus I, Fall 2009 (Math 114) • Results / Conclusions Flow & MapleTA (WMC, 2010)

3. What is MapleTA? • Maplesoft: Maple engine for homework problems • Pros • Problem types instead of specific problems • Immediate feedback • Cons • Computer issues (version 5) • Correct / incorrect feedback • Maple syntax & student frustration • Demo Flow & MapleTA (WMC, 2010)

4. What is flow? To be in the "flow" means: • Focus • Interest • Control • Goals/feedback Flow & MapleTA (WMC, 2010)

5. Flow theory(aka. optimal experience) -- Csikszentmihalyi, 1997 Flow & MapleTA (WMC, 2010)

6. ... • “Some people climb mountains whereas others make up tunes at a piano or push chess pieces across a board is in a sense incidental to the fact that they are all exploring the limits of their abilities and trying to expand on them.” • -- Csikszentmihalyi, 1975, p. 30 Flow & MapleTA (WMC, 2010)

7. Flow &MapleTA • Maple T.A. should lead students to Flow more easily than traditional methods. • Immediate external feedback • Consistent level of challenge • Ability to retake assignments Flow & MapleTA (WMC, 2010)

8. Study design • College students in Calculus I course • Volunteer, students could opt-out • Student complete survey randomly inserted into MapleTA homework • 6 weeks, 2 assignments per week • May retake assignments up to 5 times Flow & MapleTA (WMC, 2010)

9. Sample survey: Flow • On the scale of 1-10, how challenging is this problem? • On the scale of 1-10, how skilled are you with this type of problem? • Did you enjoy this problem? • Which of the following words best describes your feeling toward this problem?(bored, focused, frustrated, relaxed) • Was it difficult to keep your mind on this problem? • Do you feel that you have given yourself sufficient time to complete this problem? Flow & MapleTA (WMC, 2010)

10. Sample survey: Demographics • On what day of the week are you completing this assignment? • At what time are you completing this assignment? • Where are you working on this assignment? • On a scale of 1-10 how distracting is the surrounding environment? • How many times have you taken this particular assignment? Flow & MapleTA (WMC, 2010)

11. Results • Participants completed an average of 22.8 surveys each (σ = 11.33). • 619 surveys were attempted out of 767 (80.7%) assignments. • 549 surveys (88.6%) were complete. Flow & MapleTA (WMC, 2010)

12. What time is HW first attempted? Flow & MapleTA (WMC, 2010)

13. What day is HW “first” attempted? Flow & MapleTA (WMC, 2010)

14. Day of “first” attempt (combined) Flow & MapleTA (WMC, 2010)

15. Students rely on instructor’s schedule for time management instead of themselves. Takeaway #1

16. Enjoyment Flow & MapleTA (WMC, 2010)

17. Feeling Flow & MapleTA (WMC, 2010)

18. Chal/Skill by Feeling (95% Confidence interval) Flow & MapleTA (WMC, 2010)

19. Student perceptions of challenge and skill continue to be good predictors of “flow”. Takeaway #2

20. Student Averages for Skill/ Challenge Flow & MapleTA (WMC, 2010)

21. Challenge and Skill Averages Based On Student Rating of Feeling (95% Confidence interval) * Significantly different at p<0.05 (ANOVA w/ Tukey Post-Hoc Flow & MapleTA (WMC, 2010)

22. Correlation Results Skills • with Enjoyment (.224*) • with Correct Responses (.176*) • with Assignment Scores (.226*) • with Challenge (-.277*) Enjoyment with Challenge (-.411*) Flow & MapleTA (WMC, 2010)

23. Correlation Results Skills • with Enjoyment (.224*) • with Correct Responses (.176*) • with Assignment Scores (.226*) • with Challenge (-.277*) Enjoyment with Challenge (-.411*) • Challenges are growing too fast for most students • Students feel a lack of control regarding the challenge level Flow & MapleTA (WMC, 2010)

24. Significance • 45% of the time students were either frustrated or bored • Frustration implies content being too difficult • Boredom implies content being too easy • Enjoyment and challenge relationship is opposite of expected Flow & MapleTA (WMC, 2010)

25. Challenges and skills are unbalanced. Takeaway #3

26. Recap • Students need guidance for how to study mathematics • Students need better balance of challenges and skill development (perception) • More choice in difficulty? • Targeted skill development? • HW and quiz structure • Challenge and skill need further investigation Flow & MapleTA (WMC, 2010)

27. Limitations • Instructor was researcher • MapleTA 5 installed days before classes began • Assignment extensions • Student frustration Flow & MapleTA (WMC, 2010)

28. QA / Resources • Csikszentmihalyi, M (1997). Finding Flow: The Psychology of Engagement with Everyday Life. New York, NY: Basic Books. • Csikszentmihalyi, M (1990). Flow: The Psychology of Optimal Experience. New York, NY: Harper Perennial. • “Maple T.A. 5" Maplesoft. http://www.maplesoft.com/products/mapleta/ Flow & MapleTA (WMC, 2010)