170 likes | 399 Views
Written Versus Digital Feedback; Which Improves Student’s Learning? Bryan Adams, Kayla Blyman, Bill Corson, and David Galbreath. Research Questions. Which results in higher learning in a college level probability and statistics course: paper-based homework (PBHW) or web-based homework (WBHW)?
E N D
Written Versus Digital Feedback; Which Improves Student’s Learning?Bryan Adams, Kayla Blyman, Bill Corson, and David Galbreath
Research Questions • Which results in higher learning in a college level probability and statistics course: paper-based homework (PBHW) or web-based homework (WBHW)? • What is the opportunity cost of electing to do PBHW? “The desired result of all introductory statistics courses is to produce statistically educated students, which means that students should develop the ability to think statistically” - GAISE College Report 2016
The Course Introduction to Probability and Statistics • Apply the axioms, theorems, and basic properties of probability to quantify the likelihood of events. • Use discrete and continuous random variables to model phenomena and answer basic probability questions. • Produce and interpret graphical displays and numerical summaries of data. • Understand and use basic ideas of statistical inference (hypothesis tests and confidence intervals) in a variety of settings. • Employ linear regression models in the context of statistical analysis; interpret and draw conclusions from the standard output of statistical software packages. • Communicate results of statistical analyses to general audiences. • Apply probability and statistics concepts to a variety of engineering topics. “Probability and Statistics for Engineering and the Sciences” by Jay L. Devore
Experimental Design PBHW: Sample Size (66) – 2x Instructors, each with 2x Sections (16 students) Option to revise and resubmit Instructor provides feedback* and returns the following class Instructor provides additional feedback/solution Student submits assignment Option to resubmit 3 times Student receives correct/incorrect feedback WBHW: Sample Size (66) – 2x Instructors, each with 2x Sections (16 students) * Instructor Feedback included location of error and textbook page/example reference
Demographics MA100: Precalculus MA103: Mathematical Modeling MA104: Single Variable Calculus MA153: Math Modeling/Intro to Differential Equations MA205: Multivariable Calculus MA255: Advanced Multivariable Calculus
Mathematical Background CQPA: Cumulative Academic GPA Core AVG: Core Classes Grade AVG MA103: Mathematical Modeling MA104: Single Variable Calculus MA153: Math Modeling/Intro to Differential Equations MA205: Multivariable Calculus MA255: Advanced Multivariable Calculus
Grade Comparison • Probability Theory • Problem Set 1 • Block 2 Exam • Statistical Inference • Problem Set 2 • Course Project • Block 3 Exam
Homework Submissions Over half of the students who used WBHW submitted all 23 lessons of homework
Student Perspective “I do not like [WBHW]. It is easily forgettable and I would rather do homework from the textbook.” (WBHW Participant) “homework takes much longer” (PBHW Participant) “[WBHW] is a great platform for homework. A lot of times though, the answer I came up with would be just slightly off…and I’d get it marked wrong.” (WBHW Participant) “time consuming” (PBHW Participant)
Student Perspective “I really like the written homework option because I believe that writing something down leads to a high chance of retention than typing or online work.” (PBHW Participant) “I liked it because it provided me immediate feedback.” (WBHW Participant) “I felt that I produced better work as a result of physically turning in my homework.” (PBHW Participant)
Conclusions Does one method of homework delivery promote better learning? • Limitations: • WBHW is typically focused on computations, PBHW can be used to provide open-ended problems that focus on conceptual understanding and the investigative process. • It is difficult to quantify and assess a student’s ability to think creatively. What’s the Opportunity Cost of PBHW? * A full teaching load for an instructor in MA206 at USMA is 4x Sections (Cost Estimate: 40 Hours per semester)
Conclusions Table 1: Analysis of Evidence of Learning based on the assessed grade of the final course average and the Final Examination Does one method of homework delivery promote better learning? What’s the Opportunity Cost of PBHW?