170 likes | 313 Views
Step by Step In Vivo E xperimentation Lecture 3 for the IV track of the 2011 PSLC Summer School. Philip Pavlik Jr. Carnegie Mellon University. So, you want to run an in vivo experiment?. What is in vitro ? Self-explanation (Chi, Bassok, Lewis, Reimann, & Glaser, 1989) What is in vivo ?
E N D
Step by Step In Vivo ExperimentationLecture 3 for the IV track of the 2011 PSLC Summer School Philip Pavlik Jr. Carnegie Mellon University
So, you want to run an in vivo experiment? • What is in vitro? • Self-explanation (Chi, Bassok, Lewis, Reimann, & Glaser, 1989) • What is in vivo? • Example take from: • Booth, Siegler, Koedinger & Rittle-Johnson (2008)
Step 0 Become an expert in a content area (e.g., electrodynamics). Find a textbook Talk to an expert (Potentially the most time consuming step.)
Step 1 • Hypothesis • Self-explanation: A self-generated explanation of presented instruction that integrates the presented information with background knowledge and fills in tacit inferences. (from pslc wiki) • Correct examples • Facilitate construction of high-feature validity knowledge components. • Incorrect examples • Weaken low-feature validity knowledge components.
Step 2 • Select a domain • Algebra, geometry, physics, chemistry, Chinese, English • Select a LearnLab site • Riverview High School • Central Westmoreland Career & Technology Center • Talk with instructors • Collaboratively identify “hot spots” in curriculum.
Step 3 • Develop materials • Assessments • Tutor implementation • Get IRB approval.
Corrective self-explanation explanation of incorrect worked example
Typical self-explanation explanation of correct worked example
Step 4 Design Study Self-Explanation of Incorrect Examples
Step 5 • Formulate a Procedure • Pretest • Two forms of the assessment • Intervention • Solve problems with Cognitive Tutor Algebra • Post-test • Talk alternate form of assessment
Step 6 • Run experiment • Collect log files • Collect paper-based assessments • Send Log Data to DataShop • Test Hypotheses
Step 7 • Report your results to the scientific community • Create a wiki page • Give a conference talk • Write a journal paper
Goto Step 1 • Using the results from your in vivo experiment: • Replicate with a new population • Replicate with a new domain • Replicate and Extend in a lab experiment
Summary • Step: 0. Become an expert • Generate a hypothesis (in vitro => in vivo) • Select domain, site, instructors • Develop materials • Design study • Formulate a Procedure • Run experiment & log to DataShop • Report your results • Goto Step 1