1 / 17

Step by Step In Vivo E xperimentation Lecture 3 for the IV track of the 2011 PSLC Summer School

This lecture provides a step-by-step guide to running in vivo experiments, from becoming an expert in a content area to reporting results to the scientific community. Topics covered include hypothesis generation, material development, study design, and data analysis.

sfrederick
Download Presentation

Step by Step In Vivo E xperimentation Lecture 3 for the IV track of the 2011 PSLC Summer School

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Step by Step In Vivo ExperimentationLecture 3 for the IV track of the 2011 PSLC Summer School Philip Pavlik Jr. Carnegie Mellon University

  2. So, you want to run an in vivo experiment? • What is in vitro? • Self-explanation (Chi, Bassok, Lewis, Reimann, & Glaser, 1989) • What is in vivo? • Example take from: • Booth, Siegler, Koedinger & Rittle-Johnson (2008)

  3. Step 0 Become an expert in a content area (e.g., electrodynamics). Find a textbook Talk to an expert (Potentially the most time consuming step.)

  4. Step 1 • Hypothesis • Self-explanation: A self-generated explanation of presented instruction that integrates the presented information with background knowledge and fills in tacit inferences. (from pslc wiki) • Correct examples • Facilitate construction of high-feature validity knowledge components. • Incorrect examples • Weaken low-feature validity knowledge components.

  5. Step 2 • Select a domain • Algebra, geometry, physics, chemistry, Chinese, English • Select a LearnLab site • Riverview High School • Central Westmoreland Career & Technology Center • Talk with instructors • Collaboratively identify “hot spots” in curriculum.

  6. Step 3 • Develop materials • Assessments • Tutor implementation • Get IRB approval.

  7. Corrective self-explanation explanation of incorrect worked example

  8. Typical self-explanation explanation of correct worked example

  9. Step 4 Design Study Self-Explanation of Incorrect Examples

  10. Step 5 • Formulate a Procedure • Pretest • Two forms of the assessment • Intervention • Solve problems with Cognitive Tutor Algebra • Post-test • Talk alternate form of assessment

  11. Step 6 • Run experiment • Collect log files • Collect paper-based assessments • Send Log Data to DataShop • Test Hypotheses

  12. Step 7 • Report your results to the scientific community • Create a wiki page • Give a conference talk • Write a journal paper

  13. Number of correctly answered problems

  14. Number of conceptual errors

  15. Goto Step 1 • Using the results from your in vivo experiment: • Replicate with a new population • Replicate with a new domain • Replicate and Extend in a lab experiment

  16. Summary • Step: 0. Become an expert • Generate a hypothesis (in vitro => in vivo) • Select domain, site, instructors • Develop materials • Design study • Formulate a Procedure • Run experiment & log to DataShop • Report your results • Goto Step 1

  17. Any Questions?

More Related