1 / 24

Chapter 11

Chapter 11 . Experimental Designs. Key Ideas. Definition and uses for experimental designs Procedures used in experimental research Internal and external validity threats in experimental research Types of experimental designs Steps in conducting experimental research

presta
Download Presentation

Chapter 11

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Chapter 11 Experimental Designs Power Point Slides by Ronald J. Shope in collaboration with John W. Creswell

  2. Key Ideas • Definition and uses for experimental designs • Procedures used in experimental research • Internal and external validity threats in experimental research • Types of experimental designs • Steps in conducting experimental research • Evaluating experimental research Educational Research 2e: Creswell

  3. What is experimental research? • In an experiment, you test an idea (or practice or procedure) to determine whether it influences an outcome or dependent variable. • Determine activities with which to “experiment” • Assign individuals to experience it (and have some individuals experience something different) • Determine whether those who experienced the activities (or practice or procedure) performed better on some outcome than those who did not experience it. Educational Research 2e: Creswell

  4. When do you use experimental procedures? • To establish cause and effect • Between independent and dependent variables • Control for all variables that might influence the outcome • Used when testing theories • Used when comparing two or more groups Educational Research 2e: Creswell

  5. How did experiments develop? • Psychological experiments (late 19th early 20th century) • Procedures for comparing groups (McCall 1925) • Statistics for comparing groups (e.g. Chi-Square) Identification of types of experimental designs (Campbell and Stanley 1963) • Types of basic designs and threats (Cook and Campbell 1979) • Complicated experiments with many variables (Since 1980) Educational Research 2e: Creswell

  6. Key Characteristics of Experimental Designs • Random assignment • Control over extraneous variables • Manipulation of the treatment conditions • Outcome Measures • Group Comparisons • Threats to validity Educational Research 2e: Creswell

  7. Random assignment • Randomly assign individuals at random conditions or to groups • Random assignment equates groups and distributes variability between or among groups and conditions • Different from Random Selection which is selection of participants at random Educational Research 2e: Creswell

  8. Control over extraneous variables • Extraneous Variables: influences in participant selection, procedures, statistics, or the design likely to affect the outcome and provide an alternative explanation results than what was expected. • Random assignment helps to control for extraneous variables • Done before the experiment begins Educational Research 2e: Creswell

  9. Control over extraneous variables • Other control procedures • pretest/posttest • covariates • matching participants • selecting homogenous samples • using blocking variables Educational Research 2e: Creswell

  10. Pre-Test and Post-Tests Intervention Time 1 Time 2 Pre-Test Post-Test Educational Research 2e: Creswell

  11. Controlling for Covariates Independent Variable Dependent Variable No Covariates Covariate Introduced Independent Variable: Type of Instruction Dependent Variable: Rates of Smoking Covariate: Parents Who Smoke Variance Removed Variance Educational Research 2e: Creswell

  12. Matching Process Based on Gender John Jim James Josh Jackson Jane Johanna Julie Jean Jeb Experimental Group Control Group Educational Research 2e: Creswell

  13. Manipulation of the treatment conditions • Identify a treatment variable • Identify the conditions or levels of the treatment variable • Manipulate the treatment conditions Educational Research 2e: Creswell

  14. Independent Variables 1. Age (can’t manipulate) 2. Gender (can’t manipulate) 3. Types of Instruction (can manipulate) a. Lecture (control) b. Lecture + Hazard Instruction (Comparison) c. Lecture + Hazard Instruction + slides of damaged lungs (experiment) Dependent Variable Frequency of Smoking The Experimental Manipulation of a Treatment Group Educational Research 2e: Creswell

  15. Outcomes • Criterion or effect variable • Outcome variable • Measured on a continuous scale Educational Research 2e: Creswell

  16. Phase 1: Relationship Picture Spelling Accuracy Error Correction Treatment Phase 2: Timeline Picture Test 1 Test 2 Test 3 6 Weeks 6 Weeks 6 Weeks 6 Weeks 6 Weeks 6 Weeks Class A: Regular Spelling Practice (Control) Class B: Reduced word list (Comparison) Class C: Error Correction (Experimental) Error Correction Treatment 6 Weeks 6 Weeks 6 Weeks Phase 3: Statistical Comparisons Class A Class B Class C F-value 10.3 (3.6) 10.8 (4.3) 9.9 (3.9) 0.27 Test 1 Test 2 Test3 10.6 (3.8) 13.9 (4.2) 10.7 (3.3) 4.90* 11.1 (3.3) 10.3 (3.6) 13.1 (3.8) 3.31* Group comparisons in an experiment + * p<.05 Educational Research 2e: Creswell

  17. History Maturation Regression Selection Mortality Interactions with selection Diffusion of treatments Compensatory equalization Compensation rivalry Resentful demoralization Testing Instrumentation Threats to internal validity Educational Research 2e: Creswell

  18. Threats to external validity • Interaction of selection and treatment • Interaction of setting and treatment • Interaction of history and treatment Educational Research 2e: Creswell

  19. Types of experiments: Between groups • True Experiments • Pre- and posttest • Posttest Only • Quasi Experiments • Pre • Posttest • Factorial Designs Educational Research 2e: Creswell

  20. Depression Medium High Low Mean rate of smoking Mean rate of smoking Mean rate of smoking Health lecture Main Effects of Type of Instruction Type of Instruction Mean rate of smoking Mean rate of smoking Mean rate of smoking Standard lecture Main Effects of Depression Means and Main Effects of Eight groups in Factorial Design Educational Research 2e: Creswell

  21. High High High Low Low Low Medium Medium Medium High High High Low Low Low Graphs Showing Main and Interaction Effects Standard lecture Health lecture • No Interaction Effects • (Parallel) Extent of Smoking (b) Interaction Effects (Crossed) Standard lecture Extent of Smoking Health lecture (c) Interaction Effects (Not Parallel) Standard lecture Extent of Smoking Health lecture Educational Research 2e: Creswell

  22. Types of Experiments: Within-group or individual • Time series experiments • interrupted • uninterrupted • Repeated measures experiments • Single-subject experiments • A/B design • Multiple baseline design • Alternating treatments Educational Research 2e: Creswell

  23. Steps in Conducting Experimental Research • Decide if an experimental design fits research problem • Form cause/effect hypotheses • Select experimental unit and identify study participants • Select an experimental treatment and introduce it • Choose a type of experimental design • Conduct the experiment • Organize and analyze the data • Develop an experimental research report Educational Research 2e: Creswell

  24. Criteria for Evaluating Experimental Research • Does the experiment have a powerful intervention? • Does it employ few treatment groups (e.g. only two)? • Will participant gain from the intervention(s)? • Is there a systematic way the researcher derived the number of participants (cell size)? • Was there an adequate number of participants used in the study? • Were valid, reliable, and sensitive measures or observations used? • Did the study control for extraneous factors? • Did the researcher control for threats to internal validity? Educational Research 2e: Creswell

More Related