Psych 5510/6510

1. Psych 5510/6510 Chapter 14 Repeated Measures ANOVA: Models with Nonindependent ERRORs Part 2 (Crossed Designs) Spring, 2009

2. Nonindependence in Crossed Designs Now we are going to look at crossed designs. Example: Each subject is measured once in both conditions (Experimenter Absent and Experimenter Present). Thus the effect of the independent variable is now showing up within-subjects.

3. Design

4. Data: Note two scores per subject.

5. InappropriateAnalysis Ignore that there are two scores from each subject (one in each group). Contrast code group (X).

6. Inappropriate Analysis Model C: Ŷi = βo Ŷi = 6.75 Model A: Ŷi = βo + β1Xi Ŷi = 6.75 + .375Xi

7. Inappropriate Analysis (cont.) Ŷi = 6.75 + .375Xi

8. Subject Exp. Absent Exp. Present 1 .625 .875 2 -1.375 -2.125 3 -.375 -1.125 4 .625 1.875 5 1.625 .875 6 .625 -.125 7 -1.375 -1.125 8 -.375 .875 Residuals from inappropriate analysis Positive nonindependence

9. Appropriate Approach Due to likely nonindependence among the scores from the same subject, the solution is once again to change the nonindependent scores into one score per person. Remember how we handled this last semester when we learned the t test for dependent groups, we computed a ‘difference’ score for each subject, reflecting how their score differed from the first measure to the second. We then analyzed the difference scores.

10. From t Test for Dependent Groups The ‘difference’ scores measure the effect of the independent variable on each subject, we then test to see whether the mean difference score differ significantly from zero.

11. W1 Scores We are going to do something very similar using the same formula as before but with different deltas. The deltas come from our contrast code (X=-1 and 1). We plug in the two scores for each subject to arrive at a W1 score for each subject. The W1 score for the first subject is shown below.

12. W1i Scores Note that when the subject gets the same scores in both Y1 and Y2 that W1i=0

13. W1 is a measure of the difference between the subjects’ two scores. If the independent variable had no effect the mean value of the W1 scores would be zero The reason the W1 scores have the opposite sign of the difference scores is simply because I used (-1 and 1) for the contrast rather then (1 and –1).

14. Expected Value If we look at the mean value of W1 across subjects we find it is: Which will equal 0 if there is no difference between the means of the two conditions. So….if the independent variable had no effect we would expect the mean of the W scores to equal zero…consequently…

15. Approach We then do the multiple regression approach (Chapter 5) of testing to see if the mean of the variable we are modeling (i.e. W1) is equal to some value (i.e. zero).

16. The Models and Hypotheses Following the procedures of Chapter 5: Model C: Ŵi = Bo where Bo=0 PC=0 Model A: Ŵi = βo where βo = μwPA=1 H0: βo = Bo orμw = 0 HA: βo  Bo orμw  0

17. Computations p=.0479

18. Appropriate Summary Table In the table above the value of b has been changed back to the metric of the original Y scores by dividing it by the denominator of the W formula (this is a convention). Compare this summary table to the inappropriate analysis, there is a huge drop in SSE(A) and SSE(C) when doing it this way (while SSR is the same in both approaches).

19. Why the Drop in Error? With the original Y scores the variance between the subjects within each group is part of the error that can’t be explained by the independent variable. With the W1 analysis the variance of the W1 scores is part of the error that can’t be explained by the independent variable. Remember that W1 scores measure the effect of the IV on each subject, in our example the IV had a pretty similar effect on everyone, thus the W1 scores didn’t vary much. So what can’t be explained by the independent variable is less with the W1 scores than with the Y scores (see next slide).

20. The scores within Y1 and Y2 vary more than the scores within W1, thus the analysis of the W1 scores will be more powerful. This is common in repeated measures designs, that the effect of the independent variable (measured by W1) shows less variability than the differences between subjects (as reflected in their Y scores)

21. The Error Term What is MSerror in the summary table? 1) Model A is using the mean of W to predict each W score. 2) W measures the effect of the IV on each individual. 3) If the W scores differ from each other (i.e. differ from mean of W) then that is due to the IV having different effects on each individual, and there will be error in the model...

22. Thus... Thus the error of Model A reflects a difference in how the strength of the IV varies across various individuals, or in other words, the error of the model is the interaction between the treatment (IV) and the individual subjects.

23. Full Summary Tablefor the Crossed Design The gray cells represent the analysis within subjects, what we just accomplished by using W scores, which is what we are really interested in. The white cells represent what we lost when we moved to W scores, they are included just to be complete. SSTotal is the SS of all of the Y scores (including two per subject), SSBetweenS is found by SSTotal – SSWithinS. The same goes for the df.

24. More on Crossed Designs What if we have three levels to our independent variable and subjects are crossed with this variable?

25. Data Note large within group variance.

26. With three levels in our independent variable we are going to need two contrasts to completely code it. Let’s say we select: Contrast 1: (first group vs. other two groups combined) λ11 = -2 λ12 = 1 λ13 = 1 Contrast 2: (second group vs. third group) λ21 = 0 λ22 = -1 λ23 = 1

27. Analyzing Contrast 1 Contrast 1: λ11 = -2 λ12 = 1 λ13 = 1 Using SPSS you have it compute W1 scores, then analyze them to see if the mean of the W1 scores differs significantly from zero.

28. Data Does mean of W1 differ from zero?

29. Contrast 1

30. Contrast 1 You could simply say PRE (or R²)=.027, p=.726, or you could express it in a summary table as seen below.

31. Analyzing Contrast 2 Contrast 2: λ11 = 0 λ12 = -1 λ13 = 1 Using SPSS you have it compute W2 scores, then analyze them to see if the mean of the W2 scores differs significantly from zero.

32. Data Does mean of W2 differ from zero?

33. Contrast 2

34. Contrast 2 You could simply say PRE (or R²)=.931, p=.0004, or you could express it in a summary table as seen below.

35. Biases in Ignoring Nonindependence All these are taken care of by changing the data until you get just one score per person.

36. Summary W0 is used to come up with one score that represents (more or less) that subject’s average score. It is used to see how much the subjects differed from each other. Use in nested designs. W1, W2, etc., are used to measure the difference in the subject’s score across various contrasts (i.e. to see how the subject’s scores differed across various levels of the independent variable). Use in crossed designs.