Factorial ANOVA

1. Factorial ANOVA 2-Way ANOVA, 3-Way ANOVA, etc.

2. Factorial ANOVA • One-Way ANOVA = ANOVA with one IV with 1+ levels and one DV • Factorial ANOVA = ANOVA with 2+ IV’s and one DV • Factorial ANOVA Notation: • 2 x 3 x 4 ANOVA • The number of numbers = the number of IV’s • The numbers themselves = the number of levels in each IV

3. Factorial ANOVA • 2 x 3 x 4 ANOVA = an ANOVA with 3 IV’s, one of which has 2 levels, one of which has 3 levels, and the last of which has 4 levels • Why use a factorial ANOVA? Why not just use multiple one-way ANOVA’s? • Increased power – with the same sample size and effect size, a factorial ANOVA is more likely to result in the rejection of Ho • aka with equal effect size and probability of rejecting Ho if it is true (α), you can use fewer subjects (and time and money)

4. Factorial ANOVA • Why use a factorial ANOVA? Why not just use multiple one-way ANOVA’s? • With 3 IV’s, you’d need to run 3 one-way ANOVA’s, which would inflate your α-level • However, this could be corrected with a Bonferroni Correction 3. The best reason is that a factorial ANOVA can detect interactions, something that multiple one-way ANOVA’s cannot do

5. Factorial ANOVA • Interaction: • when the effects of one independent variable differ according to levels of another independent variable • Ex. We are testing two IV’s, Gender (male and female) and Age (young, medium, and old) and their effect on performance • If males performance differed as a function of age, i.e. males performed better or worse with age, but females performance was the same across ages, we would say that Age and Gender interact, or that we have an Age x Gender interaction

6. Factorial ANOVA • Interaction: • Presented graphically: • Note how male’s performance changes as a function of age while females does not • Note also that the lines cross one another, this is the hallmark of an interaction, and why interactions are sometimes called cross-over or disordinal interactions

7. Factorial ANOVA • Interactions: • However, it is not necessary that the lines cross, only that the slopes differ from one another • I.e. one line can be flat, and the other sloping upward, but not cross – this is still an interaction • See Fig. 13.2 on p. 400 in the Howell book for more examples

8. Factorial ANOVA • As opposed to interactions, we have what are called main effects: • the effect of an IV independent of any other IV’s • This is what we were looking at with one-way ANOVA’s – if we have a significant main effect of our IV, then we can say that the mean of at least one of the groups/levels of that IV is different than at least one of the other groups/levels

9. Factorial ANOVA • Main Effects: • Presented Graphically: • Note how the graph indicates that males performed higher than females equally for the young, medium, and old groups • This indicates a main effect (men>women), but no interaction (this is equal across ages)

10. Factorial ANOVA • Interaction Main Effect Both Main (No main effect) (No interaction) Effect & Inter.

11. Factorial ANOVA • Finally, we also have simple effects: • the effect of one group/level of our IV at one group/level of another IV • Using our example earlier of the effects of Gender (Men/Women) and Age (Young/Medium/Old) on Performance, to say that young women outperformed other groups would be to talk about a simple effect

12. Factorial ANOVA • One more new issue: • Random vs. Fixed Factors (IV’s) • Sadly, I’ve never read a paper that bothered to make this distinction, while it seriously effects the results you get • Fixed IV: when levels of IV are selected theoretically • i.e. IV = Depression, Levels = Present vs. Absent; IV = Memory Condition, Levels = Counting, Rhyming, Imagery, etc. • Random IV: when levels are randomly sampled • i.e. IV = Treatment Duration, Levels = 6, 8, and 12 sessions

13. Factorial ANOVA • Assumptions: • Normality • Homogeneity of Variance (Homoscedasticity) • Independence of Observations • Same as one-way ANOVA • Just like ANOVA, robust to violations of Assumptions #1 & 2 (so long as cell sizes are roughly equal), but very sensitive to violations of Assumption #3

14. Factorial ANOVA • Assumptions: • If Assumption #3 is violated, use a repeated-measures ANOVA • If Assumptions #1 and/or 2 are violated (and cell sizes are unequal), alternate procedures must be used • Transform non-normal data • Use Browne-Forsythe or Welch statistic

15. Factorial ANOVA • Calculating a Factorial ANOVA: • First, we have to divide our data into cells • the data represented by our simple effects • If we have a 2 x 3 ANOVA, as in our Age and Gender example, we have 3 x 2 = 6 cells

16. Factorial ANOVA • Then we calculate means for all of these cells, and for our IV’s across cells • Mean #1 = Mean for Young Males only • Mean #2 = Mean for Medium Males only • Mean #3 = Mean for Old Males • Mean #4 = Mean for Young Females • Mean #5 = Mean for Medium Females • Mean #6 = Mean for Old Females • Mean #7 = Mean for all Young people (Male and Female) • Mean #8 = Mean for all Medium people (Male and Female) • Mean #9 = Mean for all Old people (Male and Female) • Mean #10 = Mean for all Males (Young, Medium, and Old) • Mean #11 = Mean for all Females (Young, Medium, and Old)

17. Factorial ANOVA • We then calculate the Grand Mean ( ) • This remains (ΣX)/N, or all of our observations added together, divided by the number of observations • We can also calculate SStotal, which is also calculated the same as in a one-way ANOVA

18. Factorial ANOVA • Next we want to calculate our SS terms for our IV’s • Same as SStreat in one-way ANOVA, but with one small addition • SSIV = nxΣ( - )2 • n = number of subjects per group/level of our IV • x = number of groups/levels in the other IV

19. Factorial ANOVA • SSIV = nxΣ( - )2 • Subtract the grand mean from each of our levels means • For SSgender, this would involve subtracting the mean for males from the grand mean, and the mean for females from the grand mean • Note: The number of values should equal the number of levels of your IV • Square all of these values • Add all of these values up • Multiply this number by the number of subjects in each cell x the number of levels of the other IV • Repeat for any IV’s • Using the previous example, we would have both SSgender and SSage

20. Factorial ANOVA • Next we want to calculate SScells, which has a formula similar to SSIV • SScells = • Subtract the grand mean from each of our cell means • Note: The number of values should equal the number of cells • Square all of these values • Add all of these values up • Multiply this number by the number of subjects in each cell

21. Factorial ANOVA • A brief note on SScells • Represents variability in individual cell means • Cell means differ for 4 reaons: • Error • Effects of IV#1 (Gender) • Effects of IV#2 (Age) • Effects of interaction(s)

22. Factorial ANOVA • We’ve already accounted for variability due to error (SSerror), so subtracting the variability due to Gender (SSgender) and Age (SSage) from SScells leaves us with the effects of our interaction (SSint) • SSint = SScells – SSIV1 – SSIV2 – etc… • Going back to our previous example, SSint = SScells – SSgender – SSage • SSerror = SStotal – SScells

23. Factorial ANOVA • Similar to a one-way ANOVA, factorial ANOVA uses df to obtain MS • dftotal = N – 1 • dfIV = k – 1 • Using the previous example, dfage = 3 (Young/Medium/Old) – 1 = 2 and dfgender = 2 (Male/Female) – 1 = 1 • dfint = dfIV1 x dfIV2 x etc… • Again, using the previous example, dfint = 2 x 1 = 2 • dferror = dftotal – dfint - dfIV1 – dfIV2 – etc…

24. Factorial ANOVA • Factorial ANOVA provides you with F-statistics for all main effects and interactions • Therefore, we need to calculate MS for all of our IV’s (our main effects) and the interaction • MSIV = SSIV/dfIV • We would do this for each of our IV’s • MSint = SSint/dfint • MSerror = SSerror/dferror

25. Factorial ANOVA • We then divide each of our MS’s by MSerror to obtain our F - statistics • Finally, we compare this with our critical F to determine if we accept or reject Ho • All of our main effects and our interaction have their own critical F’s • Just as in the one-way ANOVA, use table E.3 or E.4 depending on your alpha level (.05 or .01) • Just as in the one-way ANOVA, “df numerator” = the df for the term in question (the IV’s or their interaction) and “df denominator” = dferror

26. Factorial ANOVA • Just like in a one-way ANOVA, a significant F in factorial ANOVA doesn’t tell you which groups/levels of your IV’s are different • There are several possible ways to determine where differences lie

27. Factorial ANOVA • Multiple Comparison Techniques in Factorial ANOVA: • Several one-way ANOVA’s (as many as there are IV’s) with their corresponding multiple comparison techniques • Probably the most common method • A priori/post hoc techniques the same as one-way ANOVA • Analysis of Simple Effects • Calculate MS for each cell/simple effect, obtain an F for each one and determine its associated p-value

28. Factorial ANOVA • Multiple Comparison Techniques in Factorial ANOVA: • In addition, interactions must be decomposed to determine what they mean • A significant interaction between two variables means that one IV’s value changes as a function of the other, but gives no specific information • The most simple and common method of interpreting interactions is to look at a graph

29. Interpreting Interactions: • In the example above, you can see that for Males, as age increases, Performance increases, whereas for Females there is no relation between Age and Performance • To interpret an interaction, we graph the DV on the y-axis, place one IV on the x-axis, and define the lines by the other IV • You may have to try switching the IV’s if you don’t get a nice interaction pattern the first time

30. Factorial ANOVA • Effect Size in Factorial ANOVA: • η2 (eta squared) = SSIV/SStotal (for any of the IV’s)or SSint/SStotal (for the interaction) • Tells you the percent of variability in the DV accounted for by the IV/interaction • Like the one-way ANOVA, very easily computed and commonly used, but also very biased – don’t ever use it

31. Factorial ANOVA • Effect Size in Factorial ANOVA: • ω2 (omega squared) = • or • Also provides an estimate of the percent of variability in the DV accounted for by the IV/interaction, but is not biased

32. Factorial ANOVA • Effect Size in Factorial ANOVA: • Cohen’s d = • The two means can be between two IV’s, or between two groups/levels within an IV, depending on what you want to estimate • Reminder: Cohen’s conventions for d – small = .3, medium = .5, large = .8

33. Factorial ANOVA • Example #1: • The previous example used data from Eysenck’s (1974) study of the effects of age and various conditions on memory performance. Another aspect of this study manipulated depth of processing more directly by placing the participants into conditions that directly elicited High or Low levels of processing. Age was maintained as a variable and was subdivided into Young and Old groups. The data is as follows:

34. Factorial ANOVA • Young/Low: 8 6 4 6 7 6 5 7 9 7 • Young/High: 21 19 17 15 22 16 22 22 18 21 • Old/Low: 9 8 6 8 10 4 6 5 7 7 • Old/High: 10 19 14 5 10 11 14 15 11 11 • What are the IV’s and the DV’s, and the number of levels of each? • What are the number of cells? • What are the various df’s?

35. Factorial ANOVA • IV = Age (2 levels) and Condition (2 levels) • 2 x 2 ANOVA = 4 cells • dage = .70 • dcondition = 1.82 • dint = .80

36. Factorial ANOVA • Decomposing the interaction: