1 / 17

How to calculate: - Average Effect Size (step 4) - Moderators (step 5)

How to calculate: - Average Effect Size (step 4) - Moderators (step 5). Overview. We will first go through “how” to do this. Then, we will repeat everything and explain “why” we do each step. At this point you have:. (1) Effect sizes. (2) Sample sizes. (3) moderators.

juro
Download Presentation

How to calculate: - Average Effect Size (step 4) - Moderators (step 5)

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. How to calculate: - Average Effect Size (step 4) - Moderators (step 5)

  2. Overview • We will first go through “how” to do this. • Then, we will repeat everything and explain “why” we do each step

  3. At this point you have: (1) Effect sizes. (2) Sample sizes. (3) moderators

  4. Step 1 - Transform “r” into Fisher’s z-to-r • See formulas from my excel file

  5. Step 2 - Weight by inverse variance • See formulas from my excel file

  6. Step 3 - Upload to SPSS • in SPSS, file-open

  7. Step 4 - Initiate “MeanES” macro • Download from Lipsey/Wilson website • Open YOUR DATASET • Open a new syntax • Put the following at the end of the syntax file • INCLUDE 'C:\Documents and Settings\Desktop\metaclub\MeanES.SPS' . • Highlight the sentence • Click run (blue triangle at top)

  8. Step 5 - Calculate “MeanES” • In syntax, type the following sentence: • MEANES ES = ES_zr /W = weight /PRINT IVZR. fyi – “ES_zr” is my name for the effect sizes “weight” is my name for the weight “/PRINT IVZR” converts output back to “r” • Highlight and click run

  9. Step 6 – Interpret output • ES = .1225, p = .0000 • Q = 1140, p = .0000

  10. Now, let’s repeat and explain “why” • Transform into Fisher’s z-to-r • Why? • Weight by inverse variance • Why? • Something about standard error? Mathew?

  11. Now, let’s move to Moderators • METAF – Categorical Moderators • INCLUDE 'C:\Documents and Settings\Desktop\metaclub\MetaF.SPS' . • METAF ES = ES_zr /W = weight /GROUP = ev1_subjecttype /PRINT IVZR. • METAF – Continuous Moderators • INCLUDE 'C:\Documents and Settings\Desktop\metaclub\MetaREG.SPS' . • METAREG ES = ES_zr /W = weight /IVS = ev1_subjecttype /PRINT IVZR. fyi – can only run 2 macros in same session fyi – I run categorical moderators using both METAF and METAREG because answer different questions

  12. Interpreting Categorical Macro • Sig difference = 22.87, p = .0000

  13. Interpreting Continuous Macro • beta = -.0201, p = .0014

  14. Now, to Multivariate • METAREG can handle multiple variables • METAREG ES = ES_zr /W = weight /IVS = ev1_subjecttype ev2_stimulustype /PRINT IVZR. fyi – Can include as many variables as you wish. fyi - I believe you can include CATEGORICAL moderators IF: • they are dichotomous, • they are continuous and linear relationship

  15. Interpreting Continuous Macro • beta for each one, p value for each one • overall r-squared

  16. Finally, Interaction analysis • Center each variable • Create interaction term by multiplying together • Enter all three into METAREG • If interaction term is sig, then interaction exists • How to graph the interaction? (next week)

  17. FYI • The club website has my excel file and the accompanying SPSS file. • You also have my quals paper, so you can use the SPSS file to practice and see if your data match the quals paper. • HOWEVER, the data will only match the CATEGORICAL moderator analysis (not the continuous moderator analysis) for reasons I don’t have time to go into.

More Related