1 / 31

Unbearable Lightness of b : Approaches to Causal Interpretation of the M to Y relation

Unbearable Lightness of b : Approaches to Causal Interpretation of the M to Y relation. David P. MacKinnon, Angela Pirlott, & Stephanie Moser Society for Personality and Social Psychology Friday, January 29, 2010 Las Vegas, Nevada. Causal Inference Criticisms of Mediation Analysis

yamka
Download Presentation

Unbearable Lightness of b : Approaches to Causal Interpretation of the M to Y relation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Unbearable Lightness of b:Approaches to Causal Interpretation of the M to Y relation David P. MacKinnon, Angela Pirlott, & Stephanie Moser Society for Personality and Social Psychology Friday, January 29, 2010 Las Vegas, Nevada Causal Inference Criticisms of Mediation Analysis Statistical Approaches to Addressing Criticisms Designs to Address Criticisms Acknowledgements: National Institute on Drug Abuse, Arizona State University Social Psychology Research Institute

  2. Single Mediator Model MEDIATOR M a b INDEPENDENT VARIABLE DEPENDENT VARIABLE c’ X Y

  3. Mediation Regression Equations • Tests of mediation for a single mediator use information from some or all of three equations. • The coefficients in the equations may be obtained using methods such as ordinary least squares regression, covariance structure analysis, or logistic regression.

  4. Equation 1 MEDIATOR M INDEPENDENT VARIABLE DEPENDENT VARIABLE c X Y • The independent variable is related to the dependent variable:

  5. Equation 2 MEDIATOR M a INDEPENDENT VARIABLE DEPENDENT VARIABLE X Y 2. The independent variable is related to the potential mediator:

  6. Equation 3 MEDIATOR M a b INDEPENDENT VARIABLE DEPENDENT VARIABLE c’ X Y 3. The mediator is related to the dependent variable controlling for exposure to the independent variable:

  7. Mediated Effect Measures Indirect Effect = Mediated effect = ab = c-c’ Direct effect=c’Total effect=ab+c’=c

  8. Mediated Effect, ab, Standard Error Mediated effect=ab Standard error= Multivariate delta method standard error (Sobel 1982; Folmer 1981) Test for significant mediation: z’= Compare to normal distribution or use product distribution/bootstrap ab

  9. Common Mediation Design X is a randomized manipulation. M and Y are measured, usually on the same occasion. Methods described earlier are applied to estimate the mediated effect and its standard error. Because X is randomized, the relation of X to M, a, and X to Y, c, have a causal interpretation. Note that the relation of M to Y adjusted for X, b, and X to Y adjusted for M, c’, are correlational. Are there methods that improve interpretation of the M to Y relation? 9

  10. Causal Inference for Mediation The Rubin Causal Model (RCM, Rubin, 1974) and other causal inference approaches (Robins & Greenland 1992; Pearl 2009) provide ways to interpret evidence for causal relations for non-experimental as well as experimental research. Helpful because these methods display limits and strengths of models, including mediation.

  11. Counterfactual Counterfactual is central to modern causal inference. The counterfactual refers to conditions in which a participant could serve, not just the condition in which they did serve. For example, for a participant in the treatment group, the counterfactual is the same participant in the control group. For a participant in the control group, the counterfactual is the same participant in the treatment group.

  12. Why b and c’ do not reflect a causal relation? Because M is not under direct experimental control, b and c’ do not necessarily represent causal effects. Need: -The relation between M and Y for participants in the treatment group if they were in the control group -The relation between M and Y for control participants if they instead were in the treatment group. -Also need these values for every value of M! Coefficients b and c’ are not causal effects, because the counterfactuals for these relations are complicated because M is not randomly assigned.

  13. Statistical Approaches to Causal Inference Statistical approaches to improving causal inference from a mediation study: Instrumental Variable Methods (Holland, 1988; Sobel 2006) Principal Stratification and Latent Classes (Frangakis & Rubin, 2002; Jo, 2006) G-estimation, Marginal Structural Models (Robins, 1999; Robins & Greenland, 1992)

  14. Design Approaches to Improving Causal Inference Statistical mediation analysis answers the following question, “How does a researcher use measures of the hypothetical intervening process to increase the amount of information from a research study?” Another question is, “What is the best next study or studies to conduct after a statistical mediation analysis to test mediation theory.” Three general approaches: (1) Double randomization designs. (2) Designs to address Consistency of the mediation relation. (3) Designs to address Specificity of the mediation relation.

  15. (1) Double Randomization If the problem with the b path is that M is not randomly assigned, then how about randomizing both X in the X to M relation and randomizing M in the M to Y relation. Say X was randomized and there is a significant effect of X on M in Study 1. In Study 2, an experiment is set up so that M was randomized to levels defined by how X changed M in Study 1. If there is a significant relation of M to Y in Study 2, then there is more evidence for mediation. 15

  16. Double Randomization ExampleWord et al. (1974) Study of self-fulfilling prophecy in interviews cited in Spencer et al., (2005). Race (X) predicts quality of interview (M) which predicts performance (Y). Confederates were used to manipulate factors. Confederate applicants were used in Study 1 for the X to M relation and confederate interviewers were used in Study 2 for the M to Y relation. 16

  17. Double Randomization ExampleWord et al. (1974) Study 1. White participants interviewed either Black or White confederate applicants (X). The dependent variable M, was interview quality and participants with Black confederate applicants gave poorer quality interviews (M). Study 2. Confederates gave either an interview (M) like White applicants were interviewed in Study 1 or like Black applicants in Study 1. This manipulation had a significant effect on applicant performance (Y). So randomization was used for the X to M relation and the M to Y relation. 17

  18. Prevention Example (MacKinnon et al., 2002) Norms increase exercise which decreases depression. Study 1, X to M: Similar to existing prevention studies, participants either receive a social norm manipulation to increase exercise or not (X) and exercise is measured (M). Study 2, M to Y: Participants are randomly assigned to conduct an amount of exercise (M) obtained in the program or the control group from Study 1 and depression is measured (Y). 18

  19. Double Randomization Problems Most problems center around the randomization of the mediator in the M to Y study so that it corresponds to the change in the mediator in the X to M study. Study 2 is a mediation X to M to Y study with a manipulation (X) that should change M in the same way as X changed M in Study 1. So Study 2 data is analyzed with statistical mediation analysis with the same problems of interpretation. 19

  20. (2) Consistency Mediation Designs Consistency designs replicate mediation relations in new settings, groups, species (animals, humans), and times. Consistency designs also replicate mediation relations with alternative manipulations (X), alternative measures of the same mediator (M), and other dependent measures (Y). Overall, consistency designs provide evidence that the mediation relation is consistently observed across many domains and variables. 20

  21. Consistency Design Example Social-influences school-based substance use prevention research provides examples of consistency designs. Mediation effects on groups defined by age, ethnicity, and location. Mediation effects on related dependent variables, tobacco, alcohol, and marijuana. 21

  22. (3) Specificity Mediation Designs Evidence for specificity of a mediation relation is obtained by comparing between groups (or variables) to demonstrate that the mediation relation is present in the predicted groups (or variables) but not present in other groups (or variables). Specificity designs demonstrate that mediation relations can be changed by different manipulations (X), mediation relations are observed for some mediators (M) but not others, and mediation is observed for some dependent measures (Y) but not others in a way that demonstrates a pattern of results consistent mediation theory. 22

  23. Specificity in X, M, Y Specificity for X: a norm change manipulation for alcohol results in a mediation effect for alcohol but not tobacco use. Specificity for M: Changes in beliefs about positive consequences is an observed mediator but changes in beliefs about negative consequences is not. Specificity for Y: a mediation relation is observed for one dependent variable but not another. For example, change in beliefs about positive consequences of alcohol use is a mediator for alcohol use but not for tobacco use. 23

  24. Blockage Specificity Designs The goal of blockage designs is to test a mediation relation with a manipulation that blocks the mediator from operating. For example, let’s say that an exercise program appears to reduce depression by increasing endorphin levels-- the hypothesized mediator. A blockage manipulation would administer a drug to prevent endorphin production so that persons receiving the exercise program would no longer experience reduced depression if the endorphin level is the mediator. 24

  25. Blockage Design Example 1 Cahill et al., (1994). Memory associated with emotional arousal is through beta-adrenergic stress hormone systems. Participants received a beta-blocker, propranol. Memory for an emotionally arousing versus an emotionally neutral story was recorded. Propranol impaired memory for the emotionally arousing story but did not affect memory for the emotionally neutral story. The implication is that the stress hormone system was the mediator because its effects were blocked as expected. 25

  26. Blockage Design Example 2 Insel & Hulihan, (1995). Tested whether partner preference was through the hormone oxytocin, not vasopressin, in female prairie voles. Half of female voles received an oxytocin blocker, half received a vasopressin blocker. Female voles in oxytocin condition showed no partner preference for mates. Voles in vasopressin condition showed clear preference for mates. The implication is that oxytocin is the mediator because its effects were blocked as expected but vasopressin did not block effects. 26

  27. Enhancement Specificity Designs The goal of enhancement designs is to test interventions that enhance the effects of a hypothesized mediator. For example, let’s say that an addiction treatment program reduces remission by improving social support. An enhancement design would increase social support even more to demonstrate a larger effect on remission. Social support may be increased by more exposure to a therapist, additional contact with friends and family etc.

  28. Blockage and Enhancement Design Example Emotional events are remembered more vividly because of arousal. O’Carroll et al. (1999) randomly assigned participants to receive a stimulant to enhance arousal, a drug to block arousal or a placebo. All saw a slide show of a boy in an accident. Obtained predicted effects on average heart rate and memory; participants who took the stimulant had better memory than placebo and placebo had better memory than blockage condition participants. Same study demonstrated that enhancement and blockage of arousal led to the expected pattern of results on memory. 28

  29. Summary -Problems with causal inference for mediation relations b and c’ because M is not directly randomized. -Double Randomization, Consistency, and Specificity research designs are available to investigate mediation hypotheses experimentally. The designs improve evidence for a causal relation between M and Y. -Best to have programs of research designed to address the many aspects of a mediation relation. -Easier task in psychology where we can run more experiments than community medicine, for example. -Other examples? David.MacKinnon@asu.edu

  30. Hypothesized Effects of SPSP talk on Mediation Designs Knowledge of Mediation Designs Norms Regarding Conducting Mediation Studies SPSP Presentation on Mediator Designs # Studies with Mediator Designs Strong desire to help find design examples. Beliefs About the Importance of Theory Testing

  31. Thank You References Cahill, L., Prins, B., Weber, M., & McGaugh, J. L. (1994). Beta-adrenergic activation and memory for emotional events. Nature, 20, 702-704. Folmer, H. (1981). Measurement of the effects of regional policy instruments by means of linear structural equation models and panel data. EEnvironment and Planning A, 13, 1435-1448. Frangakis, C.E. & Rubin, D.B. (2002). Principal stratification in causal inference. Biometrics, 58, 21-29. Holland, P. W. (1988). Causal inference, path analysis, and recursive structural equation models. Sociological Methodology, 18, 449-484. Insel, T.R. & Hulihan, T.J. (1995). A gender-specific mechanism for pair bonding: Oxytocin and partner preference formation in monogamous voles. Behavioral Neuroscience, 109, 782-789. Jo, B. (2006). Causal inference in randomized trials with mediational processes. Unpublished paper. Klesges, R. C., Vasey, M.M. & Glasgow, R.E. (1986). A worksite smoking modification competition: Potential for public health impact. American Journal of Public Health, 76, 198-200. MacKinnon, D.P. (2008). Introduction to Statistical Mediation Analysis, New York: Erlbaum. http://www.routledge.com/books/Introduction-to-Statistical-Mediation-Analysis-isbn9780805864298 MacKinnon, D.P., Lockwood, C.M., Hoffman, J.M., West, S.G., & Sheets, V. (2002), A comparison of methods to test mediation and other intervening variable effects.Psychological Methods, 7, 83-104. Mark, M. M. (1986). Validity typologies and the logic and practice of quasi-experimentation. In W. M. K. Trochim (Ed.),Advances in quasi-expermental design and analysis (pp. 47-66). San Francisco: Jossey-Bass. O’Carroll, R.E., Drysdale, E., Cahill, L., Shajahan, P., & Ebmeier, K. P. (1999). Stimulation of the noradrenergic system enhances and blockade reduces memory for emotional material in man. Psychological Medicine, 29, 1083-1088. Pearl, J. (2009). Graphs, causality, and structural equation models. Sociological Methods & Research, Robins, J.M. (1999). Marginal structural models versus structural nested models as tools for causal inference. In M.E. Halloran & D. Berry (Eds.) Statiistical Models in Epidemiology, the Environment, and Clinical Trials. Pp. 95- Robins, J.M, & Greenland, S. (1992). Identifiabilty and exchangeability for direct and indirect effects. Epidemiology, 3, 143-155. Rubin, D.B. (1974 ). Estimating causal effects of treatments in randomized and nonrandomized studies. Journal of Educational Psychology, 66, 688-701. Spencer, S. J. et al. (2005). Establishing a causal chain: Why experiments are often more effective than mediational analyses in examining psychological processes. JPSP, 89, 845-851. Sobel, M. E. (1982). Asymptotic confidence intervals for indirect effects in structural equation models. Sociological Methodology, 13, 290-312. Sobel, M.E. (2006). Identification of causal parameters in randomized studies with mediating variables. Journal of Educational and Behavioral Statistics. Word, C.O., Zanna, M.P., & Cooper, J. (1974). The nonverbal mediation of self-fulfilling prophecies in interracial interaction. JESP, 10, 109-120.

More Related