160 likes | 375 Views
Hierarchical Linear Modeling: An Introduction & Applications in Organizational Research. Michael C. Rodriguez. Common Problems. The “unit of analysis” problem – misestimated precision Testing hypotheses about effects occurring at each level and across levels
E N D
Hierarchical Linear Modeling: An Introduction & Applications in Organizational Research Michael C. Rodriguez
Common Problems • The “unit of analysis” problem – misestimated precision • Testing hypotheses about effects occurring at each level and across levels • Problems related to measurement of change or growth
What’s in a name… • Sociology: Multilevel Models • Biometrics: Mixed-Effects Models or Random-Effects Models • Econometrics: Random-Coefficient Regression Models • Statistics: Covariance Components Models
A way to think about HLM • A regression is computed for each school, given the students and student level characteristics within each school • At a second level, the resulting regression equations are regressed across schools, given the schools and school level characteristics
An Example • Is there a relationship between socio-economic status and achievement? • Is the relationship between SES and achievement the same in public schools and catholic schools?
Regression: Achievement & SES • Is the level of achievement of student i in school j related to the student’s Socio-Economic Status? • If SES scores are “centered” within each school so that the average SES for each school is zero, the intercept of the regression becomes the mean achievement level of school j
Means as Outcomes • Since the SES variable is centered within each school, we need to account for potential differences in the average SES between schools. • Is the mean achievement level of school j related to the Sector of the school (public versus catholic)?
Slopes as Outcomes • Does Sector predict the within-school slopes? • Is the relationship between SES and Achievement related to Sector?
Advantages of HLM • Estimation of parameters requires some distributional assumptions. One requires the error term (the part of the outcome that is not explained by observed factors) to be independent and identically distributed. • This is in contrast with the idea that people exist within meaningful relationships in organizations. Frank, K. (1998). Quantitative methods for studying social contexts. Review of Research in Education, 23, 171-216.
Advantages of HLM • Adjustment for nonindependence of error terms – when subjects are nested in meaningful or relevant organizations • Larger framework for real-life problems; when organizational contexts matter • Unbalanced designs and missing data are accommodated
A Classroom Assessment Study • Is achievement in mathematics related to mathematics self-efficacy and effort (about 1 hour of homework per day)? • Does the relationship between student self-efficacy, student effort, and achievement depend on classroom assessment practices?