160 likes | 428 Views
Assessing Scientific Inquiry and Leadership Skills (AScILS) Report to NIGMS Advisory Council January 25, 2008. Martin M. Chemers, PI University of California, Santa Cruz. Overarching Research Questions.
E N D
Assessing Scientific Inquiry and Leadership Skills (AScILS)Report to NIGMS Advisory Council January 25, 2008 Martin M. Chemers, PI University of California, Santa Cruz
Overarching Research Questions • How do activities implemented by biomedical research career support programs (especially research and mentoring) influence: • Scientific research skills • Science team leadership and membership skills • Beliefs in efficacy and collective efficacy regarding these skills • Identity as a scientist • Stage-appropriate educational and career outcomes? • Are these influences similar for minority and non-minority students?
Program Components Psychological Processes Outcomes Research Experience Performance: ScienceInquiry and Leadership Skills Science InquirySelf-Efficacy { Mentoring: Instrumental Socio-Emotional Leadership and Teamwork Self-Efficacy Community Involvement Commitment: SatisfactionandContinuationin Science Education and Research Academic Support Identity and Belonging as a Scientist Financial Support Student Demographics: Ethnicity, Gender
The Research Model • Theory-Driven • Interdisciplinary • Multi-Method
Brief Overview of Methods • Qualitative Studies: (Assessment of Program Components) In-depth interviews (H.S., U.G., & Grad.) (Longitudinal Case Studies) • Retrospective Surveys (UCSC Students; COSMOS; SACNAS) • Performance Assessments (Simulations & Mentor Ratings) • Longitudinal Quantitative Studies
Today’s Report: Quantitative Survey Studies • UCSC Undergraduate Retrospective Survey • SACNAS Retrospective Undergraduate and Graduate/Post-Doc Surveys
Program Components Psychological Processes Outcomes Research Experience Performance: ScienceInquiry and Leadership Skills Science InquirySelf-Efficacy { Mentoring: Instrumental Socio-Emotional Leadership and Teamwork Self-Efficacy Community Involvement Commitment: SatisfactionandContinuationin Science Education and Research Academic Support Identity and Belonging as a Scientist Financial Support Student Demographics: Ethnicity, Gender
UCSC Undergraduate Retrospective Survey Population • All 1095 participants from 14 UCSC science or engineering support programs, 1999/2000 to 2003/2004 • UCSC Science/Engineering majors not in programs during those same years • Invited 100% of 870 underrepresented minorities • Invited representative proportion of other ethnic groups: 548 Whites, 191 Asians, 131 Others
UCSC Undergraduate Retrospective Survey Sample • 502 (18%) completed survey • 56% women • Ethnic background • 34% URM • 23% Asian • 40% White • 4% Other • Average age = 23.2 years
UCSC Undergraduate Retrospective Survey Results Blue (Left) = URM students Red (Right) = White students Research Experience .42/.46 Science Inquiry Self-Efficacy .29/.21 .52/.42 .31/.25 Commitment Community Involvement .24/ns .69/.79 .11/.12 .37/.60 Identity as a Scientist .52/.52 ns/.23 .16/.15 Instrumental Mentoring Model Fit: χ2 (15) = 8.60, p = .90, CFI = 1.0, IFI = 1.0, GFI = .99, NNFI = 1.0, RMR = .03, RMSEA = .00 (.00, .02)
SACNAS Undergraduate Retrospective Survey Sample • 327 completed survey • 74% Current Undergrads, 26% Recent Grads • 67% women • Ethnic Background • 74% URM • 14% Asian • 11% White • 1% Other • Average age = 24.06 years
SACNAS Undergraduate Retrospective Survey Results Research Experience .34 Science Inquiry Self-Efficacy .24 .10 .32 .24 Community Involvement Identity as a Scientist Commitment .26 .53 .51 .29 .17 Teamwork & Leadership Self-Efficacy Instrumental Mentoring .23 Model Fit: χ2 (10) = 22.20, p = .01, CFI = .97, IFI = .97, GFI = .98, NNFI = .94, RMR = .02, RMSEA = .06 (.03, .10)
SACNAS Graduate/Post-Doc Retrospective Survey Sample • 338 completed survey • 82% Current Graduate Students, 18% Post-Docs • 63% women • Ethnic Background • 86% URM • 7% Asian • 6% White • 1% Other • Average age = 29.83 years
SACNAS Graduate/Post-Doc Retrospective Survey Results Research Experience .30 Science Inquiry Self-Efficacy .23 Professional Experience .12 .20 .23 .11 .12 Community Involvement Identity as a Scientist Commitment .49 Instrumental Mentoring .16 .12 .16 .12 Teamwork & Leadership Self-Efficacy .14 Socioemotional Mentoring .25 Model Fit: χ2 (12) = 54.42, p < .001, CFI = .96, IFI = .96, GFI = .97, NNFI = .87, RMR = .03, RMSEA = .10 (.08, .13)
Summary & Conclusions • Identity most direct predictor of commitment and performance • Science inquiry self-efficacy both indirect (through identity) and direct predictor of commitment and performance • Research, mentoring, and community involvement predict science inquiry self-efficacy and identity
Implications for Policy and Practice • Scientific self-efficacy and identity are positively affected by interventions involving research and mentoring. • Programs should place greater emphasis on these psychological mediators.