160 likes | 292 Views
Finding Factors Using exploratory factor analysis to test a performance measure. Roseanne Sovka BC Ministry of Advanced Education and Labour Market Development PNAIRP Conference 3-5 October 2010. Outline. Background Method Results Next steps. Background. BC Accountability Framework
E N D
Finding FactorsUsing exploratory factor analysis to test a performance measure Roseanne Sovka BC Ministry of Advanced Education and Labour Market Development PNAIRP Conference 3-5 October 2010
Outline • Background • Method • Results • Next steps
Background • BC Accountability Framework • All public post-secondary institutions • Annual process • 14 performance measures • Webpage: http://www.aved.gov.bc.ca/framework/welcome.htm#std
Background • Skill development performance measure • Average of 7 survey questions • Bachelor, Diploma & Certificate students • Why these questions? • Similar for all credential types?
Method • Exploratory factor analysis • Data reduction technique • Underlying factors (latent variables) explain the relationship between variables
Results • Using survey results for diploma, associate degree and certificate students • There is a factor structure • Skill development is one of the factors • Includes questions from performance measure • Explanatory power 46%
Results Performance measure
Results • Using survey results for Apprenticeship students • There is a factor structure • Skill development is one of the factors • Similar to diploma and certificate students • Some differences • Explanatory power 47%
Results Performance measure
Results • Using survey results for baccalaureate students • Fewer questions available • Somewhat different question wording and response sets
Results • Using survey results for baccalaureate students • There is a factor structure • Skill development is one of the factors • Similar to other student groups • Some differences • Explanatory power 36%
Results Performance measure
Comparison • All groups had a skills factor • The same questions grouped with the skills factor • Variation in explanatory power • Variation in non-skills factors
Conclusion • Robust skill development factor • Different student groups • Different questions and response scales • Objective rationale for performance measure
Next steps • Accountability Framework committee is considering the results • Any questions?
Finding FactorsUsing exploratory factor analysis to test a performance measure Roseanne Sovka BC Ministry of Advanced Education and Labour Market Development PNAIRP Conference 3-5 October 2010