180 likes | 265 Views
HIGHLANDS AFFILIATE CONFERENCE July 24, 2013 On-going HAB Research Review. Reliability of the HAB: test-retest and internal consistency Construct validity: Wonderlic Test (general intelligence) and Employee Aptitude Survey (verbal comprehension, visual speed/accuracy, spatial, word fluency)
E N D
HIGHLANDS AFFILIATE CONFERENCE July 24, 2013 On-going HAB Research Review • Reliability of the HAB: test-retest and internal consistency • Construct validity: Wonderlic Test (general intelligence) and Employee Aptitude Survey (verbal comprehension, visual speed/accuracy, spatial, word fluency) • Accuracy of self-estimates of abilities versus actual HAB scores • Factor Analysis: examining the relationship among the work samples over time • Cluster and Discriminant Analysis: examining the relationship between ability profiles and job choice
What is Reliability? Test-Retest Internal Consistency
Correlation Coefficient TEST-RETEST RELIABILITY correlation r12 = 1.0 Time 2 Time 1 Test score
Vocabulary r12 = .90
All work samples meet or exceed the accepted standard for test-retest reliability (r12 ≥ .70)
General Cognitive Ability • timed (12 minutes) • 50 questions General Intelligence: The level at which an individual learns, understands instructions and solves problems. It provides quantitative insight into how easily individuals can be trained, how well they can adjust and solve problems on the job, and how satisfied they are likely to be with the demands of the job.
Correlations Between the Wonderlic and HAB Work Samples n = 40-45
Intercorrelation Matrix Technical Manual
FACTOR ANALYSIS 2013 Intercorrelation Matrix The relationship among the work samples has not changed over time
2013 Factors The basic factor structure has not changed over time. Technical Manual (p. 27)
CONSTRUCT VALIDITY Correlations Between Employee Aptitude Survey (EAS) and HAB Work Samples ** correlation is significant at the 0.01 level (2-tailed). * correlation is significant at the 0.05 level (2-tailed).
Correlations Between EAS Tests and HAB Work Samples ** correlation is significant at the 0.01 level (2-tailed). * correlation is significant at the 0.05 level (2-tailed).
DISCRIMINANT ANALYSIS Used to predict membership in two or more mutually exclusive groups. A set of discriminant functions (equations) is used to estimate the probability of membership for each group. Job Groups Discriminant Functions 1 Sales P1 = .65 P2 = .30 P3= .50 P4 = .10 2 Engineering 3 Law 4 Education
Cluster Analysis Cluster Analysis A cluster is a group of individuals with similar abilities. Maximize the similarity of ability profiles within groups and minimize similarity between groups.