180 likes | 203 Views
Warren Bobrow, Ph.D. All About Performance, LLC warren@allaboutperformance.biz (310) 670-4175. Innovative Methods of Selecting New Employees: Simulations and In-Baskets. Some History In Personnel Selection. Personality Now Of Great Interest to I/O Psychologists
E N D
Warren Bobrow, Ph.D. All About Performance, LLCwarren@allaboutperformance.biz(310) 670-4175 Innovative Methods of Selecting New Employees: Simulations and In-Baskets
Some History In Personnel Selection • Personality Now Of Great Interest to I/O Psychologists • Performance Testing Has a Long History in I/O Psychology • Computer-Based Tests Are Increasingly Popular
Validity of Various Selection Procedures(Schmidt & Hunter, 1998)
What We’ll Be Addressing • The Criterion Validity of Various Innovative Procedures. • How Streamlining Assessments Can Increase ROI and Usability.
Comparison of Validity Between Live and Computer-Based Simulations • Many organizations are looking to leverage computers in selection • More efficiency • More accurate data gathering • Projects a more positive image with applicants • Are they getting good value?
Why is This Important? • If Computer-Based Simulations Are As Effective as Live Ones, Then: • Objective Way To Measure Skill and Ability • Cost Savings Can Be Realized
Live and Computer Based Simulations • Live Simulations Have Been Shown To Be Valid Predictors of Job Performance • Computers Are Limited in Their Ability to Analyze Open-Ended Responses • Is the Lower Cost of Computer Simulations Worth the (Presumed) Lower Validity
Item Writing Possibilities: All Applicants Get the Same Test Item1 Item2
Item Writing Possibilities: All Applicants Potentially Get A Unique Test Item1 Item2 Item3 Item4
Item Writing Possibilities: All Applicants Get Similar But Different Tests Item1 Item2 Item3 Item4
Simulation Demonstrations • Supervisor In-Basket • Supervisor Coaching • The CSR Computer Based Simulation Test • The CSR Live Simulation Test
Comparison • But Do These ‘Innovative’ Methods work as well (and have the same ROI) as Traditional Ones? • Same Construct Validity? • Worse/Equal/Better Criterion-Related Validity?
Live Simulations • Designed as a Traditional Simulation Exercise • Trained Role-Players/Raters • 1 Practice and 2 Real Calls
Validities:Computer vs. Live Live k=3, Computer k=21
Moral to the Story • Computer Based Simulations Have the Same Construct Validity as Their Traditional Counterparts • Multiple Choice Format Does Not Lead to a Decrement in Validity • Innovative Methods Provided Higher ROI
Improvements to Computer Tests • Better, More Sophisticated Branching Techniques • Voice Recognition of Tone, Not Just Words