90 likes | 103 Views
Explore different methods for setting cut scores in utility analysis, including subjective and objective approaches. Consider practical factors such as the pool of job applicants and the complexity of the job.
E N D
Chapter 7 Utility
Utility Analysis • What is a Utility Analysis? • Some Practical Considerations • The pool of job applicants • The complexity of the job • The cut score in use
Methods for Setting Cut Scores • Subjective • The Angoff Method • The Bookmark Method • Objective • Item response theory – Based Methods (require intensive computation)
Group assignment • Form a small of group of 4-5 • According to US Citizenship and Immigration Service, any green card holder must correctly answer 60% of the exam items related to US history and government in order to be a qualified US citizen. • A new task force is formed to set a new cut score. • Imagine a minimally competent candidate (MCC). • Randomly select 10 items from the question list posted on Sakai. • Each person independently evaluate the probability of correctly answering each item. • Meet together to see whether you can reach a consensus. If not, discuss the discrepancy until you obtain a cut score. • Explain the rationale of your cut score in a paragraph and post it on Sakai.