80 likes | 174 Views
Forms Assembly Wallace Judd, PTC Test Talk 6/16/11. Determine Desired Exam Length (Items) # of Forms Domain Constraints (Items / Domain) # of Anchor Items. Forms Assembly. For Each Form, Equate : Exam Length (Items) # of Anchor Items Anchor Items / Domain Exam Difficulty
E N D
Forms AssemblyWallace Judd,PTC Test Talk 6/16/11 Determine Desired Exam Length (Items) # of Forms Domain Constraints (Items / Domain) # of Anchor Items
Forms Assembly For Each Form, Equate : Exam Length (Items) # of Anchor Items Anchor Items / Domain Exam Difficulty Projected Exam Time
Forms Assembly 1. Exam Length 10 Minutes for: Splash Screen Intro Practice Items 5 Minutes for Survey 1 Minute / Item for MC 3-4 Minutes / Item for Constructed Response
Forms Assembly 2. # of Anchor Items Usually 10-15% of Total Items Highest Point-Biserials P-Values Close to Cutpoint Jazzy Items
Forms Assembly 3. Anchor Items / Domain Allocate to Domains by Domain % of Test Domain Anchors in Domain ----------- = ------------------------- TestTotal Anchor Items
Forms Assembly 4. Exam Difficulty Simple: Sum of P-Valuesi Middle: Sum (P-Valuesi + PBisi) Best: Sum(PBisiP+ e[1 - |PVal-CT|] where CT = Test Cutpoint
Forms Assembly 5. Projected Time Use Calibration Data (Beta test or Trial Items) Calculate Average Item Time (Correct Items Only) For Each Form: Sum Average Item Time Total Item Time for Each Form Should be +/- 5%
Forms Assembly For Each Form, Equate : Exam Length (Items) # of Anchor Items Anchor Items / Domain Exam Difficulty Projected Exam Time