130 likes | 257 Views
Video-Based Assessment of a Coach’s Ability to Fault-Check Performance. John J. Lee, Girlie C. Delacruz, Jesse Elmore, & William L. Bewley. American Educational Research Association Annual Meeting
E N D
Video-Based Assessment of a Coach’s Ability to Fault-Check Performance John J. Lee, Girlie C. Delacruz, Jesse Elmore, & William L. Bewley American Educational Research AssociationAnnual Meeting AERA 53.069 – TICL 6: Advancing the State of the Art: Computer-Based Assessment and Learning EnvironmentsNew York, NY - March 27, 2008
Overview • Background • Research base • Assessments • Design • Analysis • Demo
Background • Context: Fault Checking Performance on the Range • Two Weapon Manipulations Skills: Speed Reload and Tactical Reload • Using video-based assessment from four different angles • Main research question: Does assessment response format make a difference?
Research Base • Expert-Novice • Experts have schemas to reduce cognitive load • Expertise Reversal Effect: some task formats may impede performance for experts when inconsistent or unaligned with existing schema • Scaffolding: helpful to novices who have little or no prior knowledge • Distributed Representations: task’s response format as scaffold • Assessment Validation • Validity – reduce construct irrelevant variance as much as you can • Response fidelity more predictive validity than more abstract
Video-Based Assessments • Shooter-Skill Diagnostic Task: • Checklist Version • Open-ended Version • Shooter-Skill Performance Task: • Proper / Improper Execution • Shooter-Skill Performance Task: Drag and Drop Order