Impact of Case Studies in Toolbox Safety Talks

1. Training Intervention Effectiveness Research (TIER) What are “Toolbox Talks” Preliminary Findings Impact of Case Studies in Toolbox Safety Talks Terri Heidotting, Ed.D. and Carol Stephenson, Ph.D. (Education and Information Division) Herb Linn, M.S. and Paul Keane (Division of Safety Research) Lani Boldt, M.S. and Floyd Varley (Spokane Research Laboratory) • Toolbox talks consist of brief (10-15 minute) weekly workplace safety training sessions (“talks”) that are conducted at the worksite. • Also called “tailgate” talks, these safety sessions are commonly used in wide range of industries – such as, construction, mining, and agriculture • These safety talks are typically conducted by the site supervisor, foreman, safety supervisor, or senior employee Participant Feedback Instructors Employees • Formative Evaluation: • Conceptualization of goals and objectives to meet identified training needs • Process Evaluation: • Development and field testing of draft training materials and data collection instruments • Outcome Evaluation: • Controlled study to identify critical elements and evaluate outcomes • Impact Assessment: • Examination of longitudinal outcomes for impact of training on trainees and workplaces NIOSH Publication Number: 99-142 Website: http://www.cdc.gov/niosh/99-142.html • Want to present quality materials that will keep the employees interest and encourage their participation • “Typical toolbox materials are “pretty lame” • “Employees “aren’t paying attention…don’t care to be there…they want to sign their name and leave.” • Want materials that are easy to use • “Don’t have (pre-training) preparation time” • Reported that discussion questions pertaining to the case study facilitated participation and interest • Want quality materials that are interesting • “Ineffective toolbox talks are “rushed for time… you’re going to lose your interest right off the bat” • Real-life case studies would “get my attention” • Reported they could “relate to” the person in the case study • Case studies made information easier to remember Real Life Incident— A carpenter and his co-worker were overcome by carbon monoxide (CO) when they entered a basement area where a gasoline-powered generator was lowered into the basement to serve as the source of power.. Ongoing Data Collection • Collecting qualitative and quantitative data • Treatment conditions • Treatment – with case study • Control – without case study • Data collection and analyses • Instructor and worker feedback through focus groups • Pre/Post-training surveys of knowledge and safety attitudes • Post-training satisfaction survey • Workplace behavioral observations • Instructor feedback surveys • Study participants from • Residential and commercial construction • Sand and gravel mining Meeting Stakeholder Needs • Though data collection is ongoing, preliminary analyses revealed that including case studies in toolbox talks: • Enhances worker participation and interest • Leads to greater knowledge retention • May enhance worker attitudes towards the use of safe work practices • Data collection continues through end of 2003 • Stakeholder focus groups revealed the importance of case studies (also referred to as “stories” or narratives) towards enhancing the quality of the toolbox talk safety training. • Stakeholders also emphasized the need for quality training materials that:: • Areinexpensive and easily accessible • Have a widevariety of safety topics • Have beenevaluated for their effectiveness • Have been developed with industry input