MSHA Performance Analysis Briefing Report Presentation

1. MSHA Performance AnalysisBriefing Report Presentation Joe Breighner Allison Czapracki Tangie Gray Rashmi Jain Abi Jones October 23, 2006

2. Agenda • Statement of Work • Background • Performance Analysis Overview • Drivers and Barriers • Preliminary Data • Task Analysis • Design Approach • Conclusion • Next Steps

3. Statement of Work • The overall goal of this project is to develop a systematic and effective training strategy and course lessons for underground coal mine supervisors based on • State-of-the-art instructional design principles, processes, and learning technologies • The extensive and validated mine supervisor Job Task Analysis (JTA) developed by the Mine Safety and Heath Administration (MSHA) in cooperation with the U.S. Navy

4. Background 50% of the electricity produced in the U.S. is fueled by coal

5. Background • In 2004 58.3% of coal miners were above the age of 45 • In 2004, 3.4% of coal miners were under the age of 25 • Coal mine positions expected to increase by 10,000 over 20 years “[The mining industry] will need to replace a major portion, approximately 50% of the underground coal mining workforce in the next 5 to 7 years.” Bruce Watzman, V.P. Safety, Health and Human Resources for the National Mining Association

6. Background • Contributing factors to personnel shortage • Diminishing pool of human resources • Ever-changing production methods • Increasing high technology environment • “How these skills will be gained in advance of employment is a continuous challenge,” Bruce Watzman • Mine Safety & Health Administration’s (MSHA) challenge: Formalize underground coal mine supervisor training program

7. Background • 2005-06 Research • The future high turnover in the coal mine industry • The lack of trained and experienced coal mine supervisors • 2006-07 Immersion team to transition training prototype to accessible online training materials • The training must be • 508 compliant • Developed in Workforce Connections, a Learning Content Management System (LCMS)

8. Performance Analysis The performance analysis was conducted to • Analyze and validate the prototype created by the 2005-06 MSHA Immersion Team • Propose next steps for the task analysis and content analysis phases of the project

9. Performance Analysis Process • Held a meeting with members of the 2005-06 MSHA Immersion Team • Collected data from subject matter experts (SME), prototype evaluations, online resources, and extant data resources • Identified gaps in last year’s prototype from SME interviews • Identified the drivers that promote the project • Identified the barriers that hinder the project

10. Performance Analysis Optimal situation • Mine supervisors would possess • Overall knowledge of the mining process and specific knowledge in the following areas: • Safety issues • Regulations • Technical skills (e.g., ventilation/fluid dynamics, roof and rib control) • Management skills • Organizational skills • Logical thinking • Problem solving

11. Performance Analysis Optimal situation (contd…) • Mine supervisors would possess the ability to • Communicate effectively and develop a good rapport with co-workers • Respond appropriately and competently during emergencies and unusual situations • Job task analysis (JTA) spiders would be translated into an engaging, practical and effective training strategy

12. Performance Analysis Actual situation • Expected shortage of experienced mine supervisor candidates due to attrition • Few mine supervisor training programs are available • Current training programs are mostly On-the-Job Training (OJT) • Smaller mines do not have formal training programs

13. Drivers • Access to • SME’s, MSHA personnel, and mine environments • Extensive mine safety resources • Compiled data from 2005-06 MSHA team • Target audience as usability and content testers • Single expert source to validate training content • High number of mining fatalities during 2006 • High rate of impending retirement of experienced miners • Critical role of mine supervisors and the complexity of associated tasks

14. Barriers • Limitations of LCMS in light of Section 508 and SCORM compliance • Access to experienced miners and mine supervisors as usability and content testers • Development cycle restricted to academic year • Need for supplemental training, on or off-site

15. Barriers • “Creativity” of mine supervisors, reliance on prior knowledge • Miners showed preference for face-to-face training over online training • Ongoing MSHA administration and support of training LCMS and bulletin boards (new equipment, procedures, safety regulations)

16. Preliminary Data • Human Resources • Stakeholder • Mr. Jeffrey Duncan, MSHA • Wants a training solution with “…a management/engineering perspective [that goes] beyond compliance to understanding” • Stressed creating online training for underground coal mine supervisors • Training to include development of six training modules for 2006-07 in Workforce Connections • MSHA will position the training as professional development for miners

17. Preliminary Data • Human Resources (contd…) • SMEs • Formative evaluations of the 2005-06 training prototype • Interviews

18. Preliminary Data • Non Human Resources • Hard Data Resources • MSHA Statement of Work • Title 30 Code of Federal Regulations • Multimedia Training Materials • NIOSH Latent Imaging Exercises • Colorado State Mining Exam Preparation DVD • Commonwealth of Pennsylvania  Mine Safety Multimedia Mine Materials • MSHA Informational Reports • P&M Mine Job Task Analysis • Section 508 Website • Online Resources • http://www.msha.gov • http://www.cdc.gov/niosh • http://www.msha.gov/interactivetraining/tasktraining/index.html • http://www.section508.gov

19. Task Analysis • Cognitive task analysis divided the twelve generic duties into two rule-using categories • Procedural • Principle • Further analysis of JTAs helped refine the task analyses for Pre-Shift Examination and Emergencies and Unusual Situations

20. Design Approach • Training Environment Proposal • Visually stimulating and interactive • adaptive to the individual miner's level of experience • Customizable and flexible • Performance based • 508 and Sharable Courseware Object Reference Model (SCORM) compliant • Rich with multiple views and guided scenarios

21. Design Approach • Web-based Electronic Performance Support System (EPSS) • Scenario-driven Strategy

22. Conclusion • The performance analysis has provided: • An overview of the current state of the coal mining industry • A closer look at the coal mine supervisory workforce • A clearer understanding of the viability of the training prototype • Our challenge: bridging the gap between miners’ preference for “hands-on practice” and the cognitive-building advantages of computer-based training.

23. Next Steps • Continued Task Analysis • A continued review of extant data • A synthesis of the information collected • Work on the user interface presentation and functionality • Finalizing the instructional strategy for the entire training, as well as the multiple views and scenario based views.

24. Next Steps • Content Analysis • Synthesis of the information collected into applicable and appropriate training modules • Reviewing examples of MSHA courses in Workforce Connections • Selecting appropriate scenarios for the different lesson topics • Developing appropriate objectives and instructions to guide users through the modules

25. MSHA Performance AnalysisBriefing Report Presentation Joe Breighner Allison Czapracki Tangie Gray Rashmi Jain Abi Jones