Dan Hardin daniel.e.hardin@uscg.mil (206) 220-7226 fishsafewest/EpssNotes.pdf

1. Dan Hardin daniel.e.hardin@uscg.mil(206) 220-7226www.fishsafewest.info/EpssNotes.pdf Boise State University OWPL February 6th 2018 Performance Support: The Coast Guard Checklist Generator App for commercial fishing industry vessels (EPSS)

2. 2018 ISPI Presentation • Monday April 9th • 2 hour deeper dive.

3. This is a case study you can use • This is not proprietary, • as a tax payer you paid for it. • If you need to make a case for such an intervention you can share this with your client as an example of how much impact an EPSS can have.

4. The Coast Guard and HPT • www.fishsafewest.info/USCG_Training_Manual.pdf

5. The Coast Guard and HPT

6. Top 10 most hazardous occupations in the country Commercial fishing industry Bureau of Labor and Statistics

7. Congress passed… • Coast Guard Auth Act of 2010 and 2012 • Required mandatory exams • By Oct 15, 2012 / Oct 15, 2015 • For vessels operating beyond 3nm from shore • Extra personnel where included in the legislation • 67 proposed • but not hired due to sequestration.

9. Performance Gap • According to HQ • 35,000 vessels would be impacted • Approximately 10% of fleet (3,500) had exams thru voluntary dockside exam program • Leaving 31,500 to be examined and in compliance by Oct 15, 2015. • Vessels failing to come into compliance by that date would be in violation. • Complexity of determining what equipment a particular vessel is required to have is high

10. Performance improvement opportunity • Each visit to a vessel estimated average 3.5 hours including 2 hours travel time • Each vessel new to the program requires at least 2 visits • 1st visit examiner meets with owner, determines what equipment is required and leaves a worklist. • Regs are many depending of vessel particulars • 2nd visit examiner returns, ensures all equipment is there and in serviceable condition. (some vessels may require a 3rd visit.

11. PIP • Potential to improve performance for the least cost. • (3.5 man-hours) X (2 visits) X (31,500 vessels) = 220,500 man hours • By reducing to 1 visit • (3.5 man-hours) X (1 visit) X (31,500 vessels) = 110,250 man-hours • That could save 110,250 man hours

12. Cause Analysis • Regulations are numerous and complex in their applicability. • Written by lawyers • Information Thomas Gilbert

13. Job aid or Training”Job Aid vs Memory Analysis • Joe Harless • A job aid is recommended • If the • frequency of performance is infrequent • complexity of the task is high • consequences for failure is high • changes are made often

14. Cause Analysis • So providing data in the environment in some form was indicated. • PIP Thomas Gilbert

15. Job aid vs Electronic Performance Support • Job aid – Usually static • EPSS (or apps) – dynamic • Smart • Flexible

17. Questions

18. The Solution • The Checklist Generator Demonstration • Its purpose is to tell the user… • What is required. • How to determine if required item is serviceable. • www.fishsafewest.info

19. Questions?

21. Analysis • Task Analysis • What regulations are applicable under what circumstances? • www.fishsafewest.info/TaskAnalysis.pdf • Examine the item to ensure it is serviceable

22. Analysis • What are the circumstances that make the item applicable… “applicability parameters” • www.fishsafewest.info/ApplicabilityParameters.pdf • These are the questions you need to ask your user in order to generate a checklist.

23. Tools used to develop the app • HTML • Web page formatting language • JavaScript • The brains to process logic • .asp • Move variables to the next web page • Bootstrap • Framework for developing responsive web pages on any display size.

24. Design and Development • Checklist Generator Flow • Main strategy • Capture all of the applicable variables from the user. • Avoid asking unnecessary questions • Use data validation to ensure the user answered all necessary question presented to them. • Missing data will generate an inaccurate checklist • www.fishsafewest.info/CheckGenFlow.pdf • www.fishsafewest.info/ChecklistGenFlowChartAll.pdf

26. Evaluation • How well did the solution close of alleviate the performance gap? • 47 responses from 81 Coast Guard examiners (60%) response rate. • Question 1 – 80% said the checklist generator was accurate at generating an accurate list. • Question 2 – Before implementation of the solution all vessels required at least 2 visits. • Question 3 – High degree of positive responses that the solution was successful at preparing the user to pass the exam on the first visit.

27. Evaluation (Flash Version) • Google Analytics (Aug 17 2014 to Sept 14th 2015) • 11,699 • Average of 30 users per day

28. Evaluation (Browser) • Google Analytics (Sept 14 2015 to Aug 1, 2016) • 8,538 • Average of 27 users per day

29. Google Analytics Summary • Total of 20,237 users accessed the website as of Aug 1, 2016 • If each used the solution to prepare their vessel • 20,237 X 3.5 man hours saved per vessel • Potential savings of 70,829man hours saved.

30. Assigning a dollar value • Average annual salary of $108,000 • $52.90 per hour cost. • $52.90 X 70,829 (man hours saved) = $3,746,854 • Even if 70% of those vessels passed the exam the first time this is still a savings of approximately $2.5 million.

31. Conclusion • The Checklist Generator closes the originally indentified Performance Gap by reducing the number of man hours necessary to bring vessels into compliance with the commercial fishing vessel safety regulations saving thousands of man hours and millions of dollars.

32. Bureau of Labor and Statistics