Quantitative measurement of the conduct of work in clean up activities at Sellafield, U.K.

1. Quantitative measurement of the conduct of work in clean up activities at Sellafield, U.K. Presented by: Ian Marr, British Nuclear Group Jack Delin, British Nuclear Group Todd Shrader, US DOE -ORP

3. Contents Background and context Why we joined the (WANO) Why we want to measure the conduct of work How the measurement system was developed What the measurement system consists of How the measurement system is being used

4. Thorp Event Fatigue was direct cause Ill- conceived design modification was the root cause Key learning for the Clean Up improvement plan: Leadership and organisational effectiveness Consider Nuclear Safety as overriding priority Conduct of operations Conduct of maintenance

5. Why we joined WANO To increasing the peer review and challenge WANO mission is: �To maximise the safety and reliability of the operation of nuclear power plants by exchanging information and encouraging communication, comparison and emulation amongst its members� 2002 British Nuclear Group Sellafield Ltd applied to join WANO Four peer reviews carried out by WANO since 2002 To assist with the improvement of safety performance at Sellafield by increasing the peer review and challenge World Association of Nuclear Operators (WANO) mission is: To maximise the safety and reliability of the operation of nuclear power plants by exchanging information and encouraging communication, comparison and emulation amongst its members In 2002 British Nuclear Group Sellafield Ltd applied to join WANO and became the first non power plant to join WANO Four peer reviews have been carried out at Sellafield by WANO since 2002 To assist with the improvement of safety performance at Sellafield by increasing the peer review and challenge World Association of Nuclear Operators (WANO) mission is: To maximise the safety and reliability of the operation of nuclear power plants by exchanging information and encouraging communication, comparison and emulation amongst its members In 2002 British Nuclear Group Sellafield Ltd applied to join WANO and became the first non power plant to join WANO Four peer reviews have been carried out at Sellafield by WANO since 2002

6. Why we want to measure the conduct of work Many safety indicators are measures of outcomes Key measures show significant improvement: We have made continuous improvement in safety for several years and our existing key performance measures show significant improvement: Our �Target is Zero� accidents, incidents and environmental events. The closer we get to this target the less data we collect on these lagging measures We want to maintain this continuous improvement We have made continuous improvement in safety for several years and our existing key performance measures show significant improvement: Our �Target is Zero� accidents, incidents and environmental events. The closer we get to this target the less data we collect on these lagging measures We want to maintain this continuous improvement

7. Why we want to measure the conduct of work To measures human performance, organisation effectiveness and leadership To know the depth of our safety defences To compare the conduct of work on different clean up facilities To accelerate the clean up at Sellafield, with increased assurance that the work will be conducted safely: Very few measures of human performance, organisation effectiveness and leadership exist We want to know the depth of our safety defences, well before they are breached We want to compare the conduct of work on different clean up facilities, with different hazards We want to accelerate the clean up at Sellafield, and increase the assurance that the work will be conducted safely: Very few measures of human performance, organisation effectiveness and leadership exist We want to know the depth of our safety defences, well before they are breached We want to compare the conduct of work on different clean up facilities, with different hazards We want to accelerate the clean up at Sellafield, and increase the assurance that the work will be conducted safely:

8. How the measurement system was developed WANO Peer Review findings were reviewed WANO Peer Review findings were reviewed WANO Performance Objectives were selected to address the commonly occurring shortfalls Simple, easy to understand Objectives were defined for the conduct of the work in Clean Up at Sellafield These Objectives were peer reviewed by people with extensive international experience in clean up work to ensure that they were appropriate for decommissioning We decided that ownership and understanding of the Objectives by the workforce was fundamental to success WANO Peer Review findings were reviewed WANO Performance Objectives were selected to address the commonly occurring shortfalls Simple, easy to understand Objectives were defined for the conduct of the work in Clean Up at Sellafield These Objectives were peer reviewed by people with extensive international experience in clean up work to ensure that they were appropriate for decommissioning We decided that ownership and understanding of the Objectives by the workforce was fundamental to success

9. Ownership and understanding of the Objectives by the workforce is fundamental  Tell me.....

10. How the measurement system was developed:Relationship between Clean Up Conduct of Work Objectives

11. How the measurement system was developed Considered how the Conduct of Work Objectives be achieved Led to the definition of criteria for each of the Objectives Current conduct of work rated against these criteria by assigning a numerical value Used Microsoft Excel to record and analyse the numerical values Checked the proposal and received encouraging feedback We considered how the Conduct of Work Objectives could be achieved This led to the definition of criteria for each of the Objectives We started to rate our current conduct of work against these criteria and realised that this could provide the basis of a measurement system: - assign a numerical value We used Microsoft Excel to record and manipulate the numerical values thereby developing the draft measurement tool We tested our idea on several people and received encouraging feedback We considered how the Conduct of Work Objectives could be achieved This led to the definition of criteria for each of the Objectives We started to rate our current conduct of work against these criteria and realised that this could provide the basis of a measurement system: - assign a numerical value We used Microsoft Excel to record and manipulate the numerical values thereby developing the draft measurement tool We tested our idea on several people and received encouraging feedback

12. What the measurement system consist of

13. What the measurement system consist of Ranking of importance It was recognised that each Objective may have a different level of importance in each plant i.e. a �graded approach� was needed The level of importance was assigned by the plant teams who understand the risk/hazard /consequence Ranking assigned a value between 0 and 10

14. Rank & Rate

15. What the measurement system consist of  (Criteria) �Graded approach� according to the risk, hazard, consequences of the work Criteria for each Objective may be different Criteria defined by teams in each plant and endorsed by independent. Criteria define what will be seen when the Objective is achieved in that plant i.e. observable facts Plant can be inspected for evidence of these observable facts i.e. how fully are the Criteria being met, and a value assigned between 1 and 10 Requirement to apply the WANO Objectives according to the risk, hazard, consequences of the Clean Up work e.g. Containment of spent fuel is different to the demolition of a redundant fire station. Criteria for each Objective may therefore be different The Criteria have been defined by the teams in each area. Involvement creates ownership and understanding The Criteria are what will be seen when the Objective is achieved in that plant i.e. they are observable facts The plant can therefore be inspected to look for evidence of these observable facts i.e. how fully are the Criteria being met, and a value assigned between 1 and 10 Requirement to apply the WANO Objectives according to the risk, hazard, consequences of the Clean Up work e.g. Containment of spent fuel is different to the demolition of a redundant fire station. Criteria for each Objective may therefore be different The Criteria have been defined by the teams in each area. Involvement creates ownership and understanding The Criteria are what will be seen when the Objective is achieved in that plant i.e. they are observable facts The plant can therefore be inspected to look for evidence of these observable facts i.e. how fully are the Criteria being met, and a value assigned between 1 and 10

16. Rank & Rate

17. What the measurement system consists of

18. What the measurement system consists of - Example

19. EXAMPLE ONLY Jack, After slide 14 I suggest that we show them a picture of the right hand side of the tool i.e. the example objective and criteria Then after that, we show (separately) the left hand side of the tool i.e. the four quadrants This will then lead to the existing slide of the tool (current slide 16) where the two things can be seen side by side Jack, After slide 14 I suggest that we show them a picture of the right hand side of the tool i.e. the example objective and criteria Then after that, we show (separately) the left hand side of the tool i.e. the four quadrants This will then lead to the existing slide of the tool (current slide 16) where the two things can be seen side by side

20. What the measurement system consist of

21. What the measurement system consist of SORTED

22. Criteria ranking and rating index

23. What the measurement system consist of

24. Picture of defences

25. Focus on most important

28. How the measurement is being used Involvement of team to define Criteria develops understanding and ownership of Objectives Teams using system to carry out self assessment Self assessment establishes a benchmark and allows improvements to be prioritised and planned. Method of self assessment used for last six months in Clean Up Initially the involvement of the team to define the Criteria for the conduct of work objectives develops an understanding of the Objectives and ownership of them. The team in each plant are using the measurement system to carry out a self assessment based on their knowledge of how fully each criteria is currently being met. This self assessment performs a gap analysis that establishes a benchmark and allows the improvements to be prioritised and planned. We have been using this method for self assessment within the Clean Up team at Sellafield for the last six months Initially the involvement of the team to define the Criteria for the conduct of work objectives develops an understanding of the Objectives and ownership of them. The team in each plant are using the measurement system to carry out a self assessment based on their knowledge of how fully each criteria is currently being met. This self assessment performs a gap analysis that establishes a benchmark and allows the improvements to be prioritised and planned. We have been using this method for self assessment within the Clean Up team at Sellafield for the last six months

29. How the measurement system is being used 15 self assessments carried out using the system This has involved approximately 150 people: Superintendents Middle managers Team Leaders Operatives Feedback has been positive We have carried out 15 self assessments using the system This has involved approximately 150 people: Superintendents Middle managers Team Leaders Operatives Feedback has been positive: Increased understanding of Conduct of work Objectives Liked the visualisation of their assessment We have carried out 15 self assessments using the system This has involved approximately 150 people: Superintendents Middle managers Team Leaders Operatives Feedback has been positive: Increased understanding of Conduct of work Objectives Liked the visualisation of their assessment

30. How the measurement system is being used Intend to complete the gap analysis throughout Clean Up portfolio Director of Clean Up is setting personal targets to improve the conduct of work The conduct of work will be measured by observation before the end of 2006/07 The measurement will independently led, and involve the operators in order to generate ownership of the findings The measurement will identify next phase of improvement We intend to complete the gap analysis in each part of the Clean Up portfolio The Director of Clean Up is setting personal targets for the Superintendents to improve the conduct of work The conduct of work in each Superintendents area will be measured by observation before the end of 2006/07 The observation team will be led by an independent person, and will involve the operators in order to generate ownership of the findings The results of the measurement will determine the achievement of the personal targets, it will also enable the next phase of the improvement plans to be identified and prioritised We intend to complete the gap analysis in each part of the Clean Up portfolio The Director of Clean Up is setting personal targets for the Superintendents to improve the conduct of work The conduct of work in each Superintendents area will be measured by observation before the end of 2006/07 The observation team will be led by an independent person, and will involve the operators in order to generate ownership of the findings The results of the measurement will determine the achievement of the personal targets, it will also enable the next phase of the improvement plans to be identified and prioritised