Greg Coventry Compliance Auditor Operations & Planning

1. Job Tasks The Foundation of an Effective Training Program Greg Coventry Compliance Auditor Operations & Planning Western Electricity Coordinating Council

2. BES Reliability Related Tasks Western Electricity Coordinating Council

3. Discussion of: • Purpose of PER-005 • Systematic Approach to Training (SAT) • Importance of System Operator Training & Tools • Importance of a Training Plan/Program Agenda Western Electricity Coordinating Council

4. Primary focus on: • Why a systematic approach to training is task based? • Why training is most efficient and effective when developed and conducted at the task level? • What is a Task? • What is a BES Company Specific, Real-time Reliability-related Task (RRT)? Agenda Western Electricity Coordinating Council

5. Identification and development of an effective “BES company specific, Real-time, Reliability-related Task list” Focus Western Electricity Coordinating Council

6. … a systematic approach to training is task based? Why… Western Electricity Coordinating Council

7. …training is most efficient and effective when developed and conducted at the task level? Why… Western Electricity Coordinating Council

8. What is a task? Where to find information for task identification • Characteristics of a Task Statement • What does a task statement look like? Tasks Western Electricity Coordinating Council

9. What is… • …a BES, company specific, RRT? • Can it be defined? • How to distinguish what tasks are RRTs Western Electricity Coordinating Council

10. Power System: Audience for RRT • Operations personnel • Operations support personnel • Operations training personnel • Operations Management Personnel Western Electricity Coordinating Council

11. PER-005-2 [R1]/[R2] * For personnel identified in Applicability Section 4.1.4.1 Western Electricity Coordinating Council

12. PER-005-2 [R1]/[R2] * For personnel identified in Applicability Section 4.1.4.1 Western Electricity Coordinating Council

13. What’s all the hubbub about? PER-005-2 Purpose: To ensure that personnel performing or supporting Real-time operations on the Bulk Electric System are trained using a systematic approach . Western Electricity Coordinating Council

14. Systematic Approach to Training (SAT) Determines: The skills and knowledge needed to perform BES company-specific Real-time reliability-related tasks What training is needed to achieve those skills and knowledge Western Electricity Coordinating Council

15. Systematic Approach to Training (SAT) Determines: If the learner can perform the BES company-specific Real-time reliability-related task(s) acceptably in either a training or on-the-job environment If the training is effective, and make adjustments as necessary Western Electricity Coordinating Council

16. Mission #1 System Operators primary job responsibility Maintain the BES in a reliable state Keep the lights on & meters turning Western Electricity Coordinating Council

17. Maintaining system reliability: Mission #1 Real-time system operations is where the rubber meets the road Real-time => Present time as opposed to future time In the moment…now…immediately Western Electricity Coordinating Council

18. Maintaining system reliability: System Operators (SOs) • System Operators are an entities most important asset for maintaining system reliability • Regardless of what happens on the BES, it’s the job of the SO to respond Western Electricity Coordinating Council

19. Maintaining system reliability: System Operator Training & Tools Training, tools, and support are essential to the SO in the performance of their jobs… and ultimately, Reliability of the BES Western Electricity Coordinating Council

20. Provides a methodology to establish and continually support a training program for system operations staff directly involved in operation of the Real-time power system. Training Plan This includes: • SOs • Operations support personnel whose functions could impact the reliability related performance of the SOs Western Electricity Coordinating Council

21. What is important: Training Plan Methodology Systematic Approach to Training (SAT) • Primary methodology used to develop a Training Plan • Many variations to the application of the SAT process • Exact SAT model employed is secondary to the results obtained • Training requirements are first identified • Training solutions developed and delivered • Operations staff are continually trained and evaluated in an efficient and effective manner Western Electricity Coordinating Council

22. Baseline Requirements • To establish a baseline of knowledge for the training program • All SO trainee candidates are assumed to meet the minimum requirements as stipulated in the company job description • Operations support personnel are assumed to be competent in their specific fields • Telecommunications • Operations engineers • EMS engineers • Operations training personnel • Load forecast analysts Western Electricity Coordinating Council

23. SAT Task Based • SO Tasks are the individual foundational elements of the overall job responsibilities • Ability to apply skills and knowledge required to perform tasks sequentially or concurrently is an essential function of the SO responsibilities • Competency at performing tasks associated with a given SO position is required for overall job proficiency • Competent SOs are skilled switch-taskers Western Electricity Coordinating Council

24. Systematic Approach to Training (SAT) Training is most efficient and effective when developed and conducted at the task level • Begin with basic simple and frequently performed tasks – create the initial foundation – task by task • Develop skills and competency by building on that foundation and challenging trainee to perform increasingly difficult tasks sequentially or concurrently as needed • Once fully trained, a competent SO will be able to perform tasks as needed by Real-time conditions with confidence Western Electricity Coordinating Council

25. Systematic Approach to Training (SAT) True competency is developed over time, with experience, continued training, and development of an intuitive feel for the “company-specific” system Western Electricity Coordinating Council

26. Systematic Approach to Training (SAT) A typical training plan in NERC employs the SAT process through the five step ADDIE training model: Analysis Design Development Implementation Evaluation Western Electricity Coordinating Council

27. ADDIE Western Electricity Coordinating Council

28. Analysis Analysis phase is used to: • Determine training needs • Identify training requirements Most important input for developing learning objectives and any associated training content in later phases of the process Western Electricity Coordinating Council

29. Analysis To ensure a properly focused training program: • Needs Analysis • Job Analysis • Task Analysis Western Electricity Coordinating Council

30. NeedsAnalysis New training programs start with a Needs Analysis • Identify training needs of the target audience and determine what the training solution should be • Defining the training objective • Collecting relevant information (job descriptions, SME interviews, etc.) • Defining the implication (goal of training, training type, target audience, scope, etc.) Western Electricity Coordinating Council

31. JobAnalysis Starting point used to create a list of tasks for a specific job (i.e. System Operator) • System Operator job functions can be divided into “duty areas” • System Reliability • Transmission Operations • Generation • Balancing • Interchange • Emergency Operations Western Electricity Coordinating Council

32. JobAnalysis Starting point used to create a list of tasks for a specific job (i.e. System Operator) • System Operator job functions can be also be identified by position / AOR • Reliability Coordinator (RC) • Transmission Operator (TOP) • Balancing Authority (BA) Western Electricity Coordinating Council

33. TaskAnalysis What is a task? • A work activity that: • Has a definite beginning and end • Is measurable or observable • Consists of two or more definite steps, and • Leads to a desired outcome Western Electricity Coordinating Council

34. TaskAnalysis Sources for identifying Tasks • Industry colleagues and experts • NERC Reliability Standards • Job description • Internal Procedures • Corporate Policies • Internal Interviews Western Electricity Coordinating Council

35. TaskAnalysis Once available sources are identified: • Consult with industry colleagues and SMEs • Best practices • Review of available job information • NERC Standards • Job description • Operating procedures • Company policies (safety and other) • Prepare interview questions • Conduct interviews and observe on-shift conditions • Develop a preliminary task list by Duty Area (repeat steps above as needed) Western Electricity Coordinating Council

36. TaskAnalysis • Finalize the comprehensive task list • Categorize tasks • For each task, write a task statement that describes the task Western Electricity Coordinating Council

37. Task Statement What is a Task Statement? • Narrative description of the task: • Describes a given condition • Describes actions to be taken by the SO • Describes the desired outcome • Measurable or Observable Western Electricity Coordinating Council

38. Task Statement Example 1: Task: Respond to actual or potential transmission system SOL violations in accordance with company operating procedures and current system conditions Task Statement: Given a System Operating Limit violation on the transmission system, implement the correct procedure for the circumstances to restore loading to within normal operating limits Western Electricity Coordinating Council

39. Task Statement Description of given operating condition • Given a System Operating Limit violation on the transmission system, implement the correct procedure for the circumstances to restore loading to within normal operating limits Western Electricity Coordinating Council

40. Task Statement Description of actions to be taken by the SO • Given a System Operating Limit violation on the transmission system, implement the correct procedure for the circumstances to restore loading to within normal operating limits Western Electricity Coordinating Council

41. Task Statement Description of desired outcome • Given a System Operating Limit violation on the transmission system, implement the correct procedure for the circumstances to restore loading to within normal operating limits Western Electricity Coordinating Council

42. Task Statement Example 2: Task: Monitor generator bus voltage and MVAR output to ensure that they are maintained within agreed schedules and take action to correct deviations as needed Task Statement: Given System Operating conditions, identify deviations in generator voltage and/or MVAR output, and initiate actions or direct the actions of others to restore generator bus voltage and MVAR output pursuant to schedules provided by the TOP Western Electricity Coordinating Council

43. Task Statement Description of given operating condition • Given System Operating conditions, identify deviations in generator voltage and/or MVAR output, and initiate actions or direct the actions of others to restore generator bus voltage and MVAR output pursuant to schedules provided by the TOP Western Electricity Coordinating Council

44. Task Statement Description of actions to be taken by the SO • Given System Operating conditions, identify deviations in generator voltage and/or MVAR output, and initiate actions or direct the actions of others to restore generator bus voltage and MVAR output pursuant to schedules provided by the TOP Western Electricity Coordinating Council

45. Task Statement Description of desired outcome • Given System Operating conditions, identify deviations in generator voltage and/or MVAR output, and initiate actions or direct the actions of others to restore generator bus voltage and MVAR output pursuant to schedules provided by the TOP Western Electricity Coordinating Council

46. Task Statement Example 3: Task: Run real-time contingency analysis to determine next worst contingencies and their impact on BES reliability Task Statement: Given System Operating conditions, perform a RTCA, identify the next worst contingency and determine their impact on BES reliability Western Electricity Coordinating Council

47. Task Statement Description of given operating condition • Given System Operating conditions, perform a RTCA, identify the next worst contingency and determine their impact on BES reliability Western Electricity Coordinating Council

48. Task Statement Description of actions to be taken by the SO • Given System Operating conditions,perform a RTCA,identify the next worst contingency and determine their impact on BES reliability Western Electricity Coordinating Council

49. Task Statement Description of desired outcome • Given System Operating conditions, perform a RTCA, identify the next worst contingency and determine their impact on BES reliability Western Electricity Coordinating Council

50. Task Statement: Practice Practice 1: Evaluate scheduled generation outage based on current or anticipated system conditions and decide to authorize or postpone based on system reliability requirements Western Electricity Coordinating Council