LCLS Operations and Maintenance Management: Overview and Schedule

1. LCLS Operation in 2009 Roger A. Erickson Accelerator Systems Division (ASD) LCLS Project Review (SLAC) May 13-15, 2008

2. Topics • Accelerator System Division Overview • Maintenance management • Down time planning • Overall schedule • Scheduling beam time • Delivered beam specification

3. ASD has operated many accelerators: • Linac: 1965-2008 • SPEAR I&II: 1973-1992 • PEP: 1979-1988 • SLC: 1986-1998 • FFTB: 1998-2007 • SPPS: 2004-2007 • PEP-II: 1998-2008 • LCLS: 2007-?

4. LCLS: Linac Coherent Light Source SLAC ACCELERATOR FACILITIES Turn-on in 2009: LCLS will be the World’s First X-ray Laser

5. Linac Operating Modes in FY2009 • LCLS beam: • 4 to 14 GeV e- beam up to 120 Hz up to 1 x 1010 • Linac capabilities (if needed): • e- to 49 GeV at 120 Hz at 2 x 1010 • e+ to 49 GeV at 120 Hz at 2 x 1010

6. Main Control Center for LCLS Operations

7. Operations Authorization • Authorization for operating the Linac facilities at SLAC follows the organization of the SLAC laboratory: • SLAC DOE Site Office • Laboratory Director • Associate Laboratory Directors for LCLS and PPA • Head of the Accelerator Systems Division • Head of the Operations Group • Engineering Operator In Charge (EOIC) in the Control Room

8. ASD Mission • 1) Operate SLAC accelerator systems safely. • 2) Deliver beams to support the physics research programs. • 3) Document and improve reliability of linac operations. • 4) Coordinate accelerator maintenance. • 12 km of tunnel • 22 km of beam lines • 28 support buildings • Guiding documents: • SLAC Guidelines for Operations • ASD Operations Directives • Safety Assessment Documents • ES&H documentation • ASD documentation hierarchy

9. ASD Staff • Admin: 4 • Safety office: 2 • Physicists: 15 • Mechanical engineers: 5 • Operations and reliability: 5 • Operators: 26 • Area managers: 7 • Technicians: 3 • LCLS physics + laser staff: 10 • Total = 77

10. Program Management • Accelerator programs are managed through a matrix organization structure with links to: • Program Coordinators for LCLS Linac Pulsed Programs. • System Physicists for each major section of the accelerator facility. • Area Managers – one for each major section, who report to the System Physicists. • Experimental floor managers for x-ray systems. • Accelerator physicists and engineers responsible for subsystems or commissioning tasks. • Technical support departments with engineering and technician support for on-call maintenance. • Accelerator Division Safety Office. • ES&H departments, including Radiation Physics.

11. Planning with Accelerator Users and Maintenance Staff • 8:00 Meeting every day, seven days a week, in the MCC conference room. • Operations report by EOIC, including run time statistics, progress in carrying out scheduled program, descriptions of problems, etc. • Attended by PPA, ASD, and Operations management reps, Program Deputy, System Physicists, Area Managers, and representatives of user groups and major technical support departments. • 8:15 Maintenance Meeting, five days each week. • Run by Accelerator Operations Department maintenance managers. • Attended by supervisors of all maintenance groups, Area Managers, and interested physicists and engineers. • Accelerator Plans Meeting, weekly. • Review of operational progress, problems, and plans. • Attended by Accel Systems Div managers, Program Coordinators, ADSO, and dept heads of key support departments.

12. Control Room Staffing • Program Deputy • Duty rotates among ASD physicists. • Oversees program for period of several days. • Operations Engineer • 1 EOIC per shift (from a group of 7), on rotating 7-week cycle. • Responsible for safely carrying out the scheduled program. • Must be present if accelerator is capable of producing beam. • All have experience as accelerator systems operators. • Accelerator Systems Operators Typically 2 operators per shift on rotating 5-week cycle: • Linac and sources. • Secondary program, PPS control, and backup. • Tunnel searches, BCS and interlock checks. • Accelerator System Physicists Determine beam parameters; develop upgrades.

13. Maintenance Management • Problems that interrupt the scheduled program trigger immediate repairs to restore operations. • On-call staff for: • Electrical power • Mechanical utilities • Power supplies • RF systems • Magnets and other mechanical systems • Vacuum systems • OHP • Extensive call-in lists identify first responders, alternates, and experts for all systems. • Preventive and deferred maintenance planned for scheduled maint. days.

14. Planned and Opportunistic Maintenance Approach: • Installation and preventive maintenance jobs are pre-planned. • Repair work is managed to minimize program impact. • Coordination • Daily 8:15am meeting. • Coordinated by Operations Maintenance Office. • Area Managers are advocates for their areas. • Standby Maintenance List (SML) • Jobs that are planned and can be launched on short notice. • Provides options for EOIC to take advantage of unscheduled interruptions. • Scheduled Repair Opportunity Days (ROD) • Carefully planned; typically involved 100 or more jobs in PEP-II era. • ARTEMIS Electronic Database

15. ARTEMIS • ARTEMIS (Accelerator Remedy Trouble Entry and Maintenance Information System) is an Oracle database with a Remedy interface, accessible over the internet by everyone involved with SLAC accelerator maintenance. • Operators report problems as they occur by making entries in ARTEMIS. • Repair work is launched immediately if a problem is inhibiting the scheduled accelerator program. Otherwise, problems are reviewed in the Maintenance Meeting and response plans are prepared. • Jobs are tracked using ARTEMIS until they are finally closed. • ARTEMIS entries since Jan 1989: ~84000. • ARTEMIS entries in one year (2006): • 3166 new problems (8.7 per day). • 3296 problems closed (9.0 per day).

16. X-ray User Performance Drivers for ASD • Reliable operation with high uptime (>95%). • Steady beam parameters when operating. • Rapid change of beam parameters when needed by the users. • Maintain alternate user programs when expected user program changes.

18. Looking ahead: typical LCLS weekly report in 2010

20. Long Down Time Planning • Long Down Times usually occur once each year and typically last two to three months. • Area Managers collect job requests from system physicists, project engineers, maintenance groups, and the ARTEMIS database. • A comprehensive schedule is prepared, updated, and reviewed at weekly meetings, starting about four months before the down time. • This schedule lists each job with an assigned shop, and lists the Project or Group Manager, Responsible Task Person, and Area Manager. • Schedule specifies time and duration of each job (with 1 day time resolution), and number of persons required. • Schedule specifies authorizations required (WAF, RSWCF, EWP, etc.). • Detailed (shift by shift) schedule of pre-run testing, safety certifications, and turn-on activities is prepared by the Operations Dept and revised as needed on a real-time basis.

21. Accelerator Improvement Projects (AIP)

22. Operational Safety Reviews • Linac Re-Start Validation Review (March 2005) • Integrated Safety Management (ISMS) Review (Sept 2005) • DOE ISMS Review (October 2005) • LCLS Injector Accelerator Readiness Review (December 2006) • LCLS beam authorization to BSY (June 2007) • Linac SAD update (November 2007) • Linac ASE update (December 2007) Still ahead: • LCLS LTU/Undulator/Dump SAD (2008) • LCLS LTU/Undulator/Dump ARR (November 2008)

23. LCLS Installation and Commissioning Time-Line First Light in FEE First Light in FEH PPS Cert. LTU/Dump LTU/Und/Dump Install X-Rays in NEH CD-4 (7/31/2010) FEE/NEH Install FEH Hutch BO FEH Install PEP-II run ends now J F M A M J J A S O N D J F M A M J J A S O N D J F M A M J J A A M 2008 2009 2010 Down PPS LTU/Und Comm. Linac/BC2 Commissioning Re-commission Inj/BC2 to SL2 NEH Operations/ Commissioning FEE Comm. April 18, 2008

24. Scheduling Beam Time • ASD will work with the LCLS beam time scheduling team to allocate accelerator time in the most advantageous manner: • User needs • Machine recovery time (after downs) • Machine improvement time • Maintenance periods

25. Delivered Beam Specifications • A set of beam parameters should be specified to characterize “first run” beam parameters (nominal, expected variations, allowed variations): • Bunch charge • Bunch length • Bunch energy • Bunch size • A mechanism will be set up to facilitate communications between users and accelerator operators and to resolve conflicting requests from different users.

26. Proposed Initial Beam Parameters J. Galayda

27. Conclusions • Linac operations are managed by the Accelerator Systems Division under the LCLS Directorate starting in FY2008. • Documented policies and procedures exist or are being prepared for all safety-related accelerator activities. • Maintenance and installation work is accomplished through a matrix organization, drawing on engineers, technicians, ES&H expertise, and shop services from the ETS Directorate. • We have developed organizational structures, software tools, and documentation that enable us to manage an ambitious accelerator-based science program safely and effectively. • A beam-time scheduling mechanism is being developed to resolve operational beam parameter specifications and changes.