BE-CO Operational Exploitation

BE-CO Operational Exploitation BE-CO TC Eugenia Hatziangeli 12 December 2013

Due Explanations • Controls= Control System = Controls infrastructure • Expert= Member of CO who has developed a system (software or hardware) or participated in the development of a system (software or hardware) as part of a project team, who has installed a hardware module or participated in the installation of a hardware module (software or hardware) as part of the installation team • MCC coordinator = Marine Gourber-Pace • Exploitation Manager= Marine Gourber-Pace • (*)will be developed further in Marine’s talk • MCCs E.Hatziangeli - BE/CO/TC

BE-CO Exploitation Strategy from 2014 • 2014 is a special year for controls and it will require special effort by the group • Given the size of renovation both in HW and SW, all Injectorsare considered as completely NEW machines by CO • The support will be analogous to the support given by the CO group the very first time LHC was commissioned • CO will operate under this assumption until the control system is declared stableand operationalby operations E.Hatziangeli - BE/CO/TC

Exploitation in Phases End May 2014: Lin2 BEAM for physics Commissioning Beam in the machine • The exploitation of the Injectors is seen in phases: • HW tests, cold checkout-> Controls Infrastructure is unstable and under validation • Beam setup and Beam Operations (initial period) -> Controls Infrastructure is operational but not fully debugged • Beam Operations -> Controls Infrastructure is operational and fully debugged OP & CO: Controls unstable, under validation OP: Controls is operational CO: Controls fully debugged CO : Controls not fully debugged HW tests Cold Checkout Beam Setup Beam Operations Decreasing number of expert interventions High number of expert interventions Very low number of expert interventions (*) E.Hatziangeli - BE/CO/TC

HW tests, Cold checkout Accelerators under MCCs responsibility Full availability of CO experts End May 2014: Lin2 BEAM for physics • MCCs are responsible to follow up the commissioning of their corresponding machine until the control system is declared fully commissioned • MCC Manager maintains the overview of all issues regarding the machine under commissioning and she will declare the control system fully commissioned • HW tests (under the organisational responsibility of K. Foraz) • Take place during day time • The experts for all software systems and the hardware installation team will be fully availableand implicated in the commissioning to resolve promptly the issues found by operators (*) • Cold Checkout (under the organisational responsibility of OP) • Can be during nights for some accelerators (PSB, PS) • The support is covered by expert list on best effort • Specific experts (mainly on core software system) will be present in the CCCto offer a rapid reactivity to problems seen by operators • These experts will be placed underspecial shift work conditions (*) • Once the control system of an accelerator is declared fully commissioned its responsibility pass from the MCC to the Exploitation Manager (*) Commissioning Beam in the machine OP: Controls is operational OP & CO: Controls unstable, under validation CO: Controls fully debugged CO : Controls not fully debugged HW tests Cold Checkout Beam Setup Beam Operations Decreasing number of expert interventions High number of expert interventions Very low number of expert interventions Maximum bugs should be found and corrected in this phase E.Hatziangeli - BE/CO/TC

Beam setup and Beam Operations (initial period) Accelerators under the Exploitation Manager responsibility High availability of CO experts End May 2014: Lin2 BEAM for physics • The point in time and according to the operational schedule of the Accelerators, OP will declare the start of preparations for Beam Operations • At that date the control system is considered operational by OP but not by CO as the control system might still give rise to unexpected errors during the initial period of Beam Operations • The support model for this period remains similar to the one of the Cold Checkout period but the Exploitation Manager has now the exploitation responsibilityfor all operational machines • The support is covered by expert list on best effort • High availability of CO expertsis expected • If the physical presence of specific experts (mainly software) is required in the CCC, these experts will be placed under special shift work conditions (*) Commissioning Beam in the machine OP: Controls is operational OP & CO: Controls unstable, under validation CO: Controls fully debugged CO : Controls not fully debugged HW tests Cold Checkout Beam Setup Beam Operations Decreasing number of expert interventions High number of expert interventions Very low number of expert interventions E.Hatziangeli - BE/CO/TC

Beam Operations Accelerators under the Exploitation Manager responsibility CO experts on best effort End May 2014: Lin2 BEAM for physics • At that date the control system is considered operational by CO • This day should be preceded by a period of very low number of expert interventions • The controls infrastructure is stable and the risk of problems will be low • Upgrades of the controls infrastructure will be done for justified requests (Eq. gr, OP, CO) and only under the authorisation of Operations • The support is covered by expert list on best effort • The experts on best effort are not required to be under special shift work conditions Commissioning Beam in the machine OP: Controls is operational OP & CO: Controls unstable, under validation CO: Controls fully debugged CO : Controls not fully debugged HW tests Cold Checkout Beam Setup Beam Operations Decreasing number of expert interventions High number of expert interventions Very low number of expert interventions E.Hatziangeli - BE/CO/TC

Best Effort Definition Best-effort support describes a support service in which the service does not provide any guarantees that support is delivered. While the 100% presence and availability of the expert is not guaranteed or expected, there is an assurance that the expert will make his/her best effort to be available and good faith efforts will be made to provide support and to solve the problem • The same organisationof the best effort will be set up for all systems in CO • The exact organisation scheme will be defined by the Exploitation manager in collaboration with the section leaders and activity/project leaders • We are in the process of explaining our support organisation to each equipment group in order to find areas for collaboration • encourage standardisation of support across all equipment groups • share with equipment groups some hardware interventions for replacements of CO modules (*) • visualisation of experts lists (emphasis on protection of experts on best effort) • diagnostics tools The CO support model has been presented and explained to the responsible of the PS Complex Operations and it has been accepted with confidence E.Hatziangeli - BE/CO/TC

How best effort will be implemented in CO • Experts are requested by their SL to participate in the support of their own system, which they have either implemented or they have participated in the implementationas part of a project team • A system, which is supported by best effort, should have a team of experts (competent in this system) in best effort list (*) • The project/activity leader will be responsible for organising the team in such way that there is somebody available on best effort to support the system in the case the CCC calls • A list of experts telephones on best effort per system will be available at the CCC for Operations (*) • A person under best effort accepts to do his/her best to be available to solve problems related to his system when contacted by the CCC but it is clearly understood by the management of CO and of BE that this is a best effort support and not a guaranteed support service like piquet • Every intervention (incl. remote interventions) will be recorded, declared and compensated E.Hatziangeli - BE/CO/TC

Exploitation Manager • The Exploitation manager organises the presence of the experts in the CCC, follows the progress and resolution of all critical/blocking issues and ensures the experts are working with high priority on them • She maintains the overview of all issues and their progress but the experts remain the only responsible to solve the issues • She reports regularly to the Operations responsible and to the GL and SLs all issues that remain unsolved • For non critical issues or issues that need to be tackled by more than one team of experts, she will organise the appropriate meetings and follow their resolution E.Hatziangeli - BE/CO/TC

Problem Escalation • The CCC Operator remains the owner of the problem and the only means of passing the problem to the experts on best effort • If an expert on best effort cannot solve the issue, (s)he will inform the CCC Operatorand will propose another expertto be called • The exact implementation of the problem escalation within CO will be defined by the Exploitation manager and the CO SLs (*) • If an expert on best effort cannot be found and a problem cannot be solved by other means - while is it is declared critical by Operations -, it is escalated to the corresponding Section Leader and then to GL by the CCC operator E.Hatziangeli - BE/CO/TC

Tracking all Interventions • All CO interventions outside working hours will be dully recordedin the operational system of choice (*) • The exploitation manager will analyse them regularly (*) • The number of interventions will give us confidencefor the stability of the controls infrastructure (pass to CO fully debugged phase) • The statistics will be used to improve the weak areasof the controls infrastructure • The amount of interventions in 2014 outside working hours will be used to evaluate and tune our support strategy E.Hatziangeli - BE/CO/TC

Summary • 2014 is a special year for controls and it will require special effort by the group • There will be three exploitation phases • HW tests, cold checkout • Beam setup and Beam Operations (initial period) • Beam Operations • CO support will be based on experts on best effort • Special shift work will be applied on appropriate cases • All outside working hours interventions will be recorded and compensated • The amount of interventions will be used to evaluate and tune the group’s support strategy E.Hatziangeli - BE/CO/TC

BE-CO Operational Exploitation