1 / 26

M&O Scrutiny Group Report to LHC Resource Review Boards

M&O Scrutiny Group Report to LHC Resource Review Boards. 11 – 13 October 2010. Bernd L ö hr. DESY. Page 1. Composition of the Scrutiny Group in 2010: unchanged from last year.

geoffrey-mcclain
Download Presentation

M&O Scrutiny Group Report to LHC Resource Review Boards

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. M&O Scrutiny Group Report to LHC Resource Review Boards 11 – 13 October 2010 Bernd Löhr DESY Page 1

  2. Composition of the Scrutiny Group in 2010:unchanged from last year Giovanni Batignani (INFN Pisa) George Ginther (FNAL,Rochester University) Gabriele Cosmo (CERN) Bernd Löhr (DESY, Chair) Paul Dauncey (Imperial College London) Gerhard Mallot (CERN) Martyn Davenport (CERN) Emmanuel Tsesmelis (CERN) Christinel Diaconu (Marseille) Michał Turała (INP PAN Cracow) Scientific Secretary: Sascha Schmeling (CERN) Outline of the Presentation: • Report on the five LHC experiments • General topics of discussion with all experiments Page 2

  3. ALICE budgets and costs including NMS power costs ALICE ALICE closing Report 2009: Actual costs w/o power 4,887 kCHF Budget w/o power 4,687 kCHF Power costs 513 kCHF Power costs NMS (budget) 153 kCHF Refund to NMS 79 kCHF Actual NMS power costs 74 kCHF ALICE request for 2011 M&O A and projections to 2014 in kCHF: • On-line computer replacement delayed -> reduced request in 2011 but peak in 2012. • Improvement of ventilation of the magnet and humidity control. • Presently no detector opening foreseen during technical stop at end of 2010. The SG recommends the approval of the ALICE closing report for 2009 and the M&O A budget request for 2011. Page 3

  4. ATLAS budgets and costs including NMS power costs ATLAS ATLAS M&O A closing Report 2009: Actual costs w/o power 13,472 kCHF Budget w/o power 13,610 kCHF Power costs for Non-Member-States 936 kCHF ATLAS request for 2011 M&O A and projections to 2015 in kCHF: Major points of discussions: • Inner-Detector Cooling • Magnet consolidation program • IBL project • On-line hardware replacement Page 4

  5. ATLAS (cont. 1) Inner Detector (ID) cooling compressors: The existing compressors do not guarantee a reliable long-term operation. Two technical solutions are under study: thermo-siphon or compressor with magnetic bearing. SG requested approval by LHCC. So far LHCC encouraged the collaboration to continue studies and to find a solution. Magnet-system consolidation program: This program started already in 2009. Main objectives are: magnet related improvements, spare compressor and turbo pumps, improved cryogenics control, improvements of helium system for faster recovery after dump. Page 5

  6. ATLAS (cont. 2) Insertable B-Layer (IBL): Initially replacement of radiation-damaged pixel detector layer, now partly an upgrade. The project foresees contributions from M&O A and M&O B. The M&O A part includes modifications of beam pipe, partly new Beryllium pipe, new tooling for removal and re-installation, power supplies and cabling. The SG has asked for approval of the project by the LHCC. This is outstanding. An interim MoUis being signed by the involved Funding Agencies. A TDR has been submitted to the LHCC. On-line hardware replacement: Completion of DAQ system (3010 processors)was planned for 2010. Now stretched until 2013. delayed replacement costs. Page 6

  7. ATLAS (cont. 3) ATLAS M&O B: Closing report for 2009: spent 6,246 kCHF to be compared to budgeted 6,976 kCHF. Cumulative cash balance for M&O B is now 2,154 kCHF M&O B budget requests: The SG’s recommendation concerning ATLAS; The SG recommends the approval of the ATLAS closing reports for M&O A and M&O B of 2009. The SG recommends the approval of the M&O B budget request for 2011. The recommendation of the 2011 budgets for the IBL and for the consolidation of the Inner Detector cooling are contingent on the approval of these projects by the LHCC. Page 7

  8. CMS CMS budgets and costs including NMS power cost CMS closing Report 2009: Actual costs w/o power 13,596 kCHF Budget w/o power 10,408 kCHF Power costs for Non-member states 196 kCHF CMS request for 2011 M&O A and projections to 2014 in kCHF: • Large over-spend in 2009. • Repair of end-cap cooling (bushings) at end 2009 and • beginning 2010. Major points of discussions : Page 8

  9. CMS (cont. 1) Large over-spend in 2009: • The long shutdown period in 2009 higher costs for manpower, specialized teams necessary. • The new running schedule of the LHC with no shutdown in 2011 required preparations • for the long shutdown in 2012 already in 2009. Integrated savings up to 2008 are used to cover part the deficit in 2009. CMS will try to cover remaining 488 kCHF deficit by additional savings in 2010/2011. Possible items where savings might be possible have been indicated to the Scrutiny Group. Repair of bushings: • Unexpected failure of bushings in the cooling circuit of one end-cap at the end of 2009. Repair of bushings from December 2009 to February 2010. Additional costs of 1,121 kCHF generated in 2010. These costs cannot be accommodated in 2010 budget, they are moved to the 2011 budget request. On-line and off-line computing: • Postpone on-line hardware replacement to 2012-2013. This saves 1.9 MCHF in 2011. • Reduce request for off-line computing from 4 FTEs to 3 FTEs. The SG recommends the approval of the CMS closing report for M&O A of 2009 and the budget request for 2011. Page 9

  10. LHCb LHCb budgets and costs including NMS power costs LHCb closing report 2009: Actual costs w/o power 2,387 kCHF Budgetw/o power2,386 kCHF Power costs for Non-Member States 84 kCHF LHCb requests for 2011 M&O A and projections to 2014 in kCHF: LHCb foresees to complete the on-line farm by end of 2010 LHCB on-line hardware: replace components only when broken, assume a typical lifetime of six years. Almost constant spending profile for on-line hardware replacement The SG recommends the approval of the LHCb closing report for 2009 and the M&O A budget request for 2011. Page 10

  11. TOTEM TOTEM closing report 2009: Actual costs 410 kCHF Budget449 kCHF No power costs arise for the TOTEM experiment Taking into account the carry-over from previous years, The integrated cash balance is presently 6 kCHF. TOTEM requests for 2011 M&O A and projections to 2014 in kCHF: TOTEM wants to install the T1 detector components during the technical stop at the end of 2010. This is a combined operation with CMS. TOTEM and CMS are currently estimating the costs and are negotiating with CERN management the related funding. The Scrutiny Group recommends that TOTEM and CMS formalize their financial inter-dependence. The SG recommends the approval of the TOTEM closing report for 2008 and the M&O A budget request for 2010. Page 11

  12. General points of discussion New operational model of experiments: The experiments have been asked to estimate the difference between ‘full running years’ and ‘shutdown years’ for their M&O A requirements. Running years: full power and gas consumption, full manpower needs for DAQ. Shutdown years: additional manpower costs for detector maintenance, partially balanced by less gas and power consumption. Shutdown years are in general only slightly more expensive considering regular maintenance, but necessary repairs may create a peak in expenditures. Replacement of EVO: Presently a commercial system, VIDYO, is under test by the IT-Division and the LHC experiments as an alternative to EVO. Previous assumption was that only a one-time license fee will have to be paid for VIDYO which will be borne by CERN. Therefore the experiments planned for 50% of last years EVO costs for 2010 and nothing for the following years. This was the advice of the DRC. Recent news from IT indicate that permanent costs will also arise for VIDYO, however, less that for EVO. It is not yet decided to what extent the experiments will be charged if VIDYO will be chosen to replace EVO. Page 12

  13. Safety, a new level-2 item: The experiments face considerable expenses for installation and training courses which are related to personnel and radiation safety. These costs are now collected under a new level-2 item, Safety, which is different from the existing one, Detector Safety Systems. Page 13

  14. On-line hardware replacement: Agreement between LHC experiments and CERN management on replacement policy: “Response from the LHC experiments to the RRB Scrutiny Group concerning the Maintenance and Operation of online systems (Trigger, Data Acquisition, Event Filter Farms, and Control Systems” dated 6 September 2004. Concerning the replacement rates of hardware this document states: • Disks and fileservers typically after 3 years • PCs typically after 4 years • Network switches typically after 5 years Already in 2008, the DRC questioned the validity of this model and the Scrutiny Group expressed the same opinion. It was decided to review the model with all LHC experiments together after they gained some experience with real data taking. The LHC experiments agree to this but insist that the revision will be done in a uniform process for all experiments. The Scrutiny Group strongly suggests that requests for the 2012 budget, to be made in April 2011, should be based on a revised model. The DRC and the Scrutiny Group have agreed that a revision process will be started this year and a new model will be worked out by the end of February 2011. Page 14

  15. Accidents and unexpected urgent repairs: The unexpected failure of the CMS end-cap cooling, resulting in the necessary immediate repair of the bushings, is a type of event which can happen again anytime, also in the other experiments. The Scrutiny Group recommends the installation of a mechanism which addresses the financial aspect of unexpected events which require immediate spending of a larger amount of money not foreseen in the budget. Part of such a mechanism must be the early transmission of information to the CERN management, the Funding Agencies and the Scrutiny Group as well as a fast feedback from the Funding agencies and from the Scrutiny Group. “Fluctuating budgets” vs. “flat budgets”: Up to now: efforts to keep M&O A budgets at the same level over years. Now new situation : • DAQ systems are being completed periodic replacement costs; • operating scenario of LHC with long shutdown only every third year; • several large consolidation projects in experiments over the coming years. The real spending profiles for M&O A will be fluctuating considerably. Page 15

  16. Funding Agencies (and experiments?) supposedly prefer “flat budget profile”. The Scrutiny Group prefers fluctuating M&O A budget which reflect the real spending profile. Flat budget means: • money has to be accumulated over years for several different projects • likely to be distributed over different level-2 items; • for a given year this leads to “savings” which may necessitate “surplus refunds” • (CERN-RRB-2006-026); • in case of unexpected large expenses the savings must be protected against the • Scrutiny Group and against the own collaboration; • it makes it increasingly difficult for the Scrutiny Group to perform its task, • follow the money flow, and give a well justified recommendation to the RRB. The Scrutiny Group seeks advice from the RRBs regarding the future procedure. Page 16

  17. Composition of the Scrutiny Group: Five members of the present Scrutiny Group reached the end of their 3 year’s appointment: G.Batigniani (INFN Pisa) M.Davenport (CERN) C.Diaconu (Marseille ) G.Ginther (FNAL, Rochester) E.Tsesmelis (CERN) The Scrutiny Group wants to thank these members for their invaluable contributions to its work. The success of this year’s scrutiny process has been made possible by the fruitful cooperation of the Resource Coordinators and the management of the LHC experiment’s Collaborations, and the excellent material they have provided. Page 17

  18. Additional Information

  19. ATLAS Cost Increases, Cost Reductions 2010 2011: • external cryogenics - 1,190 kCHF • beam-pipe & vacuum + 850 kCHF • safety + 830 kCHF • on-line computing + 1,035 kCHF • magnet consolidation + 297 kCHF • ______________________ • + 1,822 kCHF • total difference w/o power + 1,782 kCHF budgeted cost increases 2011 2012: • beam-pipe & vacuum + 110 kCHF • on-line computing + 1,040 kCHF • magnet consolidation + 858 kCHF • evaporative cooling + 400 kCHF • general services + 250 kCHF • gas consumption - 250 kCHF • ______________________ • + 2,408 kCHF • total difference w/o power + 2,297 kCHF budgeted cost increases

  20. ATLAS New “Safety” Requests 2011: Major contributions: • SX1 rad. protection buffer zone 230 kCHF • neutron shielding USA-UX 150 kCHF • neutron shielding endcap toroids 100 kCHF • ALARA tools 100 kCHF • ventilation consolidation 70 kCHF • C3F8 tank rad. protection 50 kCHF 2012: Major contributions: • neutron shielding USA-UX 200 kCHF • neutron shielding endcap toroids 120 kCHF • ALARA tools 150 kCHF • level 3 alarm processing unit 120 kCHF • fire protection (water mist ) 80 kCHF • ventilation consolidation 70 kCHF

  21. ATLAS Safety

  22. ATLAS Magnet Consolidation

  23. ATLAS On-line Replacement

  24. CMS Cost Development Main changes in budgets are due to detector related costs and on-line computing costs. Year 2009 2010 2011 2012 __________________________________________________________________________________________ detector related budget 3,913 3,633 4,310 1) 3,590 kCHF actual costs 6,394 2) kCHF on-line computing budget 2,400 3,243 2,843 5,891 kCHF actual costs 2,033 kCHF 1) included are 1,128 kCHF spent in 2009 for bushings repair (endcap cooling) 2) savings in previous years is used to cover the overspend except 488 kCHF

  25. CMS Overspend in 2009

  26. CMS Bushings Repair

More Related