1 / 23

Prof. David Britton GridPP Project leader University of Glasgow

GridPP24 – Data!. Prof. David Britton GridPP Project leader University of Glasgow. GridPP24 Collaboration Meeting 14 th April 2010. Data Arrives!. The Long Road…. 383 PMB Meetings. 24th GridPP Collaboration Meeting, RHUL, 14-15 April 2010 - Data.

grazia
Download Presentation

Prof. David Britton GridPP Project leader University of Glasgow

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. GridPP24 – Data! Prof. David BrittonGridPP Project leader University of Glasgow GridPP24 Collaboration Meeting 14th April 2010 IET, Oct 09

  2. Data Arrives! PPRP

  3. The Long Road… 383 PMB Meetings 24th GridPP Collaboration Meeting, RHUL, 14-15 April 2010 - Data. 23rd GridPP Collaboration Meeting, University of Cambridge , 8-9 September 2009 – Final Steps 22nd GridPP Collaboration Meeting, UCL, 1-2 April 2009 - Service Resilience 21st GridPP Collaboration Meeting, Swansea University, 3-4 September 2008 - 21: Coming of Age 20th GridPP Collaboration Meeting, Trinity College, Dublin, 11-12 March 2008 - Unreasonableness? 19th GridPP Collaboration Meeting, Ambleside, 29-31 August 2007 – The end of (GridPP2) as we know it 18th GridPP Collaboration Meeting, Glasgow, 20-21 March 2007 17th GridPP Collaboration Meeting, NeSC, Edinburgh, 1-2 November 2006 16th GridPP Collaboration Meeting, QMUL, 27-29 June 2006 15th GridPP Collaboration Meeting, RAL, 11-12 January 2006 14th GridPP Collaboration Meeting, University of Birmingham, 6-7 September 2005 13th GridPP Collaboration Meeting, Grey College Durham, 4-6 July 2005 12th GridPP Collaboration Meeting, Brunel, 31 January-1 February 2005 11th GridPP Collaboration Meeting, Liverpool, 14-15 September 2004 10th GridPP Collaboration Meeting, CERN, Geneva, 2-4 June 2004 9th GridPP Collaboration Meeting, NeSC, Edinburgh, 4-5 February 2004 8th GridPP Collaboration Meeting, Bristol, 22-23 September 2003 7th GridPP Collaboration Meeting, Oxford, 30 June-2 July 2003 6th GridPP Collaboration Meeting, Coseners House, 30-31 January 2003 5th GridPP Collaboration Meeting, Imperial College, 16-17 September 2002 4th GridPP Collaboration Meeting, Manchester, 9-10 May 2002 3rd GridPP Collaboration Meeting, Cambridge, 14-15 February 2002 2nd GridPP Collaboration Meeting, Edinburgh, 5-6 November 2001 1st GridPP Collaboration Meeting, Coseners House, 24-25 May 2001 GridPP24

  4. … to the Start! GridPP24

  5. The Time is Now GridPP24

  6. Since GridPP23 • First Data • Tier-1 Review • RCUK International Review of e-Science • Tier-1 Opening • … and of course the GridPP4 proposal! GridPP24

  7. First Data From an Atlas presentation to wLCG MB GridPP24

  8. Tier-1 Review • Third in a series of annual reviews of the Tier-1. Reviewers included three people from CERN. • It was noted that the weekly Tier-1/experiments meeting had enhanced communications. • The out-of-hour service had been successfully developed. • The excellent performance of RAL during STEP09 was noted. • The management processes had been successfully developed. • Many (but not all) of the problems last autumn were related to the new building R89. • The Tier-1 was encouraged to develop staff-agility to provide more cover. • Concerns were voiced about the CASTOR upgrade path (GridPP24 discussion). GridPP24

  9. RCUK e-Science Review • Report explicitly mentions: • GridPP’s expertise in large-scale distributed data management and analysis. • Our work with start-up companies. • The substantial secondary economic benefit arising from the ability to rapidly screen drugs "in-silico”. GridPP resources were used in this way to screen potential agents in the fight against bird-flu and malaria. “NGS and GridPP have been highly successful, providing many users with access to more computing power than they could otherwise easily obtain. Looking forward, we recommend that these efforts, including enhanced capacity and function of distributed storage, be sustained and expanded.” RAL Tier-1

  10. Tier-1 Opening GridPP24

  11. GridPP4 Time Line • Nov 5th – invitation to bid. • Dec 10th – Face-to-face PMB to agree structure • Dec 11th – CB meeting to agree structure • Jan 15th – Face-to-face PMB to agree draft v6 • Jan 21st – CB meeting to discuss v6. • Jan 28th – Submission of draft to Oversight Committee • Feb 4th – Meeting with Oversight Committee + STFC • Feb 12th – Near-final draft incorporating feedback • Feb 22nd – Final comments/typos/corrections done • Feb 24th – Submitted! • Mar 4th – Last possible submission date • Apr 15th - PPRP • May 14th – PPRP Visiting Panel. 12 Weeks 3 Weeks GridPP24

  12. Proposal Structure WP-A: Tier-1 infrastructure and manpower; WP-B: Tier-2 infrastructure and manpower; WP-C: Grid deployment, operations and support; WP-D: Experiment-specific technical support; WP-E: Management team; WP-F: Impact Plan (Economic Impact, Knowledge Transfer and Outreach) WP-G: Travel and other costs. In the midst of writing the proposal we were told to reduce the project by 20%. This was very complex but is now built into submitted document. GridPP24

  13. Project Map GridPP24

  14. Project Deliverables RCUK e-Science Review

  15. Hardware Requirements Chamonix 2010 (Jan 2010) UK Collaboration sizes LHC Schedule Global Resource Requirements UK Resource Requirements Experiment Computing Models UK Resource Request Hardware Costings Scrutiny by C-RSG (April 2010), CRRB, LHCC (May 2010). Experience with real data (March+ 2010) A complex and evolving situation requiring constant management. Historically we have seen the integrated requirements are reasonably “good-and-improving” estimates of actual needs. GridPP24

  16. Hardware Scaling Tier-1 CPU Capacity Hardware requirements have increased exponentially – fortunately Moore’s Law has held true with about the same time constant. KSI2K vs Year RAL CPU costs Logarithmic scale ~2-year Moore’s Law Ramp for LHC start GridPP24

  17. Hardware Costs For CPU, there is a remarkably good (in fact, too-good) agreement between the CERN and GridPP predictions. For Disk, factoring in different RAID strategies etc, estimates agree at about 5% level, which is better than the exchange-rate uncertainty alone. Conclude: GridPP’s empirical approach leads to the same costing as an extensive top-down investigation of market and technology trends suggesting the Moore’s law assumption continues to be valid over the this time period. 27 pages Comparing predictions is even more difficult… GridPP24

  18. The EGI/NGI Structure GridPP operates the largest scientific Grid in the UK and must ensure the UK NGI meets the needs of the large community we serve. We have identified certain tasks that are absolutely required by GridPP and wLCG, which have wider UK applicability and would sensibly be done in close collaboration as part of a larger team within a UK NGI. We have used this as a way to optimize our manpower, our leadership, and our influence in these areas. We believe that JISC is committed to funding an NGI at some level (signed up to EGI) but we have examined alternative scenarios and included in contingency. European Framework-7 proposals EGI.eu EMI EGI.inspire NGI Management Board NGI Operations Coordinator (John Gordon) GridPP NGI Operations NGS Security Helpdesk and Regional Support Accounting and Monitoring Training/ Outreach GridPP24

  19. A UK NGI NGS4 and EGI funded GridPP4 funded EGI not funded NGS4 not funded RCUK e-Science Review

  20. Risks Register Covered by: W.A. (0.5 FTE) WP-D Expt. Support WP-C Data Man. Old (atlas) building and other measures Tier-2 strategy W.A. (0.5 FTE) WP-C security team WP-C security team W.A. (1.0 FTE) … 22 high level risks analysed in proposal. GridPP24

  21. Risks Register - 2 These risks are covered by the Contingency PPRP

  22. Publications Maintain a list of publications (best-effort basis, so incomplete) on the GridPP website at: http://www.gridpp.ac.uk/papers/. Currently 220 publications (2001 – 2009). • 2009 papers: 22 papers,105 (~70 unique) authors GridPP24

  23. In Summary PPRP

More Related