1 / 18

GridPP Presentation to PPARC Grid Steering Committee 26 July 2001

Steve Lloyd Tony Doyle John Gordon. GridPP Presentation to PPARC Grid Steering Committee 26 July 2001. Outline. Resource Allocation and Funding Scenarios Int l Financial Comparisons Int l Grid Collaborations - see addendum Grid Architecture Links with Industry - see addendum

durin
Download Presentation

GridPP Presentation to PPARC Grid Steering Committee 26 July 2001

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Steve Lloyd Tony Doyle John Gordon GridPP Presentation to PPARC Grid Steering Committee 26 July 2001

  2. Outline • Resource Allocation and Funding Scenarios • Intl Financial Comparisons • Intl Grid Collaborations - see addendum • Grid Architecture • Links with Industry - see addendum 1. VISTA and GridPP 2. GridPP monitoring page • Summary e-Science Presentation

  3. GridPP Proposal • GridPP = Vertically integrated programme • = Component Model... • Provides input for £15-20M funding scenarios... e-Science Presentation

  4. GridPP Workgroups Technical work broken down into several workgroups - broad overlap with EU DataGrid A - Workload Management Provision of software that schedule application processing requests amongst resources F - Networking Network fabric provision through to integration of network services into middleware G - Prototype Grid Implementation of a UK Grid prototype tying together new and existing facilities B - Information Services and Data Management Provision of software tools to provide flexible transparent and reliable access to the data H - Software Support Provide services to enable the development, testing and deployment of middleware and applications at institutes C - Monitoring Services All aspects of monitoring Grid services I - Experimental Objectives Responsible for ensuring development of GridPP is driven by needs of UK PP experiments D - Fabric Management and Mass Storage Integration of heterogeneous resources into common Grid framework J - Dissemination Ensure good dissemination of developments arising from GridPP into other communities and vice versa E - Security Security mechanisms from Certification Authorities to low level components e-Science Presentation

  5. J 2.6% I: 11.9% Experiment CERN Staff Objectives 27.0% H*: 5.4% Software Support H: 3.2% G: Prototype Grid 9.7% CERN Hardware 6.8% UK Managers 1.9% 1.5% 1.9% Work Groups A - F 1.7% F* UK Capital 1.5% F 15.3% 2.7% E 0.6% 1.1% 1.9% D* 1.5% 0.4% 1.4% D C* C B* B A* A Components 1-4: £21M e-Science Presentation

  6. Starting Points • PPARC EU DataGrid commitments are built in (£2.4M, noted in Table 3) - cannot be reduced • CERN component (1/3) scales with total • UK Capital (£3.2M, largest single item) assessed • then address workgroup allocations... e-Science Presentation

  7. J 2.6% I: 11.9% Experiment CERN Objectives H*: 5.4% Software Support 96.3% G: Prototype Grid 9.7% UK Managers 1.9% 1.5% 1.9% Work Groups A - F 1.7% F* UK Capital 1.5% F 2.7% E 0.6% 1.1% 1.9% D* 1.5% 0.4% 1.4% D C* C B* B A* A £20M Project £7.1m  £6.7m H: 3.2% £3.2  £2.9 e-Science Presentation

  8. J 2.6% CERN H*: 5.4% Software Support 90.0% G: Prototype Grid 9.7% UK Managers 1.9% 1.5% 1.9% Work Groups A - F 1.7% F* UK Capital 1.5% F 2.7% E 0.6% 1.1% 1.9% D* 1.5% 0.4% 1.4% D C* C B* B A* A £17M Project I: £2.49m  £1.2m Experiment £7.1m  £6.7m  £6.0m Objectives H: 3.2% £3.2  £2.9  £2.45m e-Science Presentation

  9. Experiment Objectives 50% reduction? 23 SY • Vertically integrated programme? • Broken component model… • Specific experiments or overall reduction? • To be determined by Experiments Board e-Science Presentation

  10. Workload/Data Management 10% reduction? 1.2 SY Reduced long-term programme? e.g. scheduler optimisation (WG A) query optimisation (WG B) … or overall reduction? e-Science Presentation

  11. J 2.6% CERN H*: 5.4% Software Support 90.0% G: Prototype Grid 9.7% UK Managers 1.9% 1.5% 1.9% Work Groups A - F 1.7% F* UK Capital 1.5% F 2.7% E 0.6% 1.1% 1.9% D* 1.5% 0.4% 1.4% D C* C B* B A* A £15M Project I: £2.49m  £0 Experiment £5m Objectives H: 3.2% £3.2  £2.9  £2.45m e-Science Presentation

  12. Conclusions • Even a £21M to £20M reduction is not trivial.. • £17M budget cuts hard into the project: especially User layer of Grid architecture: Experimental Objectives (50% reduction) • Effect of 10% reduction on other groups e.g. WG A/B • Evaluation based on Component Model: Components 1-4 correspond to Grid exploitation • £15M budget is impossible within the Component Model e-Science Presentation

  13. Tier-1 at FNAL and 5 Tier-2 centres • Prototype built during 2000-04, with full deployment during 2005-7 • Staff estimates for the Tier-1 centre are 14 FTE by 2003, reaching 35 FTE in 2007. • Integrated costs to 2006 are $54.7M • excluding, GriPhyN and PPDG • Tier-1 RC for all 4 LHC experiments at CC-IN2P3 in Lyon • BaBar Tier-A • an LHC prototype starting now • National Core Grid (2M€/year) • INFN National Grid based on EU DataGrid • Tier-1 RC and a prototype starting now in CNAF, Bologna • 15.9M€ is allocated during 2001-3 for Tier-1 hardware alone • Tier-1 staff rising to 25 FTE by 2003 • 10 Tier-2 centres at 1M€/year • Tier-1 starting up at Karlsruhe • BaBar Tier-B at Karlsruhe • Tier-2 for ALICE at Darmstadt • No National Grid - project led • ATLAS plans very similar to CMS with costs foreseen to be the same • Tier-1 at Brookhaven International Comparisons PP Grids under development • France • Germany • Italy • US • CMS • ATLAS e-Science Presentation

  14. International Comparisons Summary - different countries, different models • France & Germany budget for hardware, assume staff • Italy - significant investment in hardware and staff • US - funds split between Tier1/2, Universities, infrastructure, and R&D • Italy > UK ~ France ~ Germany ~US (GriPhyN, PPDG and iVDGL characteristics within GridPP: single UK programme) ~ e-Science Presentation

  15. GridPP Architecture The DataGrid Architecture Version 2 German Cancio, CERN Steve M. Fisher, RAL Tim Folkes, RAL Francesco Giacomini, INFN Wolfgang Hoschek, CERN Dave Kelsey, RAL Brian L. Tierney, LBL/CERN July 2, 2001 • GGF architecture via EU DataGrid incorporating PPDG and GriPhyN developments • EU DataGrid Architecture Status: Version 2 (2/7/01) • Key elements: • Evolutionary capability • Services via Protocols and Client APIs • Representation using UML (TogetherSoft) • Defines responsibilities of Work Packages • Based on PP Use Cases - direct application to GridPP • GridPP (and PPDG) project management using Xproject = implementation to defined timescales e-Science Presentation

  16. GridPP and VISTA • Astrogrid will federate VISTA data with other large databases • requires that VISTA data has already been processed and catalogues and images are available • VISTA have a proposal (e-VPAS) that concentrates on producing the databases on which the Astrogrid tools will work. This work has much in common with GridPP: • a similar timescale • large data flows from one remote site • many distributed users • reprocessing of data • utilization of distributed computing resources • GridPP have started discussions with VISTA and EPCC in order to collaborate and share expertise and middleware e-Science Presentation

  17. GridPP Monitoring Page • Various sites now set up with UK Globus certificates • Grid Monitoring • Polls Grid test-bed sites via globus-job-run command • Runs basic script producing XML encoded status information • Load average and timestamp information is retrieved • Current status and archived load information is plotted... e-Science Presentation

  18. Summary • Balanced exploitation programme costs £21M • £20M-£17M-£15M 3-year funding scenarios examined • £20M = maintains balanced programme • £17M = significantly reduced experimental objectives • £15M = eliminates experimental objectives • Programme optimisation depends on funding allocation • International comparisons: Italy > UK ~ France ~ Germany ~US (GriPhyN, PPDG and iVDGL characteristics within GridPP: single UK programme) • Individual contributions to GGF architecture via leading role in EU DataGrid combined with strong links to GriPhyN, PPDG and iVDGL • Industry links: emphasis on partnership • Exploring common development programme with VISTA • Demonstrators in development ~ e-Science Presentation

More Related