1 / 34

“How to Connect Campus Grids to the NGS”

“How to Connect Campus Grids to the NGS”. http://www.ngs.ac.uk. http://www.grid-support.ac.uk. Neil Geddes Director, GOSC

sybil-mcintyre
Download Presentation

“How to Connect Campus Grids to the NGS”

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. “How to Connect Campus Grids to the NGS” http://www.ngs.ac.uk http://www.grid-support.ac.uk Neil Geddes Director, GOSC The UK's National Grid Service is a project to deploy and operate a grid infrastructure for computing and data access across the UK. This development will be a cornerstone of the development of the UK's "e-Infrastructure" over the coming decade. The goals, current status and plans for the National Grid Service and the Operations Support Centre will be described.

  2. Outline • Overview of GOSC and NGS • Services & Getting Access • Joining the NGS • How and why • The Future • Roadmap for the future • Summary

  3. GOSC The Grid Operations Support Centre is a distributed “virtual centre” providing deployment and operations support for the NGS and the wider UK e-Science programme. - started October 2004

  4. GOSC Roles • UK Grid Services • National Services • Authentication, authorization, certificate management, VO management, security, network monitoring, help desk + support centre. • support@grid-support.ac.uk • NGS Services • Job submission, simple registry, data transfer, data access and integration, resource brokering, monitoring and accounting, grid management services, workflow, notification, operations centre. • NGS core-node Services • CPU, (meta-) data storage, key software • Services coordinated with others (eg OMII, NeSC, LCG, EGEE): • Integration testing, compatibility & Validation Tests, User Management, training • Administration: • Security • Policies and acceptable use conditions • SLA’s, SLD’s • Coordinate deployment and Operations

  5. The National Grid Service:Towards the UK's e-infrastructure • The UK's National Grid Service is a project to deploy and operate a grid infrastructure for computing and data access across the UK. • Learn what it means • Learn how to do it • This development will be a cornerstone of the development of the UK's "e-Infrastructure" over the coming decade

  6. NGS “Today” Interfaces Projects e-Minerals e-Materials Orbital Dynamics of Galaxies Bioinformatics (using BLAST) GEODISE project UKQCD Singlet meson project Census data analysis MIAKT project e-HTPX project. RealityGrid (chemistry) Users Leeds Oxford UCL Cardiff Southampton Imperial Liverpool Sheffield Cambridge Edinburgh QUB BBSRC CCLRC. Nottingham … OGSI::Lite • If you need something else, please say!

  7. EGEE Resources: Feb 2005 • Country providing resources • Country anticipating joining • In EGEE: • 113 sites, 30 countries • >10,000 cpu • ~5 PB storage • Includes non-EGEE sites: • 9 countries • 18 sites

  8. Applications • HEP Applications • Biomed Applications • imaging, drug discover • mri simulation • protein sequence analyis • Generic Applications • Earth Observation, Seismology, Hydrology, Climate, Geosciences • Computational Chemistry • Astrophysics • Applications “behind the corner” • R-DIG • BioDCV GOSC Management Board - NGS StatusEGEE Third Conference, Athens, 19.04.2005

  9. http://www.ngs.ac.uk NGS core nodes: Need UK e-Science certificate (1-2 days) Apply through NGS web site (1-2 weeks)

  10. Service and Access What we provide and how to get permission

  11. NGS Core Services • Globus Toolkit version 2 • Job submission, File transfer, Shell • Storage Resource Broker • Oracle (9i) • OGSA-DAI • Certificate Authority • Information Services (MDS/GIIS) • MyProxy server • Integration tests and database • Cluster monitoring • LCG-VO In testing: • VOMS • EDG Resource Broker • Portal(s)

  12. NGS Partner Sites Data nodes at RAL + Manchester Compute nodes at Oxford + Leeds Compute nodes at Cardiff + Bristol Free at point of use Apply through NGS web site Accept terms and conditions of use Light-weight peer review 1-2 weeks To do: project or VO-based application and registration National HPC services Must apply separately to research councils Digital certificate and Conventional (username/ password) access supported Affiliate Sites Access approved projects/VO’s Gaining Access • All access is through digital X.509 certificates • From UK e-Science CA or recognized peer

  13. Joining the NGS How, Why and The Vision Thing

  14. How to Join Resource providers join the NGS by • Defining level of service commitments through SLDs • Adopting NGS acceptable use and security policies • Run compatible middleware • as defined by NGS Minimum Software Stack • and verified by compliance test suite • Support monitoring and accounting Two levels of membership • Affiliation • a.k.a. connect to NGS • Partnership

  15. How to Join - 1 • Ask • Grid Support Centre, Stephen Pickles • Process currently limited only by available effort http://www.ngs.ac.uk

  16. How to Join - 2 • Ask • Grid Support Centre, Stephen Pickles • Process currently limited only by available effort • Get assigned a buddy • added to rollout mailing list • read the joining guide http://www.ngs.ac.uk/man/documents/NGS_Partner_joining_procedure_0.4.pdf

  17. How to Join - 3 • Ask • Grid Support Centre, Stephen Pickles • Process currently limited only by available effort • Get assigned a buddy • added to rollout mailing list • read the joining guide • Install the minimum software stack • On the resource, or on a gateway http://www.ngs.ac.uk/man/documents/NGS_Minimum_software_stack_0.7.pdf

  18. How to Join - 4 • Ask • Grid Support Centre, Stephen Pickles • Process currently limited only by available effort • Get assigned a buddy • added to rollout mailing list • read the joining guide • Install the minimum software stack • On the resource, or on a gateway • Pass monitoring tests for 7 days

  19. How to Join - 5 • Ask • Grid Support Centre, Stephen Pickles • Process currently limited only by available effort • Get assigned a buddy • added to rollout mailing list • read the joining guide • Install the minimum software stack • On the resource, or on a gateway • Pass monitoring tests for 7 days • Agree to security and acceptable use policies • security contact + part of campus security • developing operational security with GridPP, EGEE, OSG

  20. How to Join - 6 • Ask • Grid Support Centre, Stephen Pickles • Process currently limited only by available effort • Get assigned a buddy • added to rollout mailing list • read the joining guide • Install the minimum software stack • On the resource, or on a gateway • Pass monitoring tests for 7 days • Agree to security and acceptable use policies • Define a Service Level

  21. How to Join - 7 • Ask • Grid Support Centre, Stephen Pickles • Process currently limited only by available effort • Get assigned a buddy • added to rollout mailing list • read the joining guide • Install the minimum software stack • On the resource, or on a gateway • Pass monitoring tests for 7 days • Agree to security and acceptable use policies • Define a Service Level • Set up service level monitoring

  22. How to Join - 8 • Ask • Grid Support Centre, Stephen Pickles • Process currently limited only by available effort • Get assigned a buddy • added to rollout mailing list • read the joining guide • Install the minimum software stack • On the resource, or on a gateway • Pass monitoring tests for 7 days • Agree to security and acceptable use policies • Define a Service Level • Set up service level monitoring • Approval by GOSC Board • Get representation on Technical Board • Process took 6-12 months for core sites • Process took 3-6 months for Cardiff +Bristol • Process should take less than 3 months for Lancaster

  23. Why the NGS • Common tools, procedures and interfaces • Reduce total cost of ownership for providers • Lower threshold for users • Early adopter system for UK research grids • technology evaluation (in production) • technology choices • pool expertise • drive interface standards and requirements • both a voice and a target • etc.

  24. Why Join • (your) Users increasingly want resources as services and not as complicated bits of kit • common interfaces across a range of facilities • Funders of regional and national facilities want common interfaces to lower barriers to access • e.g. Hector • By joining you leverage the national expertise in running these services • technical advice and support • security procedures and incident response • tools to help monitor and patch • All of the above required in any TCO calculation • Get it at lower cost by joining the NGS • Members get a say in the technical decisions …

  25. The Future More Vision and Vision Meets Reality

  26. Regional and Campus grids Community Grids VRE, VLE, IE HPCx + HECtoR LHC ISIS TS2 UK e-Infrastructure Users get common access, tools, information, Nationally supported services, through NGS Integrated internationally

  27. Maintaining Compatibility • Operating a production grid means valuing robustness and reliability over fashion. • bug uncovered in OpenSSH in October 2004 • NGS cares about: • alignment/compatibility with leading international Grid efforts • special requirements of UK e-Science community • easy migration/upgrade paths • proven robustness/reliability • based on standards or standards-track specifications • NGS cannot support everything • Everyone wants service-oriented grids • but still settling out: WS-I, WS-I+, OGSI, WSRF, GT3, GT4, gLite • Caution over OGSI/WSRF has led to wide convergence on GT2 for production grids and hence some inter-Grid compatibility • but there are potentially divergent forces at work • Significant changes to NGS Minimum Software Stack will require approval by NGS Management Board on conservative time scales

  28. Strategic Framework • GOSC/NGS  UK e-Science project • support other UK (e-)science projects • International Compatibility • EGEE • European infrastructure (and possible funding) • LHC at most UK universities • only user group who want to build the grid • GridPP committed to common w/s plan in 2005 • GEANT • Others • TeraGrid – US cyberinfrastructure $$$ (unlikely to pay us) • Open Science Grid – will develop compatibility with LCG • RoW e.g. China • Want use other software, but must be EGEE compatible • Also driven by user requirements • Sets framework for relationship with OMII and others • Other factors • JISC and Shibboleth

  29. Process for Moving Forward • New developments evaluated by ETF • must have some longer term support likely • User requests treated on case by case basis • NGS Technical Board consider against needs • user demand • new functionality • improved functionality • improved security/performace/managability • Proposal brought to GOSC Board • Prepared by GOSC “executive” • N.Geddes, S.Pickles, A.Richards, S.Newhouse

  30. Current Roadmap • April 2005 Extensions of NGS membership • July 2005 First assessment of NGS WS infrastructure Outline plans for 2005/2006 NGS AAA devt. Migration and/or interoperability of GT2/GT4 • Oct 2005 Deployment of Resource Brokering and VO mgmt Client (compute element) compatibility with EGEE Decision on support for GT4 infrastructure • Jan 2006 Evaluation of Shibboleth interoperability solutions • April 2006 Approval of Shibboleth interoperability plans • July 2006 Interoperability with Shibboleth infrastructure • Oct 2006 Technology refresh for core NGS nodes

  31. The beginning …

  32. Backup slides to follow …

  33. EDS is Transforming Clients to Agile Enterprise – Virtualised Computing Platform EDS Services Transition Roadmap Step 6: Grid Reduce Risk Step 5: Utility Service • Agility Drivers • Standards • Visibility • Quality • Security • Efficiency Improve Utilisation Improve Scalability, Service Quality/Levels, Productivity & more Step 4: Virtual Service Suite Step 3: Automated Operations & Managed Storage Reduce TCO Step 2: Consolidate (Server, Network, Storage, etc) Step 1: Migrate & Manage (Regional Facilities)

  34. The GOSC Board Director, GOSC (Chair) Neil Geddes Technical Director, GOSC Stephen Pickles Collaborating Institutions CCLRC Prof. Ken Peach Leeds Prof. Peter Dew Oxford Prof. Paul Jeffreys Manchester Mr. Terry Hewitt Edinburgh/NeSC Prof. Malcolm Atkinson UKERNA Dr. Bob Day London College tbd ETF Chair Dr. Stephen Newhouse GridPP Project Leader Prof. Tony Doyle OMII Director Dr. Alistair Dunlop EGEE UK+I Federation Leader Dr. Robin Middleton HEC Liaison Mr. Hugh Pilcher-Clayton Also invited e-Science User Board Chair. Prof. Jeremy Frey Director, e-Science Core Programme Dr. Anne Trefethen 

More Related