1 / 30

Neil Geddes CCLRC Head of e-Science Director of the UK Grid Operations Support Centre Andrew Richards NGS Coordinator G

Neil Geddes CCLRC Head of e-Science Director of the UK Grid Operations Support Centre Andrew Richards NGS Coordinator GOSC – Grid Support Centre. The vision, recent history and Organisation Roles and Relationships with others GOSC, NGS, GSC, EGEE/LCG, GRIDPP, OMII, ETF

omer
Download Presentation

Neil Geddes CCLRC Head of e-Science Director of the UK Grid Operations Support Centre Andrew Richards NGS Coordinator G

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Neil Geddes CCLRC Head of e-ScienceDirector of the UK Grid Operations Support Centre Andrew Richards NGS Coordinator GOSC – Grid Support Centre

  2. The vision, recent history and Organisation • Roles and Relationships with others • GOSC, NGS, GSC, EGEE/LCG, GRIDPP, OMII, ETF • Where we want to go next

  3. Vision This UK Grid Operation Support Centre is a distributed “virtual centre” providing deployment and operations support for the UK e-Science programme. The centre is a collaboration of CCLRC, the University of Manchester, the University of Oxford, the University of Edinburgh and the White Rose Grid at the University of Leeds. The core of the GOSC is built around operation of the National Grid Service (NGS). The GOSC will support UK services for user authentication, user authorization and project organization, credential management, resource discovery, access portals to facilitate collaborative research and resource sharing across the UK and internationally. The principal roles of the GOSC (as defined in the original call) include: • Middleware deployment • Central grid service support • General User support and helpdesk • Network services • Grid Security • User and Administrator support • Interoperability and collaboration with international projects, e.g. EGEE and TeraGrid

  4. UK Core e-Science programme - Situation Today National Grid Service Level-2 Grid * Leeds Manchester * * DL * Oxford RAL *

  5. N G S UK Grid Operations Support Centre

  6. GOSC Roles • UK Grid Services • National Services • Authentication, authorisation, certificate management, VO management, security, network monitoring, help desk + support centre. • NGS Services • Job submission, simple registry, data transfer, data access and integration, resource brokering, monitoring and accounting, grid management services, workflow, notification, operations centre. • NGS core-node Services • CPU, (meta-) data storage, key software • Services to be coordinated with others (eg OMII, NeSC, LCG): • Integration testing, compatibility & Validation Tests, User Management, training • Administration: • Policies and acceptable use • SLA’s, SLD’s • Coordinate deployment and Operations

  7. GOSC + ETF • Core of GOSC built around experience in deploying and running National Grid Service (NGS) • Support service • Important to coordinate and integrate this with deployment and operations work in EGEE, LCG and similar projects. • e.g. EGEE – low level services, CA, GOC, CERT... • Focus on deployment and operations, NOT development. UK Campus and other Grids EGEE… ETF NGS Other software sources Software with proven capability & realistic deployment experience Prototypes & specifications Operations OMII ‘Gold’ services Feedback & future requirements Deployment/testing/advice

  8. ETF • Registry • A freely available UDDI implementation has been deployed/tested between 4 sites • Experience passed on to the GRIMOIRES OMII project. • Secure Flocking of Condor • Condor pools at 4 sites have been flocked together, through firewalls • authentication through use of X.509 certifcates • OMII test bed • Portals • Support access to the NGS. • Tied in with JISC VRE developments • Evaluations • InnerGrid - Contractual issues delayed start - just started. • OMII – Start later this month • GT4 – Start later this month • gLite – start next month

  9. Stuff We Don’t Do • Run a repository • Develop software • contribute to developments to influence/adaptcf “I’ve got one of those you can have. You just need to …” • (Training – Edinburgh/NeSC are part of GOSC) • Extensive user hand-holding and app support • Need the e-Science Centres • Priorities will be driven by users

  10. One Stop Shop Click for help

  11. Grid Operations Centre Responsibilities in EGEE UK focused screen UKERNA work to be integrated

  12. Authentication, authorisation, certificate management, VO management, security. Helpdesk FAQ

  13. OMII

  14. LCG • Used for batch production Now. • worldwide de facto standards • Currently trying to interface analysis S/W • on top of gLite from EGEE • Need to move out of the physics dept’s

  15. GRIDPP • UK Contribution to LCG • Also supports current users • GridPP1 (2001-2004) • 33% deployment/operations • 33% middleware dev. • 33% applications • GridPP2 (2004-2007) • 60% deployment/operations • LCG2 -> EGEE • 15% middleware dev. • 25% applications • Not just PPARC funding • Universities • support LHC • benefit from grid experience • You should know/meet these people

  16. Start from LCG2 • “Harden” middleware • Expand applications • €32 from EU • The EU Grid Infrastructure • 50% deployment/operations • lots at CERN • matched by PP • UK + I • training • GOC dev + ops • regional deployment+support • T2 coordinators

  17. NGS “Today” Interfaces OGSI::Lite WSRF::Lite • Projects • e-Minerals • e-Materials • Orbital Dynamics of Galaxies • Bioinformatics (using BLAST) • GEODISE project • UKQCD Singlet meson project • Census data analysis • MIAKT project • e-HTPX project. • RealityGrid (chemistry) • Users • Leeds • Oxford • UCL • Cardiff • Southampton • Imperial • Liverpool • Sheffield • Cambridge • Edinburgh • QUB • BBSRC • CCLRC.

  18. “Tomorrow” Web Services based National Grid Infrastructure

  19. Commercial Provider UofD PSRE Leeds Man. RAL Oxford NGS Core Nodes: Host core services, coordinate integration, deployment and support +free to access resources for all VOs. Monitored interfaces + services NGS Sites: Integrated with NGS, some services/resources available for all VOs Monitored interfaces + services NGS Connected Sites: Integrated with NGS, support for some VO’s Monitored interfaces (+security etc.) GOSC U of C U of A H P C x U of B C S A R

  20. VRE, VLE, IE HPCx + HECtoR LHC ISIS TS2 UK e-Infrastructure Users get common access, tools, information, Nationally supported services, through NGS Regional and Campus grids Integrated internationally

  21. SRB service OGSA-DAI service

  22. Production Status • TODAY • 4 new core nodes operational • 132 Users registered (32 since 1 September ’04) • Grid enabled – Globus v2 (VDT distribution v1.2) at present • BDII information service (GLUE + MDS Schemas) • Data Services – Oracle and SRB • Growing base of user applications • MyProxy and CA services provided by UK Grid Support Centre • VO Management Software – LCG-VO • User support: Helpdesk • Next… • Other Middleware [gLite/OMII etc…] • NGS Portal • Resource Broker • SRB pre-production service

  23. User Example GODIVA Diagnostics Study of Oceanography Data EVE Excitations and Visualisation Project Integrative Biology Simulation of Strain in Soft Tissue under Gravity

  24. How do I Join as a New Site? • Acceptable use and Security policies • Install required interfaces (~EGEE) • VDT • EGEE CE and SE interfaces (and Authorisation) • Monitoring and accounting • Provide services as defined in your own SLD • Buys you representation at the board (?)

  25. Core services to facilitate collaborative (grid) computing – run by GOSC • Authentication (PKI X509) • Job submission/batch service • Resource brokering • Authorisation • Virtual Organisation management • Certificate management • Information service • Data access/integration services (SRB/OGSA-DAI/DQPS) • National Registry (of registry’s) • Data replication • Data caching • Grid monitoring • Accounting UK e-Science Cert. gsi-ssh, globus-job-submit, condorG EDG-RB VOM/VOMS VOMS (+Grid3/EGEE) myProxy(++) BDII/Glue ? ETF ? ? EGEE ? ? EGEE ? EGEE/LCG + ETF +TeraGrid EGEE/LCG/ETF/GGF Web Services interfaces

  26. Where Next? • Make the NGS work • Resource Broker/scheduler • VO/Project support • Monitoring and Accounting • Compatibility with EGEE • Define and agree criteria for success • Web Services • National e-Infrastructure • Science and Innovation strategy 2004-2014

  27. Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 2006 2004 2005 Timeline NGS WS Service NGS Expansion (Bristol, Cardiff…) NGS Production Service NGS WS Service 2 OGSA-DAI NGS Expansion WS2plan WS plan OMII release gLite release 1 EGEE gLite alpha release EGEE gLite release OMII Release

  28. Summary • We are in the game of providing a service • built on leading edge academic stuff ! • The challenge • not the latest and greatest grid • not what any given user wants • The solution • want to make it work • for our researchers • for our institutions • one site will not make a useful grid • Sign people/users up (to the vision) • “get out more”

  29. GOSC Director Neil Geddes: n.i.geddes@rl.ac.uk NGS Grid Coordinator Andrew Richards: a.j.richards@rl.ac.uk Websites http://www.grid-support.ac.uk http://www.ngs.ac.uk Helpdesk (via Grid Support Centre) Email: support@grid-support.ac.uk

  30. The End

More Related