Computer Architecture & Grid Research Group and Grid-Ireland OpsCentre

1. Computer Architecture & Grid Research Groupand Grid-Ireland OpsCentre Brian Coghlan Trinity College Dublin

2. Pro-Active Healthcare Intelligent Transportation Systems e-Science Person to Person Computer Systems Education Innovative Pedagogies Learning and Instruction Programming Models Computer Architecture Software Adaptation Domain Specific Languages Clusters and Metacomputing Execution Models, Computistics Aspect Oriented Architectures Service Oriented Architectures Stream Processing & Multimedia Parallel & Virtual Architectures Ubiquitous Computing Sensor Enabled Artifacts Sensor Networks Intelligent Mobile Systems Global Smart Spaces Self Organising Systems Security and Trust Autonomic Computing Peer to Peer CVTR Lero Wireless Communications Delay Tolerant Networking Ad-hoc Networking Software Radio Channel Modelling Grid Computing Meta/Virtual/OnDemand Grids Grid Heterogeneity, eLearning Grid Trust, Security & Intrusion Grid Info, Viz, Policy, Ctrl, Data Grid-Ireland Computer Systems Research Lab

3. Grid Research & Operations Grid Research • Meta/Virtual/OnDemand Grids • Grid Heterogeneity, eLearning • Grid Info, Viz, Policy, Ctrl, Data • Grid Trust, Security & Intrusion Grid-Ireland OpsCentre • ROC for Ireland • OpsCentre manages Grid-Ireland • Remotely deploys & maintains core infrastructure • Grid component of national e-Infrastructure (e-INIS)

4. e-INIS

5. e-INIS Storage Databases Metadata Grid-Enabled Data/Metadata Services Federated ID

6. AMGA FTS LFC Database SRM Datastores Compute Data Grid Lambda-switched Networking OpsCentre OGSA-DAI LFC DPM Gateways Proposed DataManagement

7. Tightly Coupled Loosely Coupled Tightly Coupled Loosely Coupled Tightly Coupled Loosely Coupled Central Visualization Distributed Centralised Capability Distributed Capacity Algorithms Central Data Distributed Single User Viz Engine TCHPC Multi User Viz Engines e.g.TCD CSc Desktop Viz Engines Multicore Desktops Supercomputers ICHEC capability NUIG SMP Numa TCHPC Clusters UCD Rowan TCD CSc UCC Boole Cycle Harvesting TCD CSc Teaching Labs Central Query Engines ICHEC Regional Query Engines UCC NUIG Repository Query Engines Repository Sites e-INIS

8. Grid-Ireland Infrastructure Grid-Ireland

9. UKI Grid Federation

10. European Grid Infrastructures 2-OCT-07: ~250 sites >45,000 CPUs

11. UPS Network switch Gridfw (firewall) Gridinstall (Quattor) UPS Network switch Gridfw (firewall) Gridgate (CE) Gridinstall (Quattor) Gridstore (SE) Gridgate (CE) Gridmon (test WN) Gridstore (SE) Gridui (UI) Gridmon (test WN) Gridnm (NM) Gridui (UI) Gridnm (NM) Site Architecture Grid Gateway: All Virtual machines All run on 1 physical machine Remotely managed by OpsCentre Cluster(s): Managed by local admins OpsCentre supports integration Various config & install options

12. OpsCentre Central Services • OpsCentre: • Management of Grid-Ireland • Testing, porting, customisation • Deployment to remote sites • Remote management of sites • Monitoring of Grid services • National services (e.g. CA) • Dissemination and training • Grid courses and e-Learning • Links to EU Grids: • EGEE-II • int.eu.grid

13. gLite Services Typical Grid service software stack Pending layers: NGS GT4 WebCom-G SGA

14. Heterogeneity

15. Proposed Distributed Build Infrastructure Autobuild Current TCD Local Build Lifecycle

16. TestGrid site replicas cpDIASie Grid software (EGEE) OS updates csQUBuk Repository csTCDie Integration csUCCie Ops Centre hierarchical profiles scgNUIGie Certification

17. Transactional Deployment Geoff Quigley, TCD

18. gridinstall CE Repository SE Caching proxy UI Quattor profiles SW packages WN Transactional Deployment GUI Ops Centre Site Transactional Deployment Geoff Quigley, TCD

19. Operational Status - 100% available

20. Usage • 87% European- 13% National • 64% European- 36% National

21. Grid Research & Operations Grid Research • Meta/Virtual/OnDemand Grids • Grid Heterogeneity, eLearning • Grid Info, Viz, Policy, Ctrl, Data • Grid Trust, Security & Intrusion Grid-Ireland OpsCentre • ROC for Ireland • OpsCentre manages Grid-Ireland • Remotely deploys & maintains core infrastructure • Grid component of national e-Infrastructure (e-INIS)

22. TestGrid

23. ALTERNATIVES ALTERNATIVES Client SP GridShibUS WAYF ??? VOMS SAML ShibGridUK attributes SARONGUS VOMS Classic IdP VASH SLCS Attribute Cert Signing SAML Staff/StudentdB voms-proxy-init THEFT ? attributed cert AFTER USR/PW iS ISSUED usr/pw usr/pw usr/pw ADMIN Staff/StudentRegistration External ID Extra info Extra info proxy cert Grid cert THEFT ? RA Grid-Ireland CA VOMS Admin 10b Grid-Ireland RA VOMS Registration PhotoID PhotoID USER ABSENT ? 10a AFTER PHOTOID IS ISSUED 23 24 22 21 19 7 4 2 3 1 20 5 13 8 6 15 14 12 17 18 11 9 16 26 25 27 28 30 VO Admin Federated ID ALTERNATIVES ABSENT ? THEFT ?

24. Active Security Infrastructure (ASI)

25. I4C/G4C

26. Social Grid Agents - Economic Markets- Interoperability

27. Discovery Engine Consumer gridfs_discover Node 1 Discovery Engine R-GMA Node 4 Discovery Engine Producer gridfs_publish Node 6 export info query query publish export info export info export info export info Directory Engine Producer gridfs_publish_namespace Node 2 Directory Engine R-GMA Node 5 = Existing software publish = New software server config namespace info namespace info query Data Movement Engine Server GridSite Node 7 Directory Engine Consumer server config server IN namespace info server OUT namespace info query VFS VFS FUSE kernel module Data Movement Engine Client FUSE User Space Daemon Node 3 CURL User’s Job client OUT Physical Storage client IN Grid Filesystems - Standard file I/O calls- Traverses firewalls- Location-transparent- Grid secured

28. Infogrid - Relational interface to the Grid- Stream-oriented (uses R-GMA)

29. Submission System Submission System Submission System WebCom-G Infrastructure NUIG User TCD User Metadata carries job security token, which includes VOMS attributes UCC User Static SSL network connections, protected with KeyNote credentials and grid host certs Grid proxy cert GSI/SSL network connections

30. closed Secure WebCom world Border node WebCom execute nodes E WebCom portal MJX WebCom Server (entry node) CG + jobID + metadata SUBMIT + CG + proxy SUBMIT + CG + proxy + Dtoken REQ_TOKEN + proxy REQ_TOKEN + proxy Dtoken Dtoken MSX These actions could be done (if invoking Grid) directly from the WebCom portal Border node WebCom instance (grid submit node) Grid jobID + metadata GRID_SUBMIT + proxy S Grid response WebCom + Secure Connection Manager + Grid-Ireland host certs + KeyNote Security Manager + KeyNote certs + Map jobID to per-job filesystem + Execution in per-job context + TCD Secure Engine Module + TCD VOMS Job Security Module Host authN via Connection Mgr Host authZ via Security Mgr REQ_PROXY + Dtoken proxy Grid proxy cert Delegation token (NOT job security token) WebCom-G/Grid Security

31. Adaptive e-Learning

32. MetagridApplication(Drug discovery) Peter Lavin, TCD

33. Produce KML Visualisation WN CE Submit Job1 To Grid ssh RB user’s workstation UI Ronan Watson, TCD

34. Visualisation WN CE Submit Job2 To Grid Produce VR ssh RB user’s workstation UI CE WN VRG Server Ronan Watson, TCD

35. Visualisation WN CE Submit Job3 To VE ssh RB user’s workstation UI CE WN VRG Server CE WN gridgate.cs.tcd.ie Google Earth + Ogre vrengine.cs.tcd.ie Ronan Watson, TCD

36. Steer Next Computation Visualisation WN CE Steer Next Computation Client ssh Rendering RB user’s workstation UI CE WN VRG server Server CE WN gridgate.cs.tcd.ie vrengine.cs.tcd.ie Video Output and Interactive Communication Ronan Watson, TCD