GT Components

1. GT Components

2. Globus Toolkit • A “toolkit” of services and packages for creating the basic grid computing infrastructure • Higher level tools added to this infrastructure • Version 4 is web-services based • Some non-web services code exists from earlier versions (legacy) or where not appropriate (for efficiency, etc.).

3. Each part comprises a set of web services and/or non-web service components. • Some built upon earlier versions of Globus.

4. Globus Open Source Grid Software G T 4 Delegation Service Community Scheduler Framework [contribution] Python WS Core [contribution] C WS Core G T 3 CommunityAuthorization Service OGSA-DAI [Tech Preview] WS Authentication Authorization Reliable File Transfer Java WS Core Grid Resource Allocation Mgmt (WS GRAM) Monitoring & Discovery System (MDS4) G T 2 Pre-WS Authentication Authorization GridFTP Grid Resource Allocation Mgmt (Pre-WS GRAM) Monitoring & Discovery System (MDS2) C Common Libraries G T 3 Replica Location Service XIO G T 4 Credential Management Web ServicesComponents Non-WS Components Security Data Management Execution Management Information Services CommonRuntime

5. Another view of GT4 Components Your Python Client Your C Client Your Java Client Your Python Client Your Python Client Your C Client Your C Client CLIENT Your Java Client Your Java Client Your Python Client Your C Client Your Java Client Interoperable WS-I-compliant SOAP messaging X.509 credentials = common authentication Trigger Archiver Your C Service GRAM RFT Delegation Index CAS OGSA-DAI GTCP Your Python Service Your Java Service Your Java Service RLS GridFTP SimpleCA MyProxy Pre-WS MDS Pre-WS GRAM C WS Core pyGlobus WS Core Java Services in Apache Axis Plus GT Libraries and Handlers Python hosting, GT Libraries C Services using GT Libraries and Handlers SERVER

6. User Applications Custom WSRF Web Services Custom Web Services GT4WSRF Web Services Registry Administration GT4 Container WS-Addressing, WSRF, WS-Notification WSDL, SOAP, WS-Security GT4 Web Services Core

7. Execution Management Key component GRAM (Grid Resource Allocation Manager) • For submitting executable jobs • May interface to a local job scheduler

8. GT4 GRAM Structure: Service host(s) and compute element(s) GT4 Java Container Compute element Local job control GRAM services GRAM services Local scheduler Job functions sudo GRAM adapter Delegate Transfer request Delegation Client Delegate GridFTP User job RFT File Transfer FTP control FTP data Remote storage element(s) GridFTP Data management components I Foster

9. Security Components Addresses the security requirements of grid computing. Three important factors are: • Authorization • Process of deciding whether a particular identity can access a particular resource • Authentication • Process of deciding whether a particular identity is who he says he is (applies to humans and systems) • Delegation(somewhat specific to grid computing) • Process of giving authority to another identity (usually a computer/process) to act on your behalf.

10. Security continued • Security aspects complicated by the fact that virtual organization members and resources can be in different administrative domains.

11. Security G T 4 Delegation Service Community Scheduler Framework [contribution] Python WS Core [contribution] C WS Core G T 3 CommunityAuthorization Service OGSA-DAI [Tech Preview] Web ServicesComponents WS Authentication Authorization Reliable File Transfer Java WS Core Grid Resource Allocation Mgmt (WS GRAM) Monitoring & Discovery System (MDS4) G T 2 Pre-WS Authentication Authorization GridFTP Grid Resource Allocation Mgmt (Pre-WS GRAM) Monitoring & Discovery System (MDS2) C Common Libraries Non-WS Components G T 3 Replica Location Service XIO G T 4 Credential Management Security Data Management Execution Management Information Services CommonRuntime

12. GT4’s Use of Security Standards I Foster

13. GT4 Data Management • Move large data to/from nodes • Replicate data for performance & reliability • Locate data of interest • Provide access to different data sources • File systems, parallel file systems, hierarchical storage (GridFTP) • Databases (OGSA DAI)

14. GridFTP and Reliable File Transfer G T 4 Delegation Service Community Scheduler Framework [contribution] Python WS Core [contribution] C WS Core G T 4 Credential Management G T 3 CommunityAuthorization Service OGSA-DAI [Tech Preview] Web ServicesComponents WS Authentication Authorization Reliable File Transfer Java WS Core Grid Resource Allocation Mgmt (WS GRAM) Monitoring & Discovery System (MDS4) G T 2 Pre-WS Authentication Authorization GridFTP Grid Resource Allocation Mgmt (Pre-WS GRAM) Monitoring & Discovery System (MDS2) C Common Libraries Non-WS Components G T 3 Replica Location Service XIO Security Data Management Execution Management Information Services CommonRuntime

15. GridFTP • Built on FTP using separation of data and control channels • Provides features for • Large data transfers • Secure transfers • Fast transfers • Reliable transfers • Third party transfers • Not a web service • RTF (Reliable File Transfer) service provided WS-level interface

16. Third party transfers Client PI PI Server Server PI PI Control channels DTP DTP Data channel DTP= FTP Data Channel Process PI = FTP Protocol Interpreter

17. Performing a third-party transfer 1. Client establishes control channel with server 2. Using control channel, client sets up transfer parameters and requests data channel creation 3. Data channel established, 4. Client sends transfer command over control channel, 5. Data transfer starts through data channel. Either client or server can send.

18. Parallel transfers and striping • Using multiple (virtual) connections for transfer • Same external network • Speed improvement possible, but limited by network card • Striping • a version of parallel transfers that can use separate hardware interfaces • Implemented in GT 4.

19. GridFTP and RFT RFT service (Java) WS Client Client API (Java) Control channel Control channel Data channel XIO based (C) XIO based (C) GridFTP server GridFTP server From Gridwise

20. GT 4 Replica Location Service Index Index • Identify location of files via logical to physical name map • Distributed indexing of names, fault tolerant update protocols I Foster

21. Monitoring and Discovery G T 4 Delegation Service Community Scheduler Framework [contribution] Python WS Core [contribution] C WS Core G T 2 Pre-WS Authentication Authorization GridFTP Grid Resource Allocation Mgmt (Pre-WS GRAM) Monitoring & Discovery System (MDS2) C Common Libraries G T 4 Credential Management G T 3 CommunityAuthorization Service OGSA-DAI [Tech Preview] Web ServicesComponents WS Authentication Authorization Reliable File Transfer Java WS Core Grid Resource Allocation Mgmt (WS GRAM) Monitoring & Discovery System (MDS4) Non-WS Components G T 3 Replica Location Service XIO Security Data Management Execution Management Information Services CommonRuntime

22. Monitoring and Discovery • WSRF provides common mechanisms for monitoring and discovering a service: • GT4 “aggregator” services within MDS: • MDS-Index: collects state information from registered resources and makes it available as XML document • MDS-Trigger: passes this information to an executable • MDS-Archive: archives state information (awaiting implementation)