1 / 26

Grid Computing Software Components of Globus 4.0

Grid Computing Software Components of Globus 4.0. ITCS 4010 Grid Computing, 2005, UNC-Charlotte, B. Wilkinson, slides 4b. Globus Version 4. A “toolkit” of services and packages for creating the basic grid computing infrastructure Higher level tools added to this infrastructure

herne
Download Presentation

Grid Computing Software Components of Globus 4.0

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Grid Computing SoftwareComponents of Globus 4.0 ITCS 4010 Grid Computing, 2005, UNC-Charlotte, B. Wilkinson, slides 4b

  2. Globus Version 4 • A “toolkit” of services and packages for creating the basic grid computing infrastructure • Higher level tools added to this infrastructure • Version 4 is web-services based • Some non-web services code exists from earlier versions (legacy) or where not appropriate (for efficiency, etc.).

  3. Each part comprises a set of web services and/or non-web service components. • Some built upon earlier versions of Globus.

  4. Globus Open Source Grid Software G T 4 Delegation Service Community Scheduler Framework [contribution] Python WS Core [contribution] C WS Core G T 3 CommunityAuthorization Service OGSA-DAI [Tech Preview] WS Authentication Authorization Reliable File Transfer Java WS Core Grid Resource Allocation Mgmt (WS GRAM) Monitoring & Discovery System (MDS4) G T 2 Pre-WS Authentication Authorization GridFTP Grid Resource Allocation Mgmt (Pre-WS GRAM) Monitoring & Discovery System (MDS2) C Common Libraries G T 3 Replica Location Service XIO G T 4 Credential Management Web ServicesComponents Non-WS Components Security Data Management Execution Management Information Services CommonRuntime I Foster

  5. Another view of GT4 Components Your Python Client Your C Client Your Java Client Your Python Client Your Python Client Your C Client Your C Client CLIENT Your Java Client Your Java Client Your Python Client Your C Client Your Java Client Interoperable WS-I-compliant SOAP messaging X.509 credentials = common authentication Trigger Archiver Your C Service GRAM RFT Delegation Index CAS OGSA-DAI GTCP Your Python Service Your Java Service Your Java Service RLS GridFTP SimpleCA MyProxy Pre-WS MDS Pre-WS GRAM C WS Core pyGlobus WS Core Java Services in Apache Axis Plus GT Libraries and Handlers Python hosting, GT Libraries C Services using GT Libraries and Handlers SERVER I Foster

  6. GT Core • Provides the ability to create services running inside the GT 4 container. • Assignment 2 requires you to create a service inside GT 4 container and exercise it with a client.

  7. Java WS Core G T 4 Delegation Service Community Scheduler Framework [contribution] Python WS Core [contribution] C WS Core G T 2 Pre-WS Authentication Authorization GridFTP Grid Resource Allocation Mgmt (Pre-WS GRAM) Monitoring & Discovery System (MDS2) C Common Libraries G T 4 Credential Management G T 3 CommunityAuthorization Service OGSA-DAI [Tech Preview] Used in assignment 2 Web ServicesComponents WS Authentication Authorization Reliable File Transfer Java WS Core Grid Resource Allocation Mgmt (WS GRAM) Monitoring & Discovery System (MDS4) Non-WS Components G T 3 Replica Location Service XIO Security Data Management Execution Management Information Services CommonRuntime

  8. User Applications Custom WSRF Web Services Custom Web Services GT4WSRF Web Services Registry Administration GT4 Container WS-Addressing, WSRF, WS-Notification WSDL, SOAP, WS-Security GT4 Web Services Core I Foster

  9. Execution Management Key component GRAM (Grid Resource Allocation Manager) • For submitting executable jobs • Used in Assignment 3 to submit and execute jobs. • May interface to a local job scheduler • Local job scheduler used in assignment 4

  10. GRAM (Grid Resource Allocation Manager) G T 4 Delegation Service Community Scheduler Framework [contribution] Python WS Core [contribution] C WS Core G T 2 Pre-WS Authentication Authorization GridFTP Grid Resource Allocation Mgmt (Pre-WS GRAM) Monitoring & Discovery System (MDS2) C Common Libraries G T 4 Credential Management G T 3 CommunityAuthorization Service OGSA-DAI [Tech Preview] Web ServicesComponents WS Authentication Authorization Reliable File Transfer Java WS Core Grid Resource Allocation Mgmt (WS GRAM) Monitoring & Discovery System (MDS4) Non-WS Components G T 3 Replica Location Service XIO Used in assignment 3 Security Data Management Execution Management Information Services CommonRuntime

  11. GT4 GRAM Structure: Sun Grid Engine used in assignment 4 Service host(s) and compute element(s) GT4 Java Container Compute element Local job control GRAM services GRAM services Local scheduler Job functions sudo GRAM adapter Delegate Transfer request Delegation Client Delegate GridFTP User job RFT File Transfer FTP control FTP data Remote storage element(s) GridFTP Data management components I Foster

  12. Security Components Addresses the security requirements of grid computing. Three important factors are: • Authorization • Process of deciding whether a particular identity can access a particular resource • Authentication • Process of deciding whether a particular identity is who he says he is (applies to humans and systems) • Delegation(somewhat specific to grid computing) • Process of giving authority to another identity (usually a computer/process) to act on your behalf.

  13. Security continued • Security aspects complicated by the fact that virtual organization members and resources can be in different administrative domains.

  14. Security G T 4 Delegation Service Community Scheduler Framework [contribution] Python WS Core [contribution] C WS Core G T 3 CommunityAuthorization Service OGSA-DAI [Tech Preview] Web ServicesComponents WS Authentication Authorization Reliable File Transfer Java WS Core Grid Resource Allocation Mgmt (WS GRAM) Monitoring & Discovery System (MDS4) G T 2 Pre-WS Authentication Authorization GridFTP Grid Resource Allocation Mgmt (Pre-WS GRAM) Monitoring & Discovery System (MDS2) C Common Libraries Non-WS Components G T 3 Replica Location Service XIO G T 4 Credential Management Security Data Management Execution Management Information Services CommonRuntime

  15. GT4’s Use of Security Standards I Foster

  16. GT4 Data Management • Move large data to/from nodes • Replicate data for performance & reliability • Locate data of interest • Provide access to different data sources • File systems, parallel file systems, hierarchical storage (GridFTP) • Databases (OGSA DAI)

  17. GridFTP and Reliable File Transfer G T 4 Delegation Service Community Scheduler Framework [contribution] Python WS Core [contribution] C WS Core G T 4 Credential Management G T 3 CommunityAuthorization Service OGSA-DAI [Tech Preview] Web ServicesComponents WS Authentication Authorization Reliable File Transfer Java WS Core Grid Resource Allocation Mgmt (WS GRAM) Monitoring & Discovery System (MDS4) G T 2 Pre-WS Authentication Authorization GridFTP Grid Resource Allocation Mgmt (Pre-WS GRAM) Monitoring & Discovery System (MDS2) C Common Libraries Non-WS Components G T 3 Replica Location Service XIO Security Data Management Execution Management Information Services CommonRuntime

  18. GridFTP • Built on FTP using separation of data and control channels • Provides features for • Large data transfers • Secure transfers • Fast transfers • Reliable transfers • Third party transfers • Not a web service • RTF (Reliable File Transfer) service provided WS-level interface

  19. Third party transfers Client PI PI Server Server PI PI Control channels DTP DTP Data channel DTP= FTP Data Channel Process PI = FTP Protocol Interpreter

  20. Performing a third-party transfer 1. Client establishes control channel with server 2. Using control channel, client sets up transfer parameters and requests data channel creation 3. Data channel established, 4. Client sends transfer command over control channel, 5. Data transfer starts through data channel. Either client or server can send.

  21. Parallel transfers and striping • Using multiple (virtual) connections for transfer • Same external network • Speed improvement possible, but limited by network card • Striping • a version of parallel transfers that can use separate hardware interfaces • Implemented in GT 4.

  22. GridFTP and RFT RFT service (Java) WS Client Client API (Java) Control channel Control channel Data channel XIO based (C) XIO based (C) GridFTP server GridFTP server From Gridwise

  23. GT 4 Replica Location Service Index Index • Identify location of files via logical to physical name map • Distributed indexing of names, fault tolerant update protocols I Foster

  24. Monitoring and Discovery G T 4 Delegation Service Community Scheduler Framework [contribution] Python WS Core [contribution] C WS Core G T 2 Pre-WS Authentication Authorization GridFTP Grid Resource Allocation Mgmt (Pre-WS GRAM) Monitoring & Discovery System (MDS2) C Common Libraries G T 4 Credential Management G T 3 CommunityAuthorization Service OGSA-DAI [Tech Preview] Web ServicesComponents WS Authentication Authorization Reliable File Transfer Java WS Core Grid Resource Allocation Mgmt (WS GRAM) Monitoring & Discovery System (MDS4) Non-WS Components G T 3 Replica Location Service XIO Security Data Management Execution Management Information Services CommonRuntime

  25. Monitoring and Discovery • WSRF provides common mechanisms for monitoring and discovering a service: • GT4 “aggregator” services within MDS: • MDS-Index: collects state information from registered resources and makes it available as XML document • MDS-Trigger: passes this information to an executable • MDS-Archive: archives state information (awaiting implementation) • Every GT 4 is discoverable

  26. Acknowledgement Slides numbers marked with “I Foster” have been selected from presentations made by Ian Foster: • Enabling eScience: Grid Technologies Today & TomorrowAmerican Association for the Advancement of Science Annual Meeting, Washington, DC, February 21 2005. • Globus: Bridging the GapKeynote Talk, GlobusWORLD, Boston, Mass., February 8, 2005. • The Grid: Reality, Technologies, ApplicationsDistinguished Lecture, McGill University, Montreal, Canada, January 21 2005. used for educational purposes only.

More Related