Globus —— Toolkits for Grid Computing

1. Globus —— Toolkits for Grid Computing CS5204: Operating System Donghang GUO doguo@vt.edu Computer Science Department, Virginia Tech

2. Grid & Globus • Introduction to Grid Computing • What is a Grid? • What we need to build up a Grid? • Globus • Why Globus is good? • How to use Globus to build up a Grid?

3. B A C D E What is a Grid? A: a cluster B: a mainframe C: a cluster D: a smaller cluster E: a PC

4. B A C E D What is a Grid? (cont’d) • Definition “Grid is coordinated resource sharing and problem solving in dynamic, multi-institutional virtual organizations.”– [2]

5. B A C E D What is a Grid? (cont’d) • Grid is a middleware based DS • Transparency: High • Same OS (Platform): No • Communication: Model-Specific • Resource Management: Mix • Scalability: High • Openness: Open

6. B A C E D Features of Grid • Resource Sharing • WWW: Information sharing • Multiple Resources • SSP: only storage resource • ASP: only application resource • Cross-organization • CORBA, Java Bean: in one organization SSP: Storage Service Provider ASP: Application Service Provider

7. B A C E D Features of Grid (cont’d) • Controlled sharing • P2P computing: no access control • Dynamic • Cluster, Supercomputer: Static

8. Applications Collective Resource Connectivity Fabric What we need to build up a Grid? Core parts in Grid The layered Grid Architecture

9. Applications Collective Resource Connectivity Fabric What we need to build up a Grid? • Fabric Layer Computers, Storage systems, networks ... • Connectivity Layer Secured communication, authentication, authorization … • Resource Layer • Access to computation • Access to data • Access to information on resource configuration, state and performance

10. Applications Collective Resource Connectivity Fabric What we need to build up a Grid? • Collective Layer • Resource Discovery • Resource Brokering (scheduling) • System Monitoring

11. Grid Middleware Grid Middleware provides functionalities to build up a grid computing environment. • Globus A service-based toolkit following OGSI (Open Grid Services Infrastructure) standard • Legion A object-based toolkit • SRB Storage resource broker • Condor A local resource and job management system

12. Globus Toolkits • History • Origin I-WAY Project, 1994, Argonne National Laboratory and University of Illinois at Chicago. • Metacomputer  Grid? Power Grid

13. Globus Toolkits • Motivation Availability: Computing Resource: Ready Data Resource: Ready Network Resource: Ready Requirement: Cost-effective high performance computing in scientific and commercial societies We need a new system that deal with heterogeneous and dynamic natures to build up a new computing environment

14. Globus Toolkits • Features: It is Open • Open Source • Service-Based • Protocol-Based Globus is a de facto stand in Grid Computing

15. Globus Toolkits • Components • Information Service • Meta-Directory Service (MDS) • Resource Management Service • Grid Resource Allocation and Management (GRAM) • Community Scheduler Framework (CFS) • Security Service • Grid Security Infrastructure (GSI) • Data Management Service • GridFTP • Replica Location Service (RLS)

16. Resource A Client 1 GRIS Resource B Information Directly from Resource Client 2 GRIS Client 3 Collective Information GIIS MDS —— Information Model Resource A Client 1 LDAP Organization Server MDS-1 Client 2 Resource B Client 3 MDS-2

17. Resource A Client 1 GRIS Resource B Client 2 Information Directly from Resource GRIS Client 3 Collective Information GIIS MDS-2——Implementation • Service • GRIS Grid Resource Information Service • GIIS Grid Index Information Service • Protocol • GRRP Grid Resource Registration Protocol • GRIP Grid information Protocol Both GRRP and GRIP are extended from LDAP (Light Weight Directory Access Protocol)

18. MDS-2 Resource A Client 1 GRIS Resource B Client 2 Resource Lookup: GRIP GRIS Client 3 Registration: GRRP Resource Discovery: GRIP GIIS

19. MDS-2 … Mds-Cpu-Free-15min: 200 Mds-Cpu-Free-1min: 200 Mds-Cpu-Free-5min: 200 Mds-Cpu-model: Pentium III (Coppermine) Mds-Cpu-Smp-size: 2 Mds-Cpu-speedMHz: 997 Mds-Cpu-Total-count: 2 Mds-Cpu-Total-Free-15min: 200 Mds-Cpu-Total-Free-1min: 200 Mds-Cpu-Total-Free-5min: 200 Mds-Cpu-vendor: GenuineIntel Mds-Cpu-version: 6.8.6 … • Output of GRIS service • Configuration of Resource • Code in LDAP Protocol

20. Conclusion • Strength • Service-Based Open architecture • Extensibility • Interoperability • Portability • Scalable • Flexible, secure and coordinated resource sharing • Dynamic

21. Conclusion • Weakness • Not suitable for communication-intensive applications • No good overall performance optimization mechanism

22. Questions?

23. Reference • 1. Globus: A Metacomputing Infrastructure Toolkit. I. Foster, C. Kesselman. Intl J. Supercomputer Applications, 11(2):115-128, 1997 • 2. The Anatomy of the Grid: Enabling Scalable Virtual Organizations. I. Foster, C. Kesselman, S. Tuecke. International J. Supercomputer Applications, 15(3), 2001.