1 / 81

Grid Computing Concepts: Theory and Practice

Grid Computing Concepts: Theory and Practice. -Mahantesh Halappanavar Grid Computing Systems Engineer, Research Computing, Office of Computing and Communications Services (OCCS) Old Dominion University.

dayton
Download Presentation

Grid Computing Concepts: Theory and Practice

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Grid Computing Concepts:Theory and Practice -Mahantesh Halappanavar Grid Computing Systems Engineer, Research Computing, Office of Computing and Communications Services (OCCS) Old Dominion University A note of Plagiarism  I have extensively borrowed from books and presentations by others. Sources, wherever possible, are indicated on the individual slides.

  2. My Perspective: Traditional High Performance Computing Concepts Traditional Distributed Computing Concepts The Grid Computing Applications Basics Globus Toolkit Practice

  3. A Real-life Problem • The Large Hadron Collider (LHC) Project • Will produce 15 Petabytes per year • Will need 100,000 of today’s processors for processing data • Involves 200 sites in over 30 countries

  4. Traditional High Performance Computing Concepts Traditional Distributed Computing Concepts The Grid Computing Applications Basics Globus Toolkit Practice

  5. Traditional Distributed Computing Challenges Models Components

  6. Challenges • Heterogeneity (h/w, s/w, models) • Openness (standards) • Security • Scalability • Failure handling (detecting, masking, tolerating, replication, recovery) • Concurrency (synchronization, consistency) • Transparency (access, location, failure, performance, scaling)

  7. Layered Abstraction Applications, Services Middleware Operating System Platform Computer and Network h/w

  8. Traditional Paradigms for DC CORBA DCOM Java RMI RPC Socket Programming TCP/IP Network

  9. Enter Web Services • Web service is a open standard for developing server-side components that can be described, published, discovered and invoked. • Base model for Microsoft’s .NET framework, IBM’s e-business strategy, etc. • Simple open standards like XML and HTTP • Core standards: SOAP, WSDL, and UDDI and WSIL

  10. Web Services Web Services CORBA DCOM Java RMI RPC Socket Programming TCP/IP Network

  11. Simple Object Access Protocol (SOAP) • Simple and lightweight communication protocol that enables communication between clients and servers in XML format over transport-level protocol (HTTP) SOAP Envelope SOAP Header SOAP Body

  12. Web Service Description Language (WSDL) Service • XML-based specification to describe a service • Binding: SOAP over HTTP is the most common mechanism Port Port Type Operation A Messages (i/o, o/p) Operation B Messages (i/o, o/p) Binding A Binding B

  13. The Interaction: UDDI Registry Service discovery with SOAP Service WSDL registration with SOAP Service WSDL Service response with SOAP Client Service Service request with SOAP

  14. Traditional High Performance Computing Concepts Traditional Distributed Computing Concepts The Grid Computing Applications Basics Globus Toolkit Practice

  15. Traditional High Performance Computing Challenges Models Trends

  16. Design Challenges • Communication abstraction • Programming model requirements • Naming (address space) • Operations • Ordering (mutual exclusion, events) • Communication and Replication • Performance • Latency, Bandwidth and Cost

  17. CAD Database Scientific modeling Parallel applications Multipr ogramming Shar ed Message Data Pr ogramming models addr ess passing parallel Compilation Communication abstraction or library User/system boundary Operating systems support Har dwar e/softwar e boundary Communication har dwar e Physical communication medium Layered Abstraction

  18. Flynn’s Taxonomy Few Vector Machines 1 instruction stream Many data streams PCs 1 instruction stream 1 data stream Clusters, etc Many instruction streams Many data streams Theoretical Many instruction streams 1 data stream

  19. Memory Models Distributed Memory (NUMA, CCNUMA) Shared Memory (SMP, UMA) Memory Memory Memory CPU CPU CPU CPU CPU CPU Memory CPU CPU CPU CPU CPU CPU Memory Memory Memory Message Passing Multi-threading

  20. Message Passing • Point-to-Point • Send and Receive • Collective • Barrier (wait until all respond) • Broadcast/Gather/Scatter/All-to-All • Software Standard: MPI-1, MPI-2 • MPICH, LAM/MPI, etc.

  21. Some Trends in Technology

  22. Cost of Computation

  23. Projected Performance:

  24. Top 5 on the TOP500 List

  25. Architectures

  26. Interconnects

  27. Operating Systems

  28. Installation Type:

  29. Performance Development:

  30. The Grid

  31. An Analogy of Electric Grids What is the difference? IT Grid can provide the whole service

  32. The Computing Continuum

  33. Grid Computing In A Nutshell • Resource sharing and coordinated problem solving in dynamic, multi-institutional virtual organization set-up

  34. Architecture:

  35. Types of grids • Computational grid • Focused on computing power • Where most machines are high-performance servers • Scavenging grid • Large numbers of desktop machines scavenged for available CPU cycles and other resources • Owners of the desktop machines control their resources • Data grid • Houses and providing access to data across multiple organizations • Data transparency

  36. Classes of Grid Users

  37. Challenges • The Nature of Applications • Programming Models and Tools • System Architecture • Algorithms and Problem-Solving Methods • Resource Management • Security • Instrumentation and Performance Analysis • End Systems • Network Protocols and Infrastructure

  38. Applications of Grid Computing Applications

  39. Five Major Classes of Grid Applications

  40. A few Applications • Physics (High energy, Plasma, Astro, Geophysical ) • Intelligence/Defense • Climate Prediction • Computational Biology and Bioinfomatics • Health and Safety (AIDS, Cancer) • Nanotechnology and Material Science • Behavior prediction/modeling

  41. Large Hadron Collider Project • Will produce 15 Petabytes per year • Will need 100,000 of today’s processors for processing data • Involves 200 sites in over 30 countries

  42. Medical Research

  43. Search For Extra-terrestrial Intelligence (SETI@home) Avg: 72 Tflop/s

  44. Storms Forming Forecast Model Data Mining On-Demand Grid Computing Optimal Weather Prediction Using Dynamic Adaptivity Streaming Observations Linked Environments forAtmospheric Discovery

  45. Developing Applications For The Grid

  46. Grid Computing Basic Concepts

  47. Virtual Organizations • Non-hierarchical: Chaotic analyses + productions • Superimpose significant random data flows

  48. Components: The 3 Pillars Global Grid Connectivity Using Globus Toolkit With Solaris Operating System By Sun Microsystems. Article is provided courtesy of Prentice Hall PTR. Date: Jun 25, 2004.

  49. Security – The holy grail ?

  50. The Goals • The 3 As: • Authentication: Prove I am who I say I am • Authorization: What can I do? • Accounting: Keep track of actions • Non-repudiation: cannot deny actions

More Related