1 / 33

Grid Computing

Grid Computing. A summary of concepts and ideas including the implementation there-of. Robert Stallings. Thursday, April 20 th , 2006. Grid Computing Definition History Reasoning Critical Tasks Infrastructure Architecture Authentication. Globus Toolkit Radford and Globus Globus

jpierce
Download Presentation

Grid Computing

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Grid Computing A summary of concepts and ideas including the implementation there-of. Robert Stallings Thursday, April 20th, 2006

  2. Grid Computing Definition History Reasoning Critical Tasks Infrastructure Architecture Authentication Globus Toolkit Radford and Globus Globus Installing Globus What’s next Conclusion Questions and Answers Contents

  3. History • Not a new idea • 1965 Fernando Corbato • “Like a power company or water company” • 1968 J.C.R Licklider and Robert W. Taylor

  4. Definition • Server clusters • Clusters of clusters • Grids join multiple server clusters

  5. Why Gird Computing? • Quick Facts • Speed doubles every 12 months • Capacity doubles every 9 months • A computer halves in price every 18 months • Performance of WAN doubles every nine months • Capacity and WAN Performance is comparable

  6. Critical Tasks • Involves using remote resources • Must • Discover they exist • Negotiate access to them • Configure hardware and software • Not lose security.

  7. Critical Tasks • Critical Tasks • Creating and managing services • Single Sign-on • Transferring large datasets quickly • Form large communities • Maintain existence, state, and usage policies

  8. Infrastructure • Internet handles basic communication • Must • Be broadly developed • Simple • Same functionality as the Internet but more • Examples: • Science portals • Distributed Computing • Large scale Data analysis • Computer-in-the-loop instrumentation • Collaborative work

  9. Architecture

  10. Authentication • More difficult • Computer can be a server AND a client • Must be able to have one computer be able to use resources on another on behalf of the user.

  11. Authentication • Requirements • Single Sign-on • Mapping to local security • Example: Kerberos • Delegation • Community Authorization and Policy

  12. Authentication

  13. Overview Conclusion • Not a new idea • Several Critical tasks • New Infrastructure • New Architecture • Unique Authentication Procedure

  14. The Globus Toolkit Experiences with The Modern Grid

  15. Overview • Radford and Globus • Globus • Installing Globus • What’s next • Conclusion • Questions and Answers

  16. Radford and Globus • NSRL • Network and Security Laboratory • CREU • Collaborative Research Environment for Undergraduates • Current Network • 2 Fedora machines • 1 Windows Machine

  17. Globus • The Globus Toolkit • The Globus Alliance • Middleware • GRAM • MDS • GSI • GASS / GridFTP

  18. Setting Up Globus • Several Basic Steps • Security • GridFTP • Webservices • Reliable File Transfer • WS GRAM

  19. Installation • Installation • Fedora Core 4 • Easy with RPM • Windows • Standard EXE • Linux > Windows • Security • Options • Compatibility

  20. Security • Create user “Globus” • Set up full hostname • Set up dns server • Create a Simple Certificate Authority • Certificates • Certificate Authority • Single Sign-in • Add to Mapfile

  21. Security • 1st machine as Primary Certificate Authority • Secure • Sign certificates • Distribute • Signing: • Grid-ca-sign –in cert –out signed

  22. GridFTP • Start Globus Service • Install xinetd.d • Service Maintainer • Create GridFTP Service • Gridftp file • Services file

  23. gridftp file service gsiftp { instances = 100 socket_type = stream wait = no user = root env += GLOBUS_LOCATION=/usr/local/globus-4.0.1 env += LD_LIBRARY_PATH=/usr/local/globus-4.0.1/lib 2 server = /usr/local/globus-4.0.1/sbin/globus-gridftp-server server_args = -i log_on_success += DURATION nice = 10 disable = no } GridFTP

  24. Add to tail end: # Local services gsiftp 2811/tcp GridFTP • Services File

  25. Webservices • Auto-start container • stop-start script • To start and stop the container easy • Init.d script • To start the stop-start script on bootup • Errors • No Reliable File Transfer (RFT).

  26. Reliable File Transfer • Install Postgres • Database • Create User Postgres • Allow Globus User Admin Privilege

  27. Reliable File Transfer • Create Database • rft_schema.sql • Edit config file with password and user • Restart container

  28. WS GRAM • Use visudo to edit sudoers file • Sudoers • Who can do what (all one line) globus ALL=(fedoralee1) NOPASSWD: /usr/local/globus-4.0.1/libexec/globus-gridmap-and-execute -g /etc/grid-security/grid-mapfile /usr/local/globus-4.0.1/libexec/globus-job-manager-script.pl * globus ALL=(fedoralee1) NOPASSWD: /usr/local/globus-4.0.1/libexec/globus-gridmap-and-execute -g /etc/grid-security/grid-mapfile /usr/local/globus-4.0.1/libexec/globus-gram-local-proxy-tool * DONE! (with the first machine)

  29. Second Machine • Same procedure except.. • Trusting 1st machine CA • Certificate Timing • DNS configuration • Copy second machine for duplication

  30. Common Installation Problems • No fully Qualified Domain • Create a full Domain Name Service server • No Mapfile Entry for name • Invalid Timestamps for certificates

  31. Still to Be Done.. • NTP between computers • Testing Security • Porting Globus to First Windows Machines • Better Troubleshooting Guide

  32. Conclusion • A lot of time • Huge learning curve • Globus is powerful

  33. Questions ?

More Related