Grid Computing, B. Wilkinson, 2005

1. Grid ComputingFall 2005Tuesday/Thursday 11:00 am - 12:20 pmInstructorsDr. Barry WilkinsonUniversity of North Carolina at CharlotteandDr. Clayton FernerUniversity of North Carolina at Wilmington Grid Computing, B. Wilkinson, 2005

2. Grid Computing • Using geographically distributed and interconnected computers together for computing and for resource sharing.

3. “The grid virtualizes heterogeneous geographically disperse resources” from "Introduction to Grid Computing with Globus," IBM Redbooks

4. Interconnections Usually grid computing employs the Internet to interconnect the computers. As we see, standard Internet protocols are used.

5. Virtual Organization Usually, grid computing involves teams working together on a common goal, sharing computing resources and possibly experimental equipment. The geographically distributed grid computing team is called a virtual organization. The resources shared include software and experimental data.

6. Course credit This course can be taken by students at any university connected to the NCREN, for credit at their institution. Course number assigned by the institution. Listed as an undergraduate course but can be taken for graduate credit with my approval and your institution. Graduate students can expect more demanding work.

7. Course virtual organization Current list of sites scheduled to receive course with students: • NC State University • University of North Carolina at Asheville • University of North Carolina at Charlotte • University of North Carolina at Pembroke • University of North Carolina at Wilmington • Western Carolina University

8. MCNC UNC-W UNC-A NCSU WCU UNC-C ASU Course grid structure

9. Class schedule Each university has its own class schedule. Start date: Tuesday August 23rd, 2005 (UNC-C's start date). Last class: Thursday December 1st, 2005. No class on: • Tuesday October 11th, 2004 (UNC-C Fall break) and • Thursday November 24th, 2005 (Thanksgiving ). It will be necessary for students at sites with breaks that do not coincide with UNC-C's breaks to watch recordings of classes later.

10. Prerequisites • Preferably programming skills in Java on a Linux system.

11. Topics • Introduction to grid computing • Web services • Grid computing software (Globus 4.0) • Security, Public Key Infrastructure • Schedulers • UNC-W workflow editor (GridNexus) • Grid computing applications

12. Assignments and Grading 45% 15% 25% 15% • Several “simple” pre-written programming assignments (tasks) • web services • GT 4 services • Globus job • SGE job • Using UNC-W GUI • Additional programming assignment/project • Class tests (2) • Final test • Small print: Subject to change. The instructor reserves the right to change the assignments and the grading to make it easier or harder.

13. “Simple” Prewritten Programming Assignments • Detailed instructions provided on achieving a task (creating a web service, GT 4 web service, etc.) • Simply follow instructions. • At end, asked to extend the work - e.g. add functionality to a service.

14. Software Course assignments require specific distributed computing software from the NSF NMI package. The software is installed on systems at certain sites, including: • Appalachian State University • Elon University • NC State University • University of North Carolina at Charlotte • University of North Carolina at Wilmington • Western Carolina University • MCNC (Microelectronics Center of North Carolina) If not available locally, student will access software through remote access to one of the participating sites or MCNC.

15. Software continued Certain software can easily be downloaded and installed on your own PC, so that you can do some work at home. All software can be downloaded and installed on a Linux system. Instructions are provided on the course home page but it can be quite difficult to make the software work.

16. Class tests and assignment submission WebCT at UNC-C will be used for multiple-choice class tests and for submitting assignments. http://www.webct.uncc.edu/WCT_FACULTY/index.html Everyone will be given an account on this system.

17. Weeks 1 - 3 (tentative) Grid computing Virtual organizations, computational grid projects, grid computing networks, TeraGrid, grid projects in the US and around the world, grid challenges Internet Technologies IP addresses, HTTP, URL, HTTP, XML, Telnet, FTP, SSL Web Services I. Service-Oriented Architecture (SOA), service registry, XML documents, XML schema, namespaces, SOAP, XML/SOAP examples, Axis Web Services II. WSDL, portType, message definition, WSDL to/from code Assignment 1"Simple" Web service Java programming assignment. Tomcat environment, axis, JWS facility

18. Weeks 3 - 4 (tentative) Grid Computing Standards, Open Grid Services Architecture (OGSA), Web Services Resource Framework (WSRF), Globus 4.0, components, creating a GT 4 service and clients. Assignment 2"Simple" GT4 service programming assignment. Globus 4.0 environment.

19. Weeks 4 - 5 (tentative) SecuritySecure connection, authorization requirements, symmetric and asymmetric (public/private) key cryptography, non-repudiation, digital signatures, certificates, certificate authorities, X509 certificate Information Directory Services, LDAP, resource discovery Assignment 2a “Sticky Note” tutorial.

20. Weeks 5 - 6 (tentative) GT 4 Job submission Basic structure (version 4.0), service container, service browser, Globus Resource Allocation Manager (GRAM), job submission with globusrun-ws, Grid Security Infrastructure (GSI), Globus certificates, simpleCA, proxies, creating a proxy, Resource management, resource Specification Language, syntax and examples in RSL and RSl-2 Assignment 3 Submitting a Job to the Grid, GT4 globusrun-ws, job specified in RSL-2 (XML file)

21. Weeks 6 - 7 (tentative) Schedulers and Condor, submit description file, resource brokers DAGMan, Checkpointing, ClassAd, Condor-G, Sun Grid Engine Assignment 4 Submitting an SGE Job

22. Weeks 7 - 8 (tentative) High Performance Techniques for high performance computing (HPC) computing, brief introduction to MPI, techniques suitable for grid computing.

23. Weeks 8 - 9 (tentative) Workflow editors GridNexus, JXPL Grid portals Examples and design using JSP 168 Assignment 5 Using GridNexus

24. Weeks 10 to 15 UNC-W applicationsScientific, business Guest Speakers Course projects

25. Instructor detailsBarry WilkinsonDepartment of Computer ScienceUniversity of North Carolina at Charlotte Home page: http://www.cs.uncc.edu/~abwEmail: abw@uncc.eduOffice HoursTuesday/Thursday9:30 am to 10:30 am and 2:00 pm to 3:00 pm 

26. Course Home Page http://www.cs.uncc.edu/~abw/ITCS4010F05 for announcements, slides, assignments, reading materials, tests dates, etc. Visit regularly.

27. Course Text • There is no assigned course textbook • Materials and links are provided on the home page.

28. Expectations • Print out slides before class, read them, and annotate them during class. • Read key papers and other materials provided. • Ask questions during class and participate in class discussion.

29. Acknowledgements Partial support for this work was provided by the National Science Foundation’s Course, Curriculum, and Laboratory Improvement program under grant 0410667 and by University of North Carolina, Office of the President. Their support is gratefully acknowledged.

30. NCREN facility(North Carolina Research and Education Network) Site interaction Each site will be using their NCREN facility, which provides microphones for individuals to speak. Please feel fee to speak at suitable times but remember that the NCREN needs to be able to recognize the site and speaker, so first announce your institution.

31. NCREN facility(continued) • Since most microphones are turned one all the time, any sound will be heard across all sites unless a site turns their microphones off, so try to avoid unnecessary sounds. • Fans from laptop can be especially disturbing, so move laptop away from a microphone.