COMP3019 Coursework: M-grid Installation & Demo

1. COMP3019 Coursework:M-grid Installation & Demo Steve Crouch s.crouch@software.ac.uk, stc@ecs School of Electronics and Computer Science

2. Overview • Part 1: m-grid – this lecture • m-grid: lightweight software illustrating grid concepts in use • Develop a program with m-grid’s Java API to solve a simple problem, submit it to m-grid with input data, collect results • Part 2: Google MapReduce & GridSAM – after Easter • MapReduce: framework for distributed processing of large datasets using many computers • GridSAM: job submission web service interface to a computational resource (e.g. compute cluster, single machine) • Install an OMII Client (Linux/Windows) • Develop a program using GridSAM’s API that conforms to MapReduce and solves a simple problem

3. Where to get stuff/help? • Can obtain coursework materials from website • http://www.ecs.soton.ac.uk/~stc/COMP3019 • Software documentation • Coursework help lecture 19th March • Myself: s.crouch@software.ac.uk • Building 32: Level 4 lab 4067 Bay 23

4. M-grid Installation

5. Pre-requisites • Pre-requisites: • Linux recommended • Java 5 SDK and above, recommend Java 7 JDK • Browser with Java plugin (same version!) and applets enabled • Firefox strongly recommended • Set Java security to allow Java applications (i.e. applets) to run

6. Installing your Own Server • Linux, Mac OS X, Windows • Install Apache Tomcat – v6.0.32 strongly recommended!! (7MB) • Get from • http://archive.apache.org/dist/tomcat/tomcat-6/v6.0.32/bin/apache-tomcat-6.0.32.zip • http://archive.apache.org/dist/tomcat/tomcat-6/v6.0.32/bin/apache-tomcat-6.0.32.tar.gz • Undergrad Windows machines – download and unpack zip (non-service Windows install) binary • Undergrad Win boxes don’t allow service installs • Ensure it picks up the correct JDK from JAVA_HOME • Firewall may prevent external machine connections • Go to coursework resources web page • Download ‘M-grid server webapp’ (right click, Save As…), • Get right version for Mac/Linux or Windows!!! • Rename as mgrid.war (if filename has been munged) • Copy into apache-tomcat-6.0.32/webapps • Ensure Tomcat is running, go to http://localhost:8080/mgrid • That’s it

7. Installing Client Development Kit • Go to coursework resources web page • Download and unpack ‘Client developer’s kit’ • Ensure JAVA_HOME set correctly and on PATH e.g. • Linux: export JAVA_HOME=/usr/local/jdk1.5.0_01or Mac: export JAVA_HOME=/Library/Java/JavaVirtualMachines/jdk1.7.0_45.jdk/Contents/Home • Linux/Mac: export PATH=$PATH/bin:$PATH • Win: set JAVA_HOME=C:\Program Files\Java\jdk1.5.0_01 • Win: set PATH=%JAVA_HOME%\bin;%PATH% • That’s it

8. Compile, Package and Test • e.g. the Time example • Remove existing Time.jar • e.g. del Time.jar • Compile • javac -classpath . examples\time\Time.java • Package • jar -cfTime.jar examples\time\*.* • Test locally with appletviewer • appletviewerTimeTestWithJar.html • Trivial applet web page that uses Time.jar • Use GMT-8 as input output in window • Ensure you compile it first!!!

9. Submitting to m-grid • Open Java plugin-enabled browser, select Volunteer your CPU on m-grid server homepage • Make sure you do this, or your jobs won’t have anywhere to run! • Submit to m-grid • Go to http://server:port/mgrid (e.g. http://localhost:8080/mgrid) and login • Username: guest Password: guest • Going to use mgridclient/timeParams.txt • 3 inputs to Time, one per line = 3 jobs will be created • Select ‘Submit a Job’ • Enter your user name as a job name prefix • Job Jar File: browse, find and select Time.jar • Parameters File: browse, find and select timeParams.txt • Select ‘Next ->’

10. Monitor and Download Results • Monitor job • Select View Jobs • Look for your chosen Job Name • Valid job states: Uploaded -> Allocated -> Completed or Failed • Download results • Can View Results (or Error Details) for each submitted job once complete • Remove your jobs (only your job!)