Introduction to Parallel Processing

1. Introduction to Parallel Processing Dr. Guy Tel-Zur Lecture 6

2. The Course Roadmap Introduction Message Passing HPC HTC Today Condor Shared Memory Next week Exe #3 The Grid (EGEE) MPI OpenMP Cloud Computing

3. Agenda • A remark about Collective commands in MPI • More MPI Demonstrations • Introduction to Condor (next week - lab) • Users perspective • Admin. Perspective • Demo: • How to install a Personal Condor • A test program • Discussion about the Final presentations • Home assignment #2

4. http://eesgi2.ee.bgu.ac.il/

5. MPI • More MPI examples • Dead lock example with collective commands.

6. פקודות קולקטיביות חייבות להינתן באותו הסדר לכל התהליכים בקומוניקטור // Process A: MPI_Bcast(buf1, count, type, 0, comm); MPI_Bcast(buf2, count, type, 1, comm); break; // Process B (reverse broadcast): MPI_Bcast(buf2, count, type, 1, comm); MPI_Bcast(buf1, count, type, 0, comm); From: “Grid Computing for Developers” book, by VLADIMIR SILVA

7. Makefile tutorial • http://www.eng.hawaii.edu/Tutor/Make/

8. Condor • Online manual: http://www.cs.wisc.edu/condor/manual/v7.4 • Next presentation: • 2010 Condor Week • Nick LeRoy presentation: Condor User Tutorial • URL: http://www.cs.wisc.edu/condor/CondorWeek2010/condor_presentations.html

9. Installing Condor (7.4.2 – current) “Personal” Condor on Windows (Vista) Version 7.4.2. Released on April 6, 2010

10. Cont’

11. Cont’

12. Cont’

13. Cont’

14. Cont’ Click on Install

15. Cont’ Give Administrator rights to the installer

16. Cont’ restart

17. The Condor service should be started If needed restart the service here

18. At least the five Condor daemons should be running

19. Condor config

20. Condor config_local You will find both configuration files under the install dir c:\condor

21. condor_status Good! So now we have a Personal Condor running on my laptop 

22. Demo: cpu_burn.c #include <math.h> #include <stdio.h> int main() { int iMAX = 60000; int i,j; float fNORM, fMAX; float x,y; fMAX = iMAX; // convert to float fNORM = fMAX * fMAX; for (j=0;j<iMAX;j++) for (i=0;i<iMAX;i++) { y = i; // convert to float x = y*y/fNORM; } return 0; }

23. Submit file: universe = vanilla executable = cpu_burn.exe Error = err.$(Cluster).$(Process) Output = out.$(Cluster).$(Process) Log = log.$(Cluster).$(Process) Queue 5

24. Watch the Task Manager

25. Check the logfile 000 (088.001.000) 04/26 10:23:10 Job submitted from host: <127.0.0.1:50486> ... 001 (088.001.000) 04/26 10:23:19 Job executing on host: <127.0.0.1:50487> ... 005 (088.001.000) 04/26 10:24:20 Job terminated. (1) Normal termination (return value 0) Usr 0 00:00:27, Sys 0 00:00:00 - Run Remote Usage Usr 0 00:00:00, Sys 0 00:00:00 - Run Local Usage Usr 0 00:00:27, Sys 0 00:00:00 - Total Remote Usage Usr 0 00:00:00, Sys 0 00:00:00 - Total Local Usage 0 - Run Bytes Sent By Job 15686 - Run Bytes Received By Job 0 - Total Bytes Sent By Job 15686 - Total Bytes Received By Job ...

27. Condor daemons while executing cpu_burn

29. Same job at the vdwarf Show demo under: /users/agnon/misc/tel-zur/condor/cpuburn

30. Condor and Matlab/Octave demo

31. The submit file

32. The wrapper file

34. Final Presentations • עבור למצגת הרצאות גמר • כל קבוצת תלמידים מתבקשת לבחור נושא להרצאת גמר ואז לפעול כדלקמן: • לשלוח אלי ל- gtelzur@bgu.ac.il את הדברים הבאים: • נושא ההרצאה (כותרת) • מספר הקבוצה (PP-xx) • שמות חברי הקבוצה • אני אשיב לקבוצה באם הנושא אושר או לא! בטרם תקבלו אישור ממני, אין להתחיל לעבוד על ההצעה שהגשתם!

35. זהו להפעםשבוע הבא, 21.8, תירגול CONDORבמעבדה 310 בבניין 3418:00-21:00נוכחות חובה