1 / 19

Evaluation of Agent Teamwork A High Performance Distributed Computing Middleware

Evaluation of Agent Teamwork A High Performance Distributed Computing Middleware. Solomon Lane Agent Teamwork Research Assistant October 2006 – March 2007. What is Agent Teamwork?. HPDC Middleware Job Dispatch & Termination Programming Framework Under Ongoing Development.

james-rush
Download Presentation

Evaluation of Agent Teamwork A High Performance Distributed Computing Middleware

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Evaluation of Agent TeamworkA High Performance Distributed Computing Middleware Solomon Lane Agent Teamwork Research Assistant October 2006 – March 2007

  2. What is Agent Teamwork? • HPDC Middleware • Job Dispatch & Termination • Programming Framework • Under Ongoing Development

  3. Project Objectives • Evaluate Agent Teamwork’s performance against a contemporary alternative • Job Dispatch & Termination Performance • Framework Performance • Build a Reference Platform • Write 3 benchmark programs that exercise the framework

  4. Job Dispatch & Termination Performance Evaluation • Globus Based Reference Platform • Globus Toolkit • OpenPBS scheduler • MPICH-G2

  5. Reference Platform Hardware

  6. Reference Platform Overview

  7. Reference Platform Challenges • Administrator Access to Machines • Host Config & Cryptic Error Messages • DNS vs hosts files • Inconsistent hosts files • Inconsistent ptr records • Inconsistent port acls • : globus_init: failed • GTK Authentication

  8. Debugging • Strace • TcpDump • GDB

  9. Job Dispatching and Termination Function Evaluation • Not evaluating the job execution performance • Methodology • Ported available test program to the MPICH-G2 framework • measure how long it takes a job submission to be deployed, executed and cleaned up • Run with 2-64 nodes across the two clusters in a depth-first node distribution series and a breadth-first node distribution series

  10. Results

  11. Results

  12. Results

  13. Framework Function Evaluation • Framework Issues • Agent Teamwork MPI implementation • MPICH-G2 C++ • MPIJava • MPI Framework • Communication functions • Initialization, Barrier, Broadcast, Gather, Scatter, etc. • Goal to write 3 benchmark programs that have communication intensive algorithms.

  14. Benchmark Programs • MD - a molecular dynamics simulation • Wave2D - a wave dissemination simulation • Mandelbrot - a Mandelbrot generator • Code each program twice

  15. Agent Teamwork Programming • Snapshots • Programming model • func_n int func_0 (String[] Args){ … return 1; } int func_1 () { … } • Code Maturity

  16. Partial Results

  17. Partial Results

  18. Future Work • Framework debugging • Develop a pre-processor to convert conventionally programmed code into the snapshot-able func_n model

  19. Skills Developed During Project • Significant experience with globus, openPBS and the mpi • Extensive debugging with tcpdump, strace, and gdb • experience with performance analysis and writing MPI programs • new insights and understanding of HPDC

More Related