1 / 16

Nimrod/G GRID Resource Broker and Computational Economy

Nimrod/G GRID Resource Broker and Computational Economy. David Abramson, Rajkumar Buyya, Jon Giddy School of Computer Science and Software Engineering Monash University, Melbourne, Australia Email: {davida, rajkumar, jon}@csse.monash.edu.au.

duer
Download Presentation

Nimrod/G GRID Resource Broker and Computational Economy

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Nimrod/G GRID Resource Broker and Computational Economy David Abramson, Rajkumar Buyya, Jon Giddy School of Computer Science and Software Engineering Monash University, Melbourne, Australia Email: {davida, rajkumar, jon}@csse.monash.edu.au

  2. Solving grand challenge applications using computer modeling, simulation and analysis E-commerce/anything Computing Power (HPC) Drivers Life Sciences Aerospace Digital Biology CAD/CAM Military Applications Military Applications Military Applications

  3. 2100 2100 2100 2100 2100 2100 2100 2100 2100 Computing Platforms EvolutionBreaking Administrative Barriers ? PERFORMANCE Administrative Barriers Individual Group Department Campus State National Globe Inter Planet Universe Desktop (Single Processor?) SMPs or SuperComputers Local Cluster Enterprise Cluster/Grid Global Cluster/Grid Inter Planet Cluster/Grid ??

  4. Global Computational Grids

  5. Grid Resource Management: Challenging Issues • Authentication (once) • Specify simulation (code, resources, etc.) • Discover resources • Negotiate authorization, acceptable use, Cost, etc. • Acquire resources • Schedule Jobs • Initiate computation • Steer computation • Access remote data-sets • Collaborate on results • Account for usage Domain 1 Domain 2 Ack.: globus..

  6. Grid Components Applications and Portals Grid Apps. … Prob. Solving Env. Collaboration Engineering Web enabled Apps Scientific Grid Tools Development Environments and Tools … Web tools Libraries Languages Monitoring Resource Brokers Debuggers Distributed Resources Coupling Services Grid Middleware … QoS Data Access Sign on & Security Information Comm. Process Local Resource Managers … TCP/IP & UDP Queuing Systems Operating Systems Libraries & App Kernels Grid Fabric Networked Resources across Organisations … Storage Systems Data Sources Clusters Scientific Instruments Computers

  7. Grid Node N Grid Node 2 Computational Market Model for Grid Resource Management Grid Information Server(s) Info ? Health Monitor … Grid Explorer … Application Job Control Agent Grid Node1 Schedule Advisor Trading Trade Server Charging Alg. Trade Manager Accounting Resource Reservation Other services … Deployment Agent Jobs Resource Allocation Grid User Grid Resource Broker … R1 R2 Rm Grid Resource/Control Domains Grid Middleware

  8. A global scheduler for managing and steering task farming (parametric simulation) applications on computational grid based on deadline and computational economy. Key Features A single window to manage & control experiment Resource Discovery Trade for Resources Scheduling Steering & data management It allows to study the behaviour of some of the output variables against a range of different input scenarios. What is Nimrod/G ?

  9. Nimrod/G Grid Resource Broker Architecture Nimrod/G Client Nimrod/G Client Nimrod/G Client Nimrod/G Engine Schedule Advisor Grid Bookkeeper Trading Manager Grid Dispatcher Grid Explorer Grid Middleware Globus,Legion, Condor-g,, Ninf,etc. TM TS GE GIS Grid Information Server(s) RM & TS RM & TS RM & TS L N G G Ninf enabled node. Globus enabled node. L C RM: Local Resource Manager, TS: Trade Server Condor enabled node.

  10. User process I/O server File access Nimrod/G Interactions Resource location Grid Info servers Scheduler Trade Server Resource allocation (local) Prmtc.. Engine Dispatcher Queuing System Job Wrapper Process server Root node Computational node Gatekeeper node

  11. Cost A Nimrod/G Client Deadline Legion hosts Globus Hosts Bezek is in both Globus and Legion Domains

  12. Change deadline/budget + Monitor activities

  13. Adaptive Scheduling algorithms ... Locate more Machines Locate Machines Establish Rates Re-distribute Jobs Meet requirements ? Deadlines and Budget Distribute Jobs

  14. Search parameter space rather than exploring all options Nimrod/O P-BFGS Job Control Super computer Cluster Simplex Function Requests Nim Cache Function Requests Nimrod or Clustor Jobs Declarative Plan File Divide & Conquer Simulated Annealing Function Values Function Values Results NimCache Nimrod/G Nimrod/O: Automatic Design Optimization Active Sheets - Excell cell func()s execution on the Grid

  15. AppLeS (UC. San Diego) application level scheduling templates case-by-case for different Apps, soon PST. NetSolve (UTK/ORNL) -- API for creating farms SETI @ Home, Distributed.net, …. Millennium (UC. Berkeley) remote execution environment on clusters and supports computational economy CODINE/GRD (Genias/Gridware) meets deadline by dominating over others share. Mariposa- Distributed Database system (UC, Berkeley) query with budget, creates sub-query & dividesbudget, trades with (remote) servers More Info -- www.csse.monash.edu.au/~davida/nimrod.html Related Work & Further Info.

More Related