1 / 16

Rajkumar Buyya, David Abramson, Jon Giddy

Nimrod/G and Grid Market “ A Case for Economy Grid Architecture for Service Oriented Global Grid Computing”. Rajkumar Buyya, David Abramson, Jon Giddy. Monash University, Melbourne, Australia www.buyya.com/ecogrid. www.gridcomputing.com. 2100. 2100. 2100. 2100. 2100. 2100. 2100. 2100.

sirius
Download Presentation

Rajkumar Buyya, David Abramson, Jon Giddy

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Nimrod/G and Grid Market“A Case for Economy Grid Architecture for Service Oriented Global Grid Computing” Rajkumar Buyya, David Abramson, Jon Giddy Monash University, Melbourne, Australia www.buyya.com/ecogrid www.gridcomputing.com

  2. 2100 2100 2100 2100 2100 2100 2100 2100 2100 Scalable HPC: Breaking Administrative Barriers ? PERFORMANCE Administrative Barriers • Individual • Group • Department • Campus • State • National • Globe • Inter Planet • Universe Desktop SMPs or SuperComputers Global Cluster/Grid Inter Planet Cluster/Grid ?? Local Cluster Enterprise Cluster/Grid

  3. Why Grids ? Large Scale Exploration needs them—Killer Applications. • Solving grand challenge applications using computer modeling, simulation and analysis Aerospace Internet & Ecommerce Life Sciences Digital Biology CAD/CAM Military Applications Military Applications Military Applications

  4. Players in Grid Computing

  5. What users want ?Users in Grid Economy & Strategy • Grid Consumers • Execute jobs for solving varying problem size and complexity • Benefit by selecting and aggregating resources wisely • Tradeoff timeframe and cost • Strategy: minimise expenses • Grid Providers • Contribute “idle” resource for executing consumer jobs • Benefit by maximizing resource utilisation • Tradeoff local requirements & market opportunity • Strategy: maximise returns on services

  6. Legion NetSolve mix-and-match Object-oriented Internet-WWW Grid Computing Approaches Web-based Technologies Problem Solving Approach Market/Computational Economy Nimrod-G/CPM

  7. Grid Architecture for Computational Economy Information Server(s) Grid Market Services Sign-on Health Monitor Info ? Grid Node N … Grid Explorer … Application Secure Job Control Agent Grid Node1 Schedule Advisor QoS Pricing Algorithms Trade Server Trading Trade Manager Accounting Resource Reservation Misc. services … Deployment Agent JobExec Resource Allocation Storage Grid User Grid Resource Broker … R1 R2 Rm Grid Middleware Services Grid Service Providers

  8. Economy Grid = Globus + GRACE Applications Grid Apps. … Science Engineering Commerce Portals ActiveSheet High-level Services and Tools GlobusView Grid Status Grid Tools Nimrod/G DUROC MPI-G MPI-IO CC++ globusrun Core Services Heartbeat Monitor Nexus GRACE-TS Grid Middleware GRAM Globus Security Interface GASS DUROC MDS GBank GARA GMD Grid Fabric Local Services GRD QBank JVM Condor TCP UDP eCash LSF PBS Linux Irix Solaris

  9. Nimrod/G : A Grid Resource Broker • A resource broker for managing and steering task farming (parametric sweep) applications on computational Grids based on deadline and computational economy. • Key Features • A single window to manage & control experiment • Resource Discovery • Trade for Resources • Resource Composition & Scheduling • Steering & data management • It allows to study the behaviour of some of the output variables against a range of different input scenarios.

  10. A Glance at Nimrod-G Broker Nimrod/G Client Nimrod/G Client Nimrod/G Client Nimrod/G Engine Schedule Advisor Trading Manager Grid Store Grid Dispatcher Grid Explorer Grid Middleware Globus,Legion, Condor-g,, Ninf,etc. TM TS GE GIS Grid Information Server(s) RM & TS RM & TS RM & TS G C L G Legion enabled node. Globus enabled node. L C RM: Local Resource Manager, TS: Trade Server Condor enabled node.

  11. Cost A Nimrod/G Client Deadline Legion hosts Globus Hosts Bezek is in both Globus and Legion Domains

  12. Adaptive Scheduling algorithms Discover More Resources Discover Resources Establish Rates Compose & Schedule Evaluate & Reschedule Meet requirements ? Remaining Jobs, Deadline, & Budget ? Distribute Jobs

  13. Inter-Continental Grid Australia North America ANL: SGI/Sun/SP2 USC-ISI: SGI UVa: Linux Cluster Monash Uni.: Nimrod/G Linux cluster Globus+Legion +Condor/G Globus/Legion GRACE_TS Solaris WS Internet Europe ZIB/FUB: T3E/Mosix Cardiff: Sun E6500 Paderborn: HPCLine Lecce: Compaq SC CNR: Cluster Calabria: Cluster CERN: Cluster Pozman: SGI/SP2 Asia/Japan Tokyo I-Tech.: ETL, Tuskuba Linux cluster Globus + GRACE_TS Globus + GRACE_TS

  14. Experimentation on the Grid • Workload: • 165 jobs, each need 5 minute of cpu time • Deadline: 1 hrs. and budget: 800,000 units • Strategy: minimise cost and meet deadline • Execution Cost with cost optimisation • AU Peaktime:471205 (G$) • AU Offpeak time: 427155 (G$)

  15. Execution @ AU Peak Time

  16. Execution @ AU Offpeak Time

More Related