100 likes | 181 Views
A Grid Scheduler based on Clustering Technique Israel Hernandez May 20 th , 2004. Institute for Computing Systems Architecture School of Informatics , University of Edinburgh. A Grid Scheduler based on Clustering Technique. Motivation.
E N D
A Grid Scheduler based on Clustering TechniqueIsrael HernandezMay 20th, 2004 Institute for Computing Systems ArchitectureSchool of Informatics, University of Edinburgh A Grid Scheduler based on Clustering Technique
Motivation • A Grid computational environment is suitable for parallel applications. In spite of such suitability few users currently execute their parallel applications on Grid. • Mainly reason is that Grid environment has two distinct characteristics: heterogeneous and dynamic. • The Grid Scheduling problem is classified as NP-complete problem and optimal algorithms in polynomial time are known for restricted cases. • We investigate scheduling techniques which respond to dynamic resources availability. A Grid Scheduler based on Clustering Technique
A Grid Scheduler based on Clustering Technique The objective of Grid Scheduler is to minimize the completion time of a parallel application by properly allocating the tasks onto processors. A Grid Scheduler based on Clustering Technique
The Directed Acyclic Graph (DAG)model w(n1) • Each node represent a task, and the weight of node ni, w(ni) is call the computation cost, usually the execution time of the task. n1 e(n1,n2) e(n1,n4) e(n1,n3) • The edges represents a message transferred from node i to node j. The weight of • an edge is called the communication cost of the edge and is denoted by e(ni,nj). w(n2) n2 w(n4) w(n3) n3 n4 e(n4,n6) e(n2,n5) w(n5) n6 w(n6) n5 e(n5,n7) e(n6,n7) n7 w(n7) A Grid Scheduler based on Clustering Technique
The Directed Acyclic Graph (DAG) model Heterogeneous Homogeneous w(n1,r1), w(n1,r2), … ,w(n1,rn) w(n1) n1 n1 e((n1, r1,),(n2,r1)), .. , e((n1, r1),(n2,rn)), e((n1, r2,),(n2,r1)), .. , e((n1, r2),(n2,rn)), ………….. e((n1, rn,),(n2,r1)), .. , e((n1, rn,),(n2,rn)) e(n1, n2) n2 n2 w(n2,r1), w(n2,r2), … ,w(n2,rn) w(n2) A Grid Scheduler based on Clustering Technique
The Clustering Technique w(n1) 1.- Clustering At the beginning of the scheduling process each node in the DAG is considered a cluster. In the subsequent steps, two nodes are merged into a cluster if the merging reduces the completion time. The process of merging continues until no further improvements are possible. n1 e(n1,n2) e(n1,n4) e(n1,n3) n2 w(n4) w(n3) n3 n4 w(n5) n6 w(n6) n5 2.- Allocation. The next step is to allocate the clusters onto processors. e(n5,n7) e(n6,n7) n7 w(n7) A Grid Scheduler based on Clustering Technique
The Clustering Technique w(n1) 1.- Clustering At the beginning of the scheduling process each node in the DAG is considered a cluster. In the subsequent steps, two nodes are merged into a cluster if the merging reduces the completion time. The process of merging continues until no further improvements are possible. n1 e(n1,n2) e(n1,n4) e(n1,n3) n2 w(n4) w(n3) n3 n4 w(n5) n6 w(n6) n5 2.- Allocation. The next step is to allocate the clusters onto processors. e(n5,n7) e(n6,n7) n7 w(n7) A Grid Scheduler based on Clustering Technique
The Clustering Technique w(n1) 1.- Clustering At the beginning of the scheduling process each node in the DAG is considered a cluster. In the subsequent steps, two nodes are merged into a cluster if the merging reduces the completion time. The process of merging continues until no further improvements are possible. n1 e(n1,n2) e(n1,n4) e(n1,n3) n2 w(n4) w(n3) n3 n4 w(n5) n6 w(n6) n5 2.- Allocation. The next step is to allocate the clusters onto processors. e(n5,n7) e(n6,n7) n7 w(n7) A Grid Scheduler based on Clustering Technique
Grid Resource Discovery Application Problem DAG Cluster Creation Algorithm Cluster Allocation Algorithm A Grid Scheduler based on Clustering Technique Resource Mapping Function DAG information Clusters Allocation of Clusters onto processors Grid Processors status Heterogeneous Computational Resources Processes A Grid Scheduler based on Clustering Technique
Institute for Computing Systems ArchitectureSchool of Informatics, University of Edinburgh T H A N K S A Grid Scheduler based on Clustering Technique