150 likes | 301 Views
Cluster scheduling. Presented by: Priti Lohani. What is cluster?. It is a group of loosely coupled computers. They are arranged in a way to improvise in a speed and reliability provided by a single computer. It allows the organizations to boost their processing power.
E N D
Cluster scheduling Presented by: Priti Lohani
What is cluster? • It is a group of loosely coupled computers. • They are arranged in a way to improvise in a speed and reliability provided by a single computer. • It allows the organizations to boost their processing power. • It provides expandability.
Classification of clusters: • High -availability clusters • Load-balancing clusters • High-Performance clusters • Grid clusters
Clustering algorithm requirements: • scalability • Broad scope • Sensitivity to compute node and interconnect architecture • Fair share capability • Capability to integrate with standard resource managers • Fault tolerance
Resource management system • It manages the processing of load by preventing jobs from competing with each other for limited compute resources • Resource managers do basic node state monitoring, receive job submission requests and executes the requests on the computer node. • The scheduler communicates with the resource manager to obtain information about queues, loads on compute nodes, and resource availability to make scheduling decisions.
Cluster scheduling algorithms: There are two types of schedulers: • Time sharing • Space sharing Time sharing: • Local scheduling • Gang scheduling • Communication driven co-scheduling Space sharing: • Batch scheduling
Batch scheduling: • FCFS (First come first serve) • SJF (Shortest job first) • LJF (Longest job first) • Advance reservation • Backfilling • Preemptive backfilling
Classifications of clustering algorithms: Exclusive Clustering Overlapping Clustering Hierarchical Clustering Probabilistic Clustering
Maui cluster scheduler: • It is an open source advanced job scheduler. • It focuses on large turn around of large parallel jobs • It is a best open source scheduler. • It is capable of optimizing scheduling and node allocation decisions. • It has a 2 phase scheduling algorithm.
Resource managers for Maui: • PBS Version of PBS: • Open PBS • Professional PBS • Torque
Open PBS VS Torque Torque is better than PBS in following areas: Fault tolerance Scheduling interface Scalability Usability
Scheduling policies for Maui • Advance reservation • Backfill • Job prioritization