140 likes | 152 Views
Learn about clusters, their components, types, and software used in cluster computing for high performance computing, internet services, and miscellaneous applications.
E N D
What is Cluster? 2001.9.15 Donghyun Kim ryan@clunix.com 2001 Snags Seminar
What the hell is the cluster? • Cluster • (꽃, 열매, 털 등의) 송이 • (사람, 동물, 건물 등의) 무리, 집단 • 훈장 리본에 다는 작은 금속 배지 • NOW (of U.C Berkeley) • Network Of Workstations 2001 Snags Seminar
Damn Fast Machine • Parallel Processing for 1/n time !!! • MMP(Massively Multi Processors) • SMP(Symmetric Multi Processors) • ccNUMA(cache coherent non-uniform memory access) • Massage passing programming • Shared memory programming 2001 Snags Seminar
Cluster 구성 요소 • Node (Computer) • Processing Unit • Network • Interconnecting the computer • Cluster oriented SW • Administration • Single System Image View • Compiler for parallel processing 2001 Snags Seminar
Cluster의 종류 • For High Performance Computing(HPC) • Fast computing of the very LARGE data • Grand challenge problems • 해수 모델링, 대기 모델링, 유전자 분석… • Beowulf • For Internet Service • Load/traffic balancing • Linux Virtual Server • High Availability (HA) 2001 Snags Seminar
Nodes • SIMD • Single instruction & multiple data • Vector CPU, MMX instructions • MIMD • Multiple instruction & multiple data • SMP 2001 Snags Seminar
Network • Communication cost • Not 1/n time takes • Ethernet switch • SCI (Scalable Coherent Interface) • Myrinet 2001 Snags Seminar
Cluster oriented software - HPC • MPI (Message Passing Interface) • For message passing programming • PVM (Parallel Virtual Machine) • For shared memory programming • Portland Group Compilers • Thread support library • Parallel debugger 2001 Snags Seminar
Cluster oriented software – Internet Services • Linux Virtual Server (LVS) • Software(kernel-level) L4 switch • High Availability (HA) • GFS (Global File Systems) • In Clunix • dua (distributed user archiver) • dush (distributed user shell) 2001 Snags Seminar
Cluster oriented software – Misc • CMS (Cluster Management SW) • MOSIX • 동적 로드밸런싱, 선점형 프로세스 이주 • Condor • AKA seti • Locust • TreadMarks DSM 2001 Snags Seminar
Introduction to LVS • Virtual Server • Layer 4 load balancing • Goal • 리눅스 기반의 클러스터링을 통하여 고성능과 고가용성의 서버를 구성하여 높은 확장성, 신뢰성, 서비스를 제공 2001 Snags Seminar
LVS packet forwarding • NAT 방식 • Local address – Public address • In, out pkt모두 director에서 addr translate • bottleneck • IP tunneling 방식 • IP tunnel interface w/ public IP alias • Do not response ARP • Real server에서 직접 packet reply가능 • May bottleneck 2001 Snags Seminar
LVS packet forwarding – cont’d • Direct Routing 방식 • Only use in local network • Forward with MAC addr • Do not response ARP • Public IP alias • Less bottleneck 2001 Snags Seminar
LVS scheduling • Round-Robin(RR) • Weighted RR • Least-connection • Weighted least-connection 2001 Snags Seminar