1 / 61

HP Partitioning Continuum

Learn about HP's partitioning continuum technology, which isolates operational environments in single or multiple servers for flexible resizing and protection from disruptions. Explore nPars, vPars, resource partitions, and HP-UX WLM for dynamic capabilities.

bettythompson
Download Presentation

HP Partitioning Continuum

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. h p HP Partitioning Continuum Hewlett Packard Enterprise System Group / CSPS Technical Consultant byoung-ki.min@hp.com

  2. 목 차 I.HP Partition Technology Overview II. Resource Partitioning 전략 - 경쟁사 비교 - Case Study - Partition 전략 - Definition - Partition Continuum - nPar, vPar, rPar - wlm III. Miscellaneous (vPar/PRM/wlm) HP presentation template user tutorial

  3. 1. HP Partition Technology Overview Partitioning 의 정의 단일 또는 여러 대의 서버 환경에서 물리적 또는 논리적으로 isolating operational 환경을 제공하는 기술로서 유연한 동적 재구성이 가능하고 예상치 못한 Error 에 대한 보호기능을 기대 할 수 있는 서버 Consolidation 의 기초가 되는 기술 Partitions are physical or logical mechanisms for isolating operational environments within single or multiple servers to offer the flexibility of dynamic resizing while ensuring that applications can enjoy protection from unrelated events that could otherwise cause disruption, interruption, or performance degradation. HP presentation template user tutorial

  4. 완벽한 물리적/ • 논리적 분리 • node 단위 • multiple OS 이미지 • 완벽한 물리적 분리 • Cell 단위 • multiple OS 이미지 • 완벽한 • 논리적 분리 • CPU 단위 • dynamic CPU migration • multiple OS 이미지 • 동적 자원 할당 • FSS - share (%) granularity • PSETs – 1CPU 단위 • 1 OS 이미지 1. HP Partition Technology Overview HP’s Partitioning Continuum 단일 OS Image 에서의 resource partitions hard partition 에서의 virtual partitions 여러 대 시스템에서의 hard partitions 단일 시스템에서의 hard partitions multi-server solutions HP hyperplex application clusters nPartitions virtualpartitions resourcepartitions HP-UX Partition Manager- complex-wide HW views, vPar & nPar configuration Cleansweep - OS configuration HP-UX PRM- resource partition config HP-UX WLM (workload manager) - automatic goal-based resource allocation via set SLOs isolation highest degree of separation flexibility highest degree of dynamic capabilities HP presentation template user tutorial

  5. 1. HP Partition Technology Overview Partition 기술의 선택 • nPars • vPars • PSET Resource Partitions • Fair Share Scheduler Resource Partitions HP presentation template user tutorial

  6. 1. HP Partition Technology Overview nPars • nPar 의 장점 • Hardware Fault Isolation • 한 파티션의 운영중에 다른 파티션의 Upgrade 등 유지 보수가 가능하다. • iCOD 와 결합하여 동적 재구성이 가능하다. HP presentation template user tutorial

  7. 1. HP Partition Technology Overview vPars • vPar 의 장점 • 파티션의 재부팅 없이 Dynamic processor 이동이 가능하다. • Single cpu granularity • nPar 내에 vPar 운영이 가능하다. • Software fault isolation • 다른 OS 버젼을 설치 할 수 있다. • Application isolation 을 보장한다. HP presentation template user tutorial

  8. 1. HP Partition Technology Overview Resource Partitions • Resource Partition 의 장점 • I/O 공유를 통해 hardware 자원 사용을 줄일 수 있다. • 구성이 쉽다. • 저렴한 TCO : 단일 instance • nPar 와(또는) vPar 와 결합해서 사용할 수 있다. • PSETs 방식 • Processor isolation – 어플리케이션을 processor 단위로 할당 가능 하다. • Memory isolation on top of PSETs • FSS provides: • 좀더 세분화된 CPU allocation • More partitions HP presentation template user tutorial

  9. 1. HP Partition Technology Overview WLM • WLM 은 파티션 자체적인 기술이 아니라, 서비스 레벨 수준을 만족하도록 파티션간에자동적으로 CPU 를 할당을 제공한다. • WLM 장점 • Automatic CPU resource allocation to meet SLOs • Truly maximizes CPU utilization • Automatic response to ServiceGuard failovers • iCOD integration • Minimizes utility(PPU) computing costs through automatic allocation/de-allocation of utility CPUs HP presentation template user tutorial

  10. 목 차 I. HP Partition Technology Overview II.Resource Partitioning 전략 - 경쟁사 비교 - Case Study - Partition 전략 - Definition - Partition Continuum - nPar, vPar, rPar - wlm III. Miscellaneous (vPar/PRM/wlm) HP presentation template user tutorial

  11. 2. Resource Partitioning 전략 Partition 기술 경쟁사 비교 HP 는 완벽한 Hard 파티션 및 Logical 파티션을 제공하는 유일한 벤더입니다. 100% Goal-based workload management Virtual partitions (LPAR) Virtual partition ( vPar) utilization Hardware partitions (nPar) Hardware partitions Resource management Resource management Resource management 0% hp Sun IBM HP presentation template user tutorial

  12. 2. Resource Partitioning 전략 Single System High Availability • DPD or DPR : Dynamic Processor De-allocation or Dynamic Processor Resilience • Dynamic Processor De-allocation은 시스템 운영 중, 어플리케이션의 중단 없이 Processor를de-allocation하는 기술입니다. 이를 위해서 해당 Processor에서 스케줄 되어 있던 모든 어플리케이션 프로세스는 다른 정상적인 Processor로 이동하게 됩니다. • 이와 같은 DPD 기능은 프로세서 내부의 On-chip Cache 상의 수정 가능한 에러의 발생 비율을 모니터링 하는 EMS(Event Monitoring Service) 및 LPMC(Low Priority Machine Checks)에 의해서 더욱 철저히 수행됩니다.On-chip Cache 상에서는 때때로 수정 가능한 에러가 발생하기도 하는데, 이와 같은 에러의 발생 비율이 짧은 시간 내에 높아지게 되면 수정 불가능한 Cache 에러로 확대될 수 있습니다. 따라서 EMS LPMC 모니터는 발생하는 에러의 비율을 지속적으로 감시하고 필요한 경우 심각한 장애로의 확산을 방지하기 위하여 Processor를 자동으로 de-allocation 합니다. • ECC : Error Checking and Correction - 메인 메모리에 대한 비트 에러 감지 및 자동 수정 - CPU 내부 Cache Memory(On-chip Cache)에 대한 비트 에러 감지 및 자동 수정 • DMR : Dynamic Memory Resilience • Dynamic Memory Resilience는 에러가 발생한 메모리 페이지를 온라인 상에서 de-allocation 하는 기능입니다. HP presentation template user tutorial

  13. 2. Resource Partitioning 전략 Wachovia Bank Leading 10 Bank Holding Companies by Number of Branches in the US: 2002 for Bank of America Corp., Wells Fargo and Co., Wachovia Corp., J.P. Morgan Chase & Co., Citigroup Inc “HP-UX Workload Manager helped us to maximize system utilization and reduce our capacity management costs in our consolidated Oracle Hotel environment. In addition, the integration of HP-UX Workload Manager with MC/ServiceGuard helped us to prioritize production database instances on failover." Tommy Simmons UNIX Team Leader Wachovia Bank HP presentation template user tutorial

  14. WebLogic 2 WebLogic 1 queue = 0 queue = 0 free threads = 10 free threads = 10 2. Resource Partitioning 전략 WLM Optimization of Resources Superdome partition default PSET workload PSET 1 workload PSET 2 0 1 2 6 7 3 4 5 other workloads and spare capacity WLM WebLogic toolkit WLM WebLogic toolkit Workload Manager HP presentation template user tutorial

  15. WebLogic 2 WebLogic 1 queue = 31 queue = 77 free threads = 0 free threads = 0 2. Resource Partitioning 전략 Load is added to each WebLogic Superdome partition default PSET workload PSET 1 workload PSET 2 0 1 2 6 7 3 4 5 other workloads and spare capacity WLM WebLogic toolkit WLM WebLogic toolkit Workload Manager HP presentation template user tutorial

  16. WebLogic 2 WebLogic 1 queue = 37 queue = 0 free threads = 4 free threads = 0 2. Resource Partitioning 전략 WLM allocates additional CPUs Superdome partition default PSET workload PSET 1 workload PSET 2 0 1 2 6 7 5 4 3 other workloads and spare capacity WLM WebLogic toolkit WLM WebLogic toolkit Workload Manager HP presentation template user tutorial

  17. WebLogic 2 WebLogic 1 queue = 0 queue = 0 free threads = 2 free threads = 2 2. Resource Partitioning 전략 More is still needed for WebLogic 1 Superdome partition default PSET workload PSET 1 workload PSET 2 3 0 1 2 6 7 5 4 other workloads and spare capacity WLM WebLogic toolkit WLM WebLogic toolkit Workload Manager HP presentation template user tutorial

  18. WebLogic 2 WebLogic 1 queue = 0 queue = 0 free threads = 2 free threads = 11 2. Resource Partitioning 전략 Load decreases on WebLogic 2 Superdome partition default PSET workload PSET 1 workload PSET 2 3 0 1 2 6 7 5 4 other workloads and spare capacity WLM WebLogic toolkit WLM WebLogic toolkit Workload Manager HP presentation template user tutorial

  19. WebLogic 2 WebLogic 1 queue = 0 queue = 0 free threads = 4 free threads = 3 2. Resource Partitioning 전략 WLM moves a CPU back to the “free” poolUsed for other workloads Superdome partition default PSET workload PSET 1 workload PSET 2 3 0 1 2 6 7 5 4 other workloads and spare capacity WLM WebLogic toolkit WLM WebLogic toolkit Workload Manager HP presentation template user tutorial

  20. 2. Resource Partitioning 전략 K은행 Benchmark Test Workload Management Test System Configuration HP presentation template user tutorial

  21. 2. Resource Partitioning 전략 K은행 Benchmark Test Logical Architecture Partition 1 WebLogic iPlanet EJB Container Servlet Container SB Servlet EB JSP Data Storing Storage DB Server Load Generator DBMS Partition 2 JEUS WebtoB EJB Container Servlet Container SB Servlet EB JSP HP presentation template user tutorial

  22. 2. Resource Partitioning 전략 K은행 Benchmark Test Test 시나리오 & 결과 (1/4) 1) Each partition has 4 CPUs Allocate system CPU for processes using pset CPU1  System Process CPU2  Web Server CPU3, CPU4  Web Application Server vpartion1 vpartion2 HP presentation template user tutorial

  23. 2. Resource Partitioning 전략 K은행 Benchmark Test Test 시나리오 & 결과 (2/4) 2) Deallocate CPU4 from JEUS in partition2 vpartion1 vpartion2 HP presentation template user tutorial

  24. 2. Resource Partitioning 전략 K은행 Benchmark Test Test 시나리오 & 결과 (3/4) 3) Add CPU4 of partition 2 to parttion1 vpartion1 vpartion2 HP presentation template user tutorial

  25. 2. Resource Partitioning 전략 K은행 Benchmark Test Test 시나리오 & 결과 (4/4) 4) Allocate CPU4 from partition2 to iplanet vpartion1 vpartion2 HP presentation template user tutorial

  26. 2. Resource Partitioning 전략 K은행 Benchmark Test HP presentation template user tutorial

  27. 2. Resource Partitioning 전략 Consolidation 을 위한 Partitioning 전략 1. Mission Critical 업무의 경우 : 최고의 고가용성과 안정성을 요구하는 업무의 경우 Electronic Isolation 을 보장하는 nPartition 기능과 MC Service Guard 에 의한 HA Solution 을 적용한다. nPartition #1 nPartition #1 HA clustering nPartition #2 nPartition #2 HP presentation template user tutorial

  28. 2. Resource Partitioning 전략 Consolidation 을 위한 Partitioning 전략 2. Mission Critical 업무이면서 Dynamic Resource Plan 이 필요한 경우 : 최고의 고가용성과 안정성을 요구하면서 Resource 의 Resizing 이 필요한 경우 Electronic Isolation 을 보장하는 nPartition 기능과 wlm 에 의해 즉각적인 active / deactive 가 가능한 iCOD 를 활용하여 구성한다. ( 방안 I ) nPar 1-1 nPar 2-1 w l m w l m HA clustering iCOD iCOD cpu cpu nPar 1-2 nPar 2-2 iCOD iCOD HP presentation template user tutorial

  29. 2. Resource Partitioning 전략 Consolidation 을 위한 Partitioning 전략 2. Mission Critical 업무이면서 Dynamic Resource Plan 이 필요한 경우 : 최고의 고가용성과 안정성을 요구하면서 Resource 의 Resizing 이 필요한 경우 OS Isolation 을 보장하는 vPartition 기능과 PRM/wlm 에 의해 dynamic resource 할당을 가능하도록 구성한다. ( 방안 II ) w l m w l m vPar 1-1 vPar 2-1 HA clustering cpu cpu vPar 1-2 vPar 2-2 HP presentation template user tutorial

  30. 2. Resource Partitioning 전략 Consolidation 을 위한 Partitioning 전략 3. Important 업무의 경우 : 고가용성과 안정성을 요구하는 업무의 경우 Electronic Isolation 을 보장하는 nPartition 기능과 또는 OS Isolation 을 보장하는 vPartition 기능을 사용하여 구성한다. nPar 1 vPar 1 or nPar 2 vPar 2 HP presentation template user tutorial

  31. 2. Resource Partitioning 전략 Consolidation 을 위한 Partitioning 전략 4. Important 업무이면서 Dynamic Resource Plan 이 필요한 경우 : 고가용성과 안정성을 요구하는 업무의 경우 OS Isolation 을 보장하는 vPartition 기능과 PRM/wlm 을 사용하여 구성한다. w l m vPar 1 cpu vPar 2 HP presentation template user tutorial

  32. 2. Resource Partitioning 전략 Consolidation 을 위한 Partitioning 전략 5. 일반업무이면서 Dynamic Resource Plan 이 필요한 경우 : 일반 업무의 경우 OS Isolation 을 보장하는 vPartition 기능과 PRM/wlm 을 사용하여 구성하거나 하나의 OS로 구성된 nPar 또는 vPar 에서 Application 을 통합하여 PRM/wlm 을 활용하여 resource 를 할당하도록 구성한다. w l m w l m vPar 1 Appl 1 cpu cpu or vPar 2 Appl 2 HP presentation template user tutorial

  33. 2. Resource Partitioning 전략 Consolidation 을 위한 Partitioning 전략 • Quardrant Matrix for Consolidation Using Partition dynamic Resource Static Resource Misson Critical (HA) I. nPar & iCOD II. vPar & PRM/wlm I. nPar I. vPar & PRM/wlm II. PRM/wlm I. nPar II. vPar Non Mission Critical HP presentation template user tutorial

  34. 2. Resource Partitioning 전략 Consolidation 을 위한 Partitioning 전략 • K-Class Consolidation Example 1. 서버 세대 분류 G0 : PA8700+ 875MHz 이상의 서버 세대 G1 : PA8700 650~750MHz 의 서버 세대 G2 : PA8600 540~550MHz 의 서버 세대 G3 : PA8500 540MHz 이하의 서버 세대 K-Class 2. K-Class tpmC (Sybase 기준) HP presentation template user tutorial

  35. 2. Resource Partitioning 전략 Consolidation 을 위한 Partitioning 전략 3. Superdome (PA8700+ 875MHz CPU) tpmC (Oracle 기준) 4. K580 4CPU(21,000 tpmC) 를 기준으로 Superdome 32Way 에 2CPU(22,500tpmC) 의 vPar 로 Consolidation 했을 경우 (vPar 는 최소 2CPU 이상을 권장함) vP2 vP3 vP4 vP5 vP6 vP7 vP8 vP1 vP1 vP2 vP3 vP4 vP5 vP6 vP7 vP8 Superdome 32Way 16개의 vPar 로 구성 가능 vP9 vP10 vP11 vP12 vP13 vP14 vP15 vP16 vP9 vP10 vP11 vP12 vP13 vP14 vP15 vP16 HP presentation template user tutorial

  36. 2. Resource Partitioning 전략 요약 -Resource management of your adaptive infrastructure nPar 1 nPar 2 • 2 nPars 는 • hardware fault isolation • 를 제공한다. • 2 vPars 는 다음을 제공한다. • software fault isolation • OS version isolation • WLM1은 resource partition 간에 • cpu 를 동적으로 할당한다. • WLM2는 vPar 간에 cpu 를 • 동적으로 할당한다. • Failover across nPar boundary (indicated by ) provides • HA for both hardware and software faults • WLM will reallocate resources upon failover vPar 1.1 vPar 2.1 resource partition 1.1.1 resource partition 2.1.1 resource partition 1.1.2 resource partition 2.1.2 WLM1 resource partition 1.1.n resource partition 2.1.n WLM2 vPar 1.2 vPar 2.2 resource partition 1.2.1 resource partition 2.2.1 resource partition 1.2.2 resource partition 2.2.2 resource partition 1.2.n resource partition 2.2.n HP presentation template user tutorial

  37. 3. Miscellaneous 단일 Cell 로 구성된 nPar 에서의 vPar 예 파란색 vPar : 2 CPUs, 8 Gbyte memory, 6 PCI slots. 붉은색 vPar : 1 CPU, 4 GByte memory, 3 PCI slots. 노란색 vPar : 1 CPU, 4 GByte memory, 3 PCI slots. P0 Cell Controller P1 I/O Controller P2 unbound CPUs 는 vPar 의 재부팅 없이 dynamic 이동이 가능함 Example: CPU P1 (an unbound CPU ) can move from blue to red partition when the red partition needs more processing power. P3 Mem 0-8 Gbyte Slot 10 Slot 11 Slot 0 Slot 1 Slot 2 Slot 6 Slot 7 Slot 8 Slot 9 Slot 3 Slot 4 Slot 5 Mem 8-12 Gbyte Mem 12-16Gbyte HP presentation template user tutorial

  38. Dept. BApp 1 Dept. BApp 1 Dynamic adjustment of resources by migration of CPUs between vpars when required HP-UX Rev Y HP-UX Rev Y Dept. BApp 2 Dept. BApp 1 Dept. BApp 1 Dept. BApp 2 HP-UX Rev Y HP-UX Rev Z HP-UX Rev Z HP-UX Rev Y Business need defines the relative priority and response time for the various applications Dept. BApp 1 Dept. BApp 2 Dept. BApp 2 HP-UX Rev Y HP-UX Rev Z HP-UX Rev Z 응답시간 등 vPar 로 부터 Dynamic feedback 분석 Dept. AApp 1 Dept.AApp 1 Dept. AApp 1 Dept. AApp 1 Dept. AApp 1 Dept. AApp 1 HP-UX Rev X HP-UX Rev X HP-UX Rev X HP-UX Rev X HP-UX Rev X HP-UX Rev X 3. Miscellaneous vPars 와 Workload ManagerAutomatic goal-based CPU allocation between vPars WLM WLM Rules Sets HP presentation template user tutorial

  39. 3. Miscellaneous Resource Partitioning 특징 • Supports hierarchical partitions • Resource controls: • CPU Controls • CPU allocation by percentage, shares, or whole processors • Optional capping in FSS partitions • Concurrent FSS and PSETs • Real memory controls • Each partition gets a separate memory manager in 11i • Disk bandwidth • Both LVM and Veritas VxVM Volume Groups • Automatic process assignment to partition • Users/Groups • Executable path/Process name • Children automatically run with parent by default HP presentation template user tutorial

  40. 3. Miscellaneous FSS CPU 방식 - 회전 목마 Algorithm • Shares become slots in a carousel • Each slot is 10 ms. • Processes in group get first shot at CPU during their tick • If capping is off carousel turns if no processes need CPU • Example: • Group A has 8 shares or 50% • Group B has 4 shares or 25% • Group C has 4 shares or 25% HP presentation template user tutorial

  41. CPU capping off If a group does not need the CPU, the scheduler checks the next group for work CPU shares CPU percentage 1 12.50% 2 25.00% CPU capping on The group with control of the CPU retains control, regardless of need, until the clock tick ends 4 50.00% 1 12.50% Group with control of CPU 3. Miscellaneous FSS CPU 방식 - 회전 목마 Algorithm HP presentation template user tutorial

  42. PSETs 방식 FSS in default PSET PRM group Oracle_Sales #2 #3 #0 #1 #6 #7 #4 #5 • PRM group PRM_SYS • PRM group Dev • PRM group Appl • PRM group OTHERS #8 #9 #10 #11 #14 #15 #12 #13 PRM group Oracle_Financials HP presentation template user tutorial

  43. 3. Miscellaneous PSET 방식에 의한 Resource Partition • PSET is a PRM group type • CPU is allocated on whole CPU boundaries • A configuration can contain both FSS and PSET groups • The FSS groups run in the default PSET • Standard Unix scheduler allocates CPU within a PSET • Separate process schedulers for each partition, as with FSS groups as well • PRM uses PSET system calls to manipulate PSETs • Configuration using configuration file or xprm HP presentation template user tutorial

  44. HP-UX Operating System Instance Memory Resources Partition 0 Partition 1 Partition 2 Memory Manager Memory Manager Memory Manager Application A Application B Application C Process Scheduler Process Scheduler Process Scheduler Partition 0 Partition 1 Partition 2 CPU Resources 3. Miscellaneous Resource Partitions 하나의 OS 상에서 어플리케이션이 동작 하지만, 어플리케이션은 각각의 구분된 process schedulers 와 memory managers 를 갖게 된다. HP presentation template user tutorial

  45. 3. Miscellaneous PRM 과 Oracle Database Resource Manager PRM 은 Oracle 9i DB Resource Manager 와 연동 가능하다. PRM 에 의해서 Pset 과 memory 가 Oracle instance 에 할당되어진다. Oracle Database Resource Manager controls resources within the instance Result: HP9000 is the ideal Oracle consolidation platform PRM slices system PSET 2 Ora 2 PSET 0 Other PSET 1 Ora 1 Mem 1 Mem 2 Mem 3 CPU CPU CPU CPU CPU CPU CPU CPU ODBRM manages instance ODBRM manages instance WLM Manages pset HP 9000 Server Processor set defined by PRM Memory allocated by PRM HP presentation template user tutorial

  46. 3. Miscellaneous Drag and Drop 방식의 PSETs Configuration HP presentation template user tutorial

  47. 3. Miscellaneous Allocating Memory to Resource Partitions creates isolated environment of both cpus and memory HP presentation template user tutorial

  48. IT Services Management Service- Level Agreement Service- Level Objective Metrics What is Workload Management? • System management • Availability of system • Workload management • Availability of applications—at a specified level of performance HP presentation template user tutorial

  49. What is hp-ux WLM? • WLM provides automatic resource allocation and application performance management through the use of prioritized SLOs. WLM consists of: • wlmd daemon for managing system resources • wlmpard daemon (WLM global arbiter) which governs cross-partition management • Glance, Oracle, SAS, Apache/Java, WebLogic, SNMP data collectors • Library API for reporting performance to WLM • User-written data collectors that report to WLM • EMS monitor that provides info to EMS clients • Example configuration files HP presentation template user tutorial

  50. 3. Miscellaneous WLM Service Level Objectives SLO’s use goals, constraints, and conditions. • An SLO consists of: • A workload (partition) • Constraints (min, max cpu) • A goal • Priority • Conditions (time of day, event, etc) Group A Min CPU: 20% Max CPU: 50% Group A receives 3 shares for each additional user. Policy applies 9am to 5pm AND when ServiceGuard Package XYZ HP presentation template user tutorial

More Related