1 / 87

System Performance Management & Capacity Planning

System Performance Management & Capacity Planning. Dr Bernie Domanski The City University of New York The College of Staten Island. Session 1 (of 2). What’s Going On? What Do We Have To Do? The Capacity Planning Process Surveying the Users Forecast Workload Levels Model New Configurations

miyo
Download Presentation

System Performance Management & Capacity Planning

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. System Performance Management & Capacity Planning Dr Bernie DomanskiThe City University of New YorkThe College of Staten Island

  2. Session 1 (of 2) • What’s Going On? • What Do We Have To Do? • The Capacity Planning Process • Surveying the Users • Forecast Workload Levels • Model New Configurations • Management Reporting • Who Do People Listen To? • Summary of Issues

  3. Tutorial Description • To provide a framework for performance management and capacity planning • To survey the tools and methods in use today

  4. Intended Audiences • Directed to managers & users concerned about performance management and/or capacity planning • Directed to performance analysts desiring a broader framework and perspective

  5. Capacity Planning Is … • Finding when a system will exceed the ability to provide cost-effective service & what to do about it. • An on-going process of upgrading and altering configurations to maintain a cost-effective balance between workload changes and performance constraints. • Gathering a certain amount of performance data about a system, • Developing a model from the data, and • Making predictions about what will happen when the load is increased when you add new equipment, make software changes, etc..

  6. Performance Management Is … • Finding when a system has exceeded its service constraints and requires tuning or re-planning • Applying all the tools and techniques required to get the system within the service constraints

  7. Session 1 (of 2) • What’s Going On? • What Do We Have To Do? • The Capacity Planning Process • Surveying the Users • Forecast Workload Levels • Model New Configurations • Management Reporting • Who Do People Listen To? • Summary of Issues

  8. The Capacity Planning Process Business Requirements Capacity User Expectations Workload

  9. The Capacity Planning Process ADD MEMORY TO EXISTING SYSTEM ($20,000) EXISTING SYSTEM NEW SYSTEM COST ($400,000) RESPONSE TIME WORKLOAD

  10. Workload Characterization Workload Identification by Subsystems & Resources Historical Data What Does The CapacityPlanner Do?

  11. Capacity PlanningStatus Quo • Data Sources – needed to drive: • workload characterization • workload forecasting • performance prediction

  12. Workload Characterization • Use the usual - • CPU, I/O, Mem on both clients and servers • Add locality metrics - • where does the process occur? • where is the data used? • Process & Data Dependencies • which workloads must complete & be synch’ed with other workloads / data

  13. Example of Using Workload Characterization • Server Consolidation

  14. Consolidation Methodology Overview • Determining a viable target configuration for server consolidation consists of four major tasks. • Identification of candidate servers • Application workload characterization • Determination of forecasting parameters • Analyzing target configurations for utilization and service levels

  15. Configuration Sizing

  16. Processing Environment Worksheet • Click Here to VIEW

  17. Session 1 (2) • What’s Going On? • What Do We Have To Do? • The Capacity Planning Process • Surveying the Users • Forecast Workload Levels • Model New Configurations • Management Reporting • Who Do People Listen To? • Summary of Issues

  18. Historical Data Workload Identification by Subsystems & Resources Business / Application Manager Survey the User Community Business Planning Data Service Level Objectives Workload Growth Forecast Data Center

  19. Complexities & Questions • Multiple mission critical workloads • “What machine do I put which workload on?” • How far into the future should I forecast? • Which workloads can I mix?

  20. Session 1 (of 2) • What’s Going On? • What Do We Have To Do? • The Capacity Planning Process • Surveying the Users • Forecast Workload Levels • Model New Configurations • Management Reporting • Who Do People Listen To? • Summary of Issues

  21. Where We Are In The Process NEW SYSTEM COST ($400,000) ADD MEMORY TO EXISTING SYSTEM ($20,000) EXISTING SYSTEM RESPONSE TIME WORKLOAD the 1st critical forecasted point into the future ... we need to evaluate 2 different options

  22. Session 1 (of 2) • What’s Going On? • What Do We Have To Do? • The Capacity Planning Process • Surveying the Users • Forecast Workload Levels • Model New Configurations • Management Reporting • Who Do People Listen To? • Summary of Issues

  23. Simulation MODELING Analytic Historical Data Model Untuned Workload Identification by Subsystems & Resources Service Level Objectives Workload Growth Calibration Equipment Acquisition Plan Model Baseline What - If

  24. Session 1 (of 2) • What’s Going On? • What Do We Have To Do? • The Capacity Planning Process • Surveying the Users • Forecast Workload Levels • Model New Configurations • Management Reporting • Who Do People Listen To? • Summary of Issues

  25. MANAGEMENT REPORTING Equipment Acquisition Plan Management Reports < FUTURE > Tracking Feedback to Applications and Business Managers Management Reports < REALITY vs FUTURE >

  26. Cost / Benefit Analysis • Annual • Costs • Extra/Misc • Costs • Annual • Savings • Net Total Hardware Communications Systems Software Development Application Cap & Perf Tools Operations Staff Overhead

  27. Session 1 (of 2) • What’s Going On? • What Do We Have To Do? • The Capacity Planning Process • Surveying the Users • Forecast Workload Levels • Model New Configurations • Management Reporting • Who Do People Listen To? • Summary of Issues

  28. THE FIVE STAGES OF CAPACITY PLANNING • Vendor CP • Services provided as part of a vendors' marketing efforts • Special Studies • Individuals periodically assigned to conduct capacity studies

  29. THE FIVE STAGES OF CAPACITY PLANNING • Technician • Specialized staff that address CP technical issues • Organizational • Focus transfers from tools to end-user requirements, financial considerations, reporting, and communications

  30. THE FIVE STAGES OF CAPACITY PLANNING • Mature • Corporate executives perceive CP results essential to decision making process

  31. INSTALLATION ACCOUNTING, PERFORMANCE MANAGEMENT, CAPACITY PLANNING • Economic value must be assigned to resources used • Charge for better service levels • Link future resource requirements to future user budget expenditures • Charge for failure to live within installation standards

  32. Why Re-Engineer Capacity Planning? • we need a broader focus with less precision • the changing nature of computing from time-sharing to client-server • client server addresses our weaknesses • we need a new perspective

  33. Session 1 (of 2) • What’s Going On? • What Do We Have To Do? • The Capacity Planning Process • Surveying the Users • Forecast Workload Levels • Model New Configurations • Management Reporting • Who Do People Listen To? • Summary of Issues

  34. Other System Mgt Issues • Disaster Recovery/Backup • workstations are ignored • still need offsite storage • centralized backup is preferred over local • users must keep machines running off-shift?

  35. Other System Mgt Issues • Security • Who gets the burden of protection: client, server, or central control • Change Management • Need single focal point for coordination & tracking • Problem Management • Coordination of monitors

  36. Issues & Complexities • Expensive Management & Control • Labor intensive • Security & Integrity Weakness • Operating Systems (UNIX & NT/XP) have never faced availability & security requirements

  37. Issues & Complexities • Lack of Tools for server sizing • no client/server analysis tools • no performance db’s provided • Complex Bottleneck Analysis • Lack of tools for troubleshooting • Must include network performance • Lack of instrumentation

  38. Summary & What’s Coming • Instrumentation & Data Reduction • Workload Characterization • Modeling Tools

  39. Session 2 (of 2) • Application Modeling Methodology • System Life Cycle Model • A Common Performance Methodology • Load – Service Curves and How To Get Them • Workload Characterization & Clustering • Forecasting Techniques • Benchmarking • Modeling Concepts & Simulation

  40. Application Modeling Methodology • John Pilch’s session: • Capacity Planning in the Development Cycle • Thursday 2:45pm Carson 1 & 2 • Click HERE to View

  41. Session 2 (of 2) • Application Modeling Methodology • System Life Cycle Model • A Common Performance Methodology • Load – Service Curves and How To Get Them • Workload Characterization & Clustering • Forecasting Techniques • Benchmarking • Modeling Concepts & Simulation

  42. Requirements Operation Acquisition THE SYSTEM LIFE CYCLE MODEL

  43. Requirements Operation Acquisition THE SYSTEM LIFE CYCLE MODEL LOAD SERVICE Compare Alternatives Plan

  44. Requirements Acquisition Operation THE SYSTEM LIFE CYCLE MODEL Quantify Forecast LOAD SERVICE Functional Chargeback Contract Monitoring Fx Spec Bmrk Pkg RFP Eval Criteria LTD Performance Management Award Acceptance Test Compare Alternatives Conversion Continuous Reporting Load Management Exception Reporting Plan

  45. Requirements Acquisition Operation Performance Management Compare Alternatives Measure Trigger Plan Tune Plan THE SYSTEM LIFE CYCLE MODEL LOAD SERVICE

  46. Session 2 (of 2) • Application Modeling Methodology • System Life Cycle Model • A Common Performance Methodology • Load – Service Curves and How To Get Them • Workload Characterization & Clustering • Forecasting Techniques • Benchmarking • Modeling Concepts & Simulation

  47. Approach to Problem Solving CAPACITY SERVICE Service = f ( Load, Capacity) Performance Problems Capacity = g ( Load, Service) Configuration Planning Load = h ( Capacity, Service) Application Design LOAD

  48. Load Configuration Service • Load forecasts • Anticipated service levels • Configuration definitions over time

  49. CapacityMgmt Plan Load Forecast Anticipated Service Levels Configuration Definitions Load Data- arrival rate Hardware Data - availability - utilizations - upgrades Service Data- Response time

  50. Monitor Program Mix UserCharacteristics Peak Periods Generic Log Survey Data Log Files MemoryRequirements PeripheralI/O Job Mix

More Related