Performance & Availability Lifecycle Recorded on July 10, 2008

1. Performance & Availability LifecycleRecorded on July 10, 2008 Sanjay Anne HP Software, Product Marketing

2. Agenda Performance & Availability Lifecycle Why is it important? Why is it hard to achieve? How does it help QA/Test and Ops teams? Customer example 27 November 2014

3. Performance & Availability Lifecycle (PAL) • What? • Managing performance and availability in both pre-production and production • How? • By integrating testing and monitoring solutions to drive efficiency, mitigate risk, and reduce costs • Deployment • Use best practices created by HP Software Services to deploy

4. “86% of IT projects experience performance problems when first put in production” Why is it important? Performance Requirements? Testing Operations Record Business Processes Record Business Processes Run Load Tests Deploy and Monitor Gartner

5. Failure CIO Why is it hard to achieve? SOA, Shared Services, Web 2.0, Enterprise 2.0 Increasing time and cost pressures Distributed and Offshore teams Integrated business processes ? New and Agile Business Capabilities Business Services Increasing complexity CRM Operations e-Commerce Finance

6. PAL scenarios – attributes of a real-time enterprise TESTING OPERATIONS Record Business Process Scripts Test and Optimize Reuse Business ProcessScripts Monitor and Optimize Bidirectional Asset Reuse New application deployment Major upgrades Continuous improvement (Hot packs, fixes etc) Reuse Business Processes Scripts/SLAs from Testing in Production Leverage Real User Information in Pre-Production Unified Diagnostics

7. Leverage operational information Linking pre-production and production teams HP Performance and Availability Lifecycle includes: • HP Performance Center software • HP LoadRunner software • HP Business Availability Center software • HP End User Management software • HP Business Process Monitor • HP Real User Monitor • HP Diagnostics software • HP Performance Center Implementation Service software

8. QA Environment Objective is to establish the breaking points of the application Confined to the QA environment No access restrictions Known data sets Dummy data All operations are fair game Clean environment Consistent network Not an audited environment Production Objective is to ensure the service doesn’t break Global Scope Location/Time restrictions Chaotic user defined data Information security requirements Some things cannot be touched Noisy environment Network varies by time & user Auditing is common Key differences when going live…

9. Performance and Availability Lifecycle Process OPTIMIZE BUSINESS OUTCOMES TESTING AND OPTIMIZATION MONITORING AND OPTIMIZATION Deploy GoNo-Go Gather Performance Requirements Plan Capacity Gather Performance Requirements Diagnose Root Cause & Optimize Build Test Scripts & Scenarios Validate Results Develop Monitoring Strategy Detect and Isolate Problems Run Performance Tests Diagnose Root Cause & Optimize Build Monitoring Scripts Monitor App and Infrastructure Bidirectional Script Reuse Reuse Business Processes Scripts/SLAs from Testing in Production Development Performance Engineer Quality Assurance Operations Performance Engineer Application Support

10. Performance and Availability Lifecycle Process OPTIMIZE BUSINESS OUTCOMES TESTING AND OPTIMIZATION MONITORING AND OPTIMIZATION Deploy GoNo-Go Gather Performance Requirements Plan Capacity Gather Performance Requirements Diagnose Root Cause & Optimize Build Test Scripts & Scenarios Validate Results Develop Monitoring Strategy Detect and Isolate Problems Run Performance Tests Diagnose Root Cause & Optimize Build Monitoring Scripts Monitor App and Infrastructure Bidirectional Script Reuse Store and retrieve Test Scripts & Scenarios Reuse Business Processes Scripts/SLAs from Testing in Production Development Performance Engineer Quality Assurance Operations Performance Engineer Application Support

11. Define SLA’s to a load test

12. Generate point & click scripts

13. With powerful scripting capabilities

14. SAP Oracle 11i Siebel .NET J2EE J2EE Legacy Databases • 3270 • 5250 • VT100 • Oracle • MS SQLServer • DB2 • ODBC Middleware • EJBs • CORBA • COM • RMI • MQSeries Web • SOA • HTTP(S) • Web 2.0 • Citrix ICA • WAP ERP/CRM • SAP • Oracle • Siebel • PeopleSoft Broadest environment support Diagnostics Load Generators Controller Network Load Balancer Web Server Application Servers Database Europe PROTOCOLS Vusers US Monitors • Windows • Unix • Linux • SNMP • WAN Emulation • MS IIS • iPlanet • Apache • BEA WebLogic • IBM WebSphere • ATG Dynamo • iPlanet App Server • EJB • JDBC • JSP • Sitraka JMonitor • Oracle • MSSQLServer • DB2 Operating Systems Network Web Servers App Servers Java Databases

15. Performance and Availability Lifecycle Process OPTIMIZE BUSINESS OUTCOMES TESTING AND OPTIMIZATION MONITORING AND OPTIMIZATION Deploy GoNo-Go Gather Performance Requirements Plan Capacity Gather Performance Requirements Diagnose Root Cause & Optimize Build Test Scripts & Scenarios Validate Results Develop Monitoring Strategy Detect and Isolate Problems Run Performance Tests Diagnose Root Cause & Optimize Build Monitoring Scripts Monitor App and Infrastructure Bidirectional Script Reuse Store and retrieve Monitoring Scripts Development Performance Engineer Quality Assurance Operations Performance Engineer Application Support

16. Save time creating monitors Reuse Test Scripts for Business Process Monitoring

17. Performance and Availability Lifecycle Process OPTIMIZE BUSINESS OUTCOMES TESTING AND OPTIMIZATION MONITORING AND OPTIMIZATION Deploy GoNo-Go Gather Performance Requirements Plan Capacity Gather Performance Requirements Diagnose Root Cause & Optimize Build Test Scripts & Scenarios Validate Results Develop Monitoring Strategy Detect and Isolate Problems Run Performance Tests Diagnose Root Cause & Optimize Build Monitoring Scripts Monitor App and Infrastructure Bidirectional Script Reuse Capture Real User Scripts & Scenarios for reuse Leverage Real User Information in Pre-Production Development Performance Engineer Quality Assurance Operations Performance Engineer Application Support

18. Individual behavior Slow operations Odd data Navigation paths Error creation Group behavior Usage loads Common paths Abandonment metrics Under/Unutilized areas User set/group idiosyncrasies Infrastructure behavior Utilization Topology Relations to user loads Shared services Application logic Topology flows Slow methods/functions Bottlenecks Utilization norms between test and production What can be learned in production?

19. Day one monitoring Understand user experience to ensure service levels

20. Create SLA definitions based on production data

21. Performance and Availability Lifecycle Process OPTIMIZE BUSINESS OUTCOMES TESTING AND OPTIMIZATION MONITORING AND OPTIMIZATION Deploy GoNo-Go Gather Performance Requirements Plan Capacity Gather Performance Requirements Diagnose Root Cause & Optimize Build Test Scripts & Scenarios Validate Results Develop Monitoring Strategy Detect and Isolate Problems Run Performance Tests Diagnose Root Cause & Optimize Build Monitoring Scripts Monitor App and Infrastructure Bidirectional Script Reuse Capture Real User Scripts & Scenarios for reuse Leverage Real User Information in Pre-Production Development Performance Engineer Quality Assurance Operations Performance Engineer Application Support

22. Closed-loop integration with Operations

23. Identify critical business processes Specify data for accuracy

24. Manage what really matters

25. Deliver actionable information

26. Manage by actionable information

27. Create scenarios from production data Data used to create scenarios: What are the most used BPs? How many users per BP?

28. Generate test scripts from Real-User Monitoring • Create Scripts from Production data: • What does a user do during session?

29. Performance and Availability Lifecycle Process OPTIMIZE BUSINESS OUTCOMES TESTING AND OPTIMIZATION MONITORING AND OPTIMIZATION Deploy GoNo-Go Gather Performance Requirements Plan Capacity Gather Performance Requirements Diagnose Root Cause & Optimize Build Test Scripts & Scenarios Validate Results Develop Monitoring Strategy Detect and Isolate Problems Run Performance Tests Diagnose Root Cause & Optimize Build Monitoring Scripts Monitor App and Infrastructure Bidirectional Script Reuse Collaboration to decrease Time to Resolution Development Performance Engineer Quality Assurance Operations Performance Engineer Application Support Unified Diagnostics

30. Unified Diagnostics in pre-production and production

31. Performance and Availability Lifecycle Process OPTIMIZE BUSINESS OUTCOMES TESTING AND OPTIMIZATION MONITORING AND OPTIMIZATION Deploy GoNo-Go Gather Performance Requirements Plan Capacity Gather Performance Requirements Diagnose Root Cause & Optimize Build Test Scripts & Scenarios Validate Results Develop Monitoring Strategy Detect and Isolate Problems Run Performance Tests Diagnose Root Cause & Optimize Build Monitoring Scripts Monitor App and Infrastructure Bidirectional Script Reuse Store and retrieve Monitoring Scripts Store and retrieve Test Scripts & Scenarios Capture Real User Scripts & Scenarios for reuse Collaboration to decrease Time to Resolution Development Performance Engineer Quality Assurance Operations Performance Engineer Application Support

32. Performance and Availability Lifecycle Process OPTIMIZE BUSINESS OUTCOMES TESTING AND OPTIMIZATION MONITORING AND OPTIMIZATION Deploy GoNo-Go Gather Performance Requirements Plan Capacity Gather Performance Requirements Diagnose Root Cause & Optimize Build Test Scripts & Scenarios Validate Results Develop Monitoring Strategy Detect and Isolate Problems Run Performance Tests Diagnose Root Cause & Optimize Build Monitoring Scripts Monitor App and Infrastructure Bidirectional Script Reuse Store and retrieve Monitoring Scripts Store and retrieve Test Scripts & Scenarios Capture Real User Scripts & Scenarios for reuse Collaboration to decrease Time to Resolution Development Performance Engineer Quality Assurance Operations Performance Engineer Application Support

33. 2 3 4 1 Mitigate risk with testing and monitoring Increase IT efficiency with requirements and script reuse Increase collaboration to accelerate time to resolution Optimize Service Performance Value proposition • For organizations who: • Want to collaborate across IT silos • Want to optimize IT efficiency through bi-directional use of requirements, assets, people, and information. • Responsible for overall delivery of the application and infrastructure to support business processes • Realize Performance is “not” a one time event but a cyclical process that is held captive by the dynamic nature of applications.

34. Customer example: SAP BW Rollout • Customer Goals: 300 concurrent users, <20 second reports • Baseline Situation: Scalability to only 90 users

35. SAP project: issues identified • Presentation Layer: • Spawning would improve performance (CPU/Memory/Capacity OK) • BW Layer: • Change Load Balancing schema • Update service packs • Optimize batch scheduling • Reconfigure memory settings (after upgrade) • Oracle DB Layer: • Update for Oracle 9i configurations • Remove STAR_TRANSFORMATION hint from the BW queries • Increase Redo Log file

36. Support pack implementation SAP project: response time improvement

37. City of Boston Bridging the application life-cycle “If we have a performance or availability issue, even if it’s only once a quarter, the perception of the end user is ‘the system doesn’t work.’ We need to be proactive and prevent issues from becoming visible to users.” David Nero, Director of Enterprise Applications Challenge Solution Results • Need to improve customers perception of application availability • Lack visibility into IT infrastructure and end users experience • Improve customer experience • Need to scale and ensure IT is not the bottleneck • HP Business Availability Center • Business Process Monitor • Service Level Management • Service Availability Management • HP Loadrunner • Improved end user perceptions of system availability • Improved business process availability and performance to 10x faster than expected • Leverage assets between pre and post production • Foundation in place for driving improved performance and accountability 24x7 37 27 November 2014

38. Why HP? • Complete lifecycle solution • Bi-directional script reuse • Unified Diagnostics support for both pre-production and production • Market leader in key aspects of lifecycle • Pre-deployment testing, monitoring and diagnostics • Comprehensive and flexible service offerings • Consulting, Education, Support and Managed Services Optimize application performance Mitigate risk

39. Summary • Without it IT cannot set, test, measure, or deliver on expectations • Without it Quality will suffer • Without it Service degradation is inevitable • Lifecycle must start with clear business requirements • Testing must be done based on actual production measures • An accurate view of service level must be measured and monitored “If you can’t measure it, you can’t manage it” - Dave Packard

40. More information • HP Performance and Availability Lifecycle Webinar (recorded 9/19/07) www.hp.com/go/hpswpalwebinar • Learn how you can integrate HP LoadRunner, HP End User Management and HP diagnostics software to: • Reduce risk to new application rollouts and upgrades • Streamline the testing cycle so you can run more tests and resolve problems prior to production • Automate test script and scenario creation • HP Software-as-a-Service: www.hp.com/go/saas • Register for live or on-demand HP Software Web Events -www.hp.com/go/HPSoftwarewebevents • Get white papers and more at the HP Software Download Center -www.hp.com/go/dlc • Get more on HP Software - www.hp.com/software