Quality Management with Rational tools - and a competitive view

1. Quality Management with Rational tools- and a competitive view Lars Bjorstrup Presales consultant larsbjor@dk.ibm.com

2. What is test? Test Management Rational Testing Tools Competitive view Q&A Agenda

3. What is test all about • Test is comparing actual to expected result • Purpose? • Ensure product quality (errors) • Decision (go / no-go) • Cost / Investment, ROI • Terminology • Testcase, Testplan, Testsuite .. • Manuel and Automated testing • Regression testing • Testphases • Tools used for testing?

4. What is test? Test Management Rational Testing Tools Competitive view Q&A Agenda

5. What is Test Management? • Plan Objective: • Organize and maintain an inventory of items to test • Create Objective: • Capturing the steps required to complete a given test • Execute Objective: • Assembling scripts in sequence to perform a suite of tests • Analyze Objective: • Determine current status of testing project Plan Analyze Create Execute

6. Rational ClearQuest Change Management Defects Enhancement Requests Customer defined records Test Management Create and configure test plans and test cases Create and run suites or individual test cases Extensive query and reporting facilities to measure test progress Activity Management Built-in work flow Management Integration with Rational and 3rd party tools Definable, repeatable and auditable processes 6

7. Plan: Enterprise test management & planning • Manages test planning, test results, quality metrics, and defects • Link requirements to tests (traceability) • Automates sharing and reuse of distributed assets • Extensible customization of forms and workflows • Auditable test change history • e-Signature support • Supports enterprise-level databases (Oracle, DB2, SQL Server, etc)

8. Link Requirements to Testcase (traceability)

9. Create and Execute: Extensible test ecosystem • Simplifies the management of tools from multiple vendors • Integrated with • Rational Manual Tester • Rational Functional Tester • Rational Performance Tester • Partner and customer extensibility • Open source plug-ins Partner solutions Test automation tools Eclipse TPTP Extensible test management system Open API Open source solutions Third party test automation tools

10. Analyze: Powerful Metrics Real-time project status Queries & Charts Easily create and modify with Wizards Charts: Aging, Trend, Distribution Reports Crystal Reports-based run-time engine Export to many common formats (Excel, Word, HTML) E-mail notification rules Automatic notification of events and state Changes Configurable through GUI interface 10

11. What is test? Test Management Rational Testing Tools Competitive view Q&A Agenda

12. Rational Manual TesterBuilding modular manual tests • Challenge: Creating and maintaining manual tests is labor intensive and difficult with tools such as Microsoft Word or Excel. • Modular tests - share common content • Import existing Word or Excel test documents to quick-start test development Share test content

13. Rational Manual TesterAssisted data entry and data verification Application under test Test execution window

14. Rational Manual TesterAssisted data entry and data verification

15. Rational Functional TesterAutomated Functional Testing Record Enhance Execute • Script Recording • Capture user interactions with the system under test • Script Enhancing • Modify scripts for situation specific challenges • Script Execution • Ensure reliable playback for local or remote execution

16. Rational Functional TesterSupported Recording Environments • IBM Rational Functional Tester supports the following environments • Web • Java • Any VS.NET application running under the .NET Framework • Terminal Emulation • Add-on support for 3270/5250 terminal-based applications • Packaged Applications • Add-on support for Siebel and SAP solutions

17. Rational Functional TesterRecording and enhancing scripts • Record and Replay functionality • Data Driven testing (wizard driven process) • Verification points (also regular expression support) • Enhancing scripts (VB.net or Java code) • Flexible coding language • Powerful, professional debugger • Object map editing flexibility • Version control of scripts

18. Rational Functional Tester – now SAP Certified Rational Functional Tester is now officially SAP Netweaver Certified

19. Key Benefits Built for Day 1 Productivity Mask complexity to get the job done Advanced Data Access & Manipulation Automated data variation and synchronization Root Cause Analysis Identifies location and cause of performance problem in hardware and software Rational Performance Tester Performance Tester for Web Based Applications Performance testing for the novice and the professional Record & Build Scripts Execute & Analyze Schedule Workload

20. SOA Quality Automation 1. Rational Tester for SOA Quality 2. Rational Performance Tester Extension for SOA Quality • Both built on Rational Performance Tester technology • Support for Web Services standards • UDDI, WSDL, SOAP, HTTP, JMS • HTTPS, WS-Security • Integrated with • Rational Test Management tools (Test Manager with ClearQuest) • Monitoring tools (Tivoli)

21. #1 in Market Share for Application Security • – Gartner & IDC Best Security Company Rational AppScanApplication Security Testing

22. What is test? Test Management Rational Testing Tools Competitive view Q&A Agenda

23. IBM Rational Competitive Strong points • Most complete support for application lifecycle management (ALM) • Including a Quality solution with traceability from model based development, through requirements, to test and defects, market leading manual tester, both functional and performance test in same solution. Supplemented by strong requirement, change, configuration and release management. • Heterogeneous development support • No other vendor can match the depth and breadth of support IBM Rational provides for heterogeneous computing environments (Cobol, C, C++, .Net, Java, Linux, Unix, zSeries, iSeries, Windows, packaged application (e.g. SAP, Siebel), embedded platforms). • Excellent ability to scale • Strong change management solution. Ability to support highly distributed teams. • Commitment to open standards,open architecture, and open source • Leadership, support and commitment from IBM Rational

24. IBM Rational Quality Management Process RMTRFT RPT Robot RTRT RUP RMC AppScan Purify+ ReqPro Requirements Mgmt. Test Planning Keyword Testing Test Spec. & Execute Defects Mgmt. ClearQuest Analysis & Design Change Management RSA / RSM RDA Rose .. Config. Mgmt. UCM ClearCase Software Development BuildForge Portfolio Mgmt. Build Mgmt. RAD RSD RDZ Compilers RPM

25. HP/Mercury Quality Management Process (MR) QTP LR WR (No RT) Mercury Best Practices (No comp test) SPI Quality Center / Testdirector Requirements Mgmt. Test Planning Buss. Proc. Testing Test Spec. & Execute Defects Mgmt. Analysis & Design No Change Management No Config. Mgmt. UCM No Software Development No Portfolio Mgmt. Build Mgmt. No Project and portfolio Center

26. Rational Quality Management vs. HP QualityCenter/Test Director Table above reflects estimated relative capabilities of each product and is not for customer consumption. Note: The assessment above is based on the TUP with ClearQuest with Test Management capabilities 2-Moderate 4-Excellent Capability Scale 1-Limited 0- None 3-Good

27. Top 5 IBM Technical Advantages over HP-Mercury • IBM embraces open standards while Mercury testing tools are proprietary • Mercury has propriety APIs, scripting languages and does not support Eclipse • HP/Mercury cannot support a full fledged SOA governance strategy • Uncertainty of future technology direction and level of customer support due to acquisition make analysts skeptical, meanwhile IBM leads in this movement • Mercury’s testing leadership will likely fade due to HP’s focus on systems management & software integration challenges between HP & Mercury • HP/Mercury cannot provide a full set of integrated IT lifecycle solutions • Their governance solution is for IT operations, IBM’s is more complete • They cannot address the build process (architect/design/develop) • Deploy/change management lacks software build, version control & best-of-breed provisioning • Cannot provide process, data, and tooling integration across build/deploy/manage like IBM • Mercury testing solution weaknesses • PRICE: Mercury list is at least 5 times more expensive than IBM list • TD requirements management is for test cases only – not full requirements management • Mercury workflows are harder to customize/less flexible than ClearQuest • Weak support for manual testing which accounts for 70+% of testing compared to IBM • J2EE Diagnostics is an expensive add-on for LoadRunner customers – IBM has a free solution

28. Rational Competitive Differentiators • HP/Mercury: • missing modeling, construction, change and configuration, build and release and process • Microsoft: • missing requirements management and testing • Telelogic: • missing construction for embedded, functional testing, build and release • Serena: • missing BPM, modeling, construction, testing, process • Borland: • missing construction, build and release, process • ...

29. Summary Business Operations Development • Lifecycle Approach to Software Quality Supports • Quality focus early in lifecycle • Quality integrated into the software development lifecycle • Traceability from Requirements to test and defects • Govern and controlled testing to manage risk and compliance (E-signature and full audit trail) • Manual and Automated Testing • Open standards • IBM Software Quality Solutions Provide • Faster time-to-value • Consistent, reliable application delivery 33

30. For more information • IBM Rational quality management • http://www-306.ibm.com/software/rational/offerings/testing.html • DeveloperWorks • http://www-130.ibm.com/developerworks/rational