Amiruddin Syed Mohammed

1. Testing as a Service - New Realities and Perspectives to address Quality and Agility challenges in BFSI Testing Amiruddin Syed Mohammed

2. The Sectoral Challenge BFSI Test Offerings BFSI Corporate strategies… …Sectoral challenges…..

3. The Need : Do More with Less Market Agility and Responsiveness Faster time to market for New products and services Realize benefits from Distruptive and Emerging technologies ( Cloud, Mobile , etc) Empower business with modernized applications New ways to collaborate with customers & partners New business models ROI and Cost Control Lower TCO Move from CAPEX to OPEX Predictability of Testing and software costs Scalable resources and Economies of scale Eliminate Overhead cost on under-used capacity Standardization through industrialized service delivery Business and Operational Risk • Security, audit and reporting requirements • Functionality, Non-functionality, Predictability and • Reliability • Assurance of External & Internal Quality

4. So What is Testing as a Service (TaaS)? • Testing of IT applications ( Custom, Enterprise, Business apps) leveraging Cloud for virtualized , scalable ,on-demand test labs that provide self-provisioning and management of multi-platform environments. These are similar to traditional 3rd-party testing services such as dedicated testing centers of excellence but executed and managed in Cloud based.* • Testing tools • Test scripts • Test standards • The work flow • The standard applications that are being tested (like SAP or Oracle or point solution) • Test metrics • The test environment (Platform, architecture and the applications them selves) What is Same…. • Complete utility model for platform, test experts and tools • Predictable End-to-end cost • Access to variety of tools.. In some cases more test coverage because of multiple tools testing • One stop solution possible for all testing .. Option to change the tools selection, when not satisfied (Try and use) • Verify architectural / design level – using new generation performance tools – before going live. What is New…. * Adapted from IDC definition of TaaS

5. Overview of ‘ As a Service ‘ from a Testing point of view Capability-as-a-Service (CaaS) CaaS • Functional Testing as a Service • Performance Testing as a Service • Mobile Testing as a Service • Test Automation as a Service • Security Testing as a Service • ....... Testing SaaS PaaS Software as a Service (SaaS) Platform-as-a-Service (PaaS) • ASQ Tools in alternate licensing models • Test Management Tools • Automation tools • Performance Testing tools • LCQM tools • Open Source Tools • Test Environment (Servers / Desktops/ Configurations)on demand to support • New Develpment / Enhancement • Patches / Hot Foixes • Migrations / Upgrades

6. How is TaaS different from Traditional Testing Models ? Traditional Testing TaaS Labour Arbitrage as key lever Business Value + Cost Reduction as key lever Craftsman Approach Industrialized Input based pricing Output / Outcome based pricing Rigid Flexible and Scalable on Demand Testing seen as a tactical activity Testing seen as a strategic enabler Resource ( People ) focus Services ( Assets) focus Limited collaboration with ASQ partners High on collaboration with ASQ partners A paradigm market shift underway — from labourarbitrage and process efficiency to service arbitrage and business assurance

7. TaaSin Cloud for BFSI – SHAPE , TRANSFORM and MANAGE your portfolio • Business Drivers • Pressure to reduce operational spending • Faster time to market • Emergence of global workforce • Meet dynamic resource requirements • Move towards variable cost structure for testing services and even ASQ tools • IT Drivers • Need to support strategic initiatives • Multi-site delivery and 24X7 operations • Focus on first-time-right • High incidence of production issues and higher cost of rework • Keep pace with technology Key drivers for testing in cloud On-Demand Resourcing Service Performance Metrics Insurance Banking and Financial Services CLOUD LAB Reusable Asset Repository Testing Offerings SHAPE - Test Process Management -Cloud Enablement Mobility TRANSFORM - Hybrid TCoE - Web Apps. Perf. Testing - Cloud Certification MANAGE Industrialized Testing Services Functional Testing Non Functional Testing ERP Testing Specialized Validation Global Process Framework Choice of Engagement & Global Delivery Models with alternative Pricing Options Output Based Pricing Virtual Teams using Collaboration tools & platforms Alliances -VMWare , Citrix , IBM Rational, HP Mercury, Segue, Compuware, Work soft, and ITKO Sourced on Demand Improved utilization Elastic Use scale-up / scale-down Enhanced Quality Faster time to market Pay as you goService arbitrage Ubiquitous Access Geography independent

8. TaaS Ecosystem – A snapshot Mobile Testing Cloud Certification Non Functional Testing Functional Testing SAAS (Software as a Service) Enterprise Applications – SAP, Oracle, Cadence, PTC, Sugar CRM Apps & Services Web Applications Client / Server Tools Sandbox Service Virtualization Borland ES, Cold fusion, Tomcat, Web logic, Web Sphere, Web Application server (SAP), ATG Dynamo, JBOSS Elastic servers (Tomcat, My SQL combinations) Mobile Platform simulators Linux (Red hat, Linux, Debian) Windows (Multilingual, Multi CPUs) Platforms MS-SQL. Oracle, DB2, Informix, MySQL, Teradata Sun Solaris

9. Database servers Application Servers TaaS – Delivery Model TaaSin Cloud Provider Web Server Customer Test Requirements & Application Components Cloud Orchestration FTP / URL / VPN Test Strategy & Planning Customer Sign-off Service virtualization Cloud lab Mobile Simulators Automated Software Quality Tools Application Under Test Certify Application Collaboration Provider Customer Infrastructure Stabilization Test Summary Reports Test Execution Provider & Customer

10. Traditional Testing Vs TaaS Comparisons Dramaticreduction in test cycle time Significant reduction in total cost of operation Traditional Lab Config. 1 Configure Environment Configure Environment Test Execution Test Execution Resolve Defects Resolve Defects Test Planning Test Planning Test Case/Data Development Test Case/Data Development Config. 2 TaaS – Cloud Lab Test Pass 2 Test Pass 1 Config. 1 Config. 2

11. The Challenge • Concerns on Security in Cloud • Lack of Test Environment management expertise • In efficient test automation • Beyond Testing – complimentary services ( ADM etc) • Evaluating the right tools • Lifecycle quality management • Integration with non-virtualizable components • Additional Skills for Testers

12. Critical factors an enterprise should consider while evaluating test vendors for TaaS • TaaS is evolving – hence Providers should offer customers flexible buying options – discrete vs bundled • High Value Test assets owned by the provider – reusable assets, accelerators and frameworks • Technical resource expertise in test automation • Lifecycle quality management tools and capabilities • Experience managing Security of data and TaaS environment • SLA based delivery • Automatic backup and recovery • Dashboards and tracking tools • Larger portfolio of offerings – benefit from ADM , SOA, Security offerings

13. Building Roadmap Towards TaaS Phase 3 • Shape • Transform • Manage Cloud Testing Services • Replicate for other applications • Optimize tools and licenses • Extend to other testing types • Measurement & Ongoing Improvements Phase 2 Pilot first application on Cloud • Set up Cloud environment • Carry out Proof of Concept • Enhance Cloud Testing framework based on Pilot results Cloud Testing Strategy • Cloud Testing assessment • Detailed transition Plan identifying priority applications • Identify test types – functional, automation , performance, security …. Phase 1