Sastry Bvssrs Senior IT Quality Analyst Nitin Upreti Project Manager Optum

1. Quantifying Quality in DevOps Sastry Bvssrs Senior IT Quality Analyst Nitin Upreti Project Manager Optum

2. ABSTRACT Software Testing started initially as a Traditional Approach with Waterfall Model and then we moved towards V Model where verification and validation will be taken care as a whole for the requirements. Agility started with Scrum practices, then advanced in testing practices like Continuous Integration, Test / Behaviour Driven Development, then advanced with Operations practice like DevOps. But even then the agility of time to market is a challenge with traditional architecture. This presentation outlines how we can achieve greater agility and also accelerate DevOps QA strategy by defining Efficient Strategies for QA in DevOps. ..then the Strategies… First some concepts… • DevOps, Agile model, Team structure in DevOps • Business Challenges • What is DevOps? • Shift from Traditional to Devops Testing • (conceptually, Technically, Team & Style) ...then Conclusion. • Benefits to business • Metrics

3. CHALLENGE In a recent IT Economicsurvey*, just 27 percent of IT executives said they deliver fast enough for the pace of business IT Development and IT Operations have different values and ways of working that are often not in alignment. A high proportion of production incidents are a result of human errors in the manual release of software IT organizations typically spend more time in testing, deploying and releasing software due to complex architecture patterns * - Source: Nginx

4. WHAT IS DEVOPS? DevOps is usually termed as it sits in between of Development, QA and Operations. DevOps (a clipped compound of "development" and "operations") is a software development and delivery process that emphasizes communication and collaboration between product management, software development, and operations professionals. (Source – Wikipedia)

5. Transition from Agile to Devops DevOps = {Agile Methodology + Shift Left Approach + Lean Testing} Agile : Fast, Automated, Time to Market • Goals of DevOps: • Fast and Contiguous • Early and Often Test, Risk identification in same phase • Speed to Market • Improved Productivity • Low Risk • Improved Code Quality + Shift Left : Early and Automated Testing + Lean: Remove Waste

6. DEVOPS Might be well-structured inside. But, can only be deployed as a whole Traditional Req Suite Automated Regression Testing Manual Exploratory Testing Release Manual Testing Finalize Build Components can only be deployed independently if tests are independent & if your Continuous Delivery Pipeline works Manual Exploratory Testing Manual Exploratory Testing Manual Exploratory Testing Manual Exploratory Testing Automated Regression Testing Automated Regression Testing Automated Regression Testing Automated Regression Testing Manual Testing Manual Testing Manual Testing Finalize Build Finalize Build Finalize Build Finalize Build Manual Testing System Integration Testing as a whole Release DevOps Requirement Suite

7. Framework Continuous Planning across Requirements Continuous Testing by enabling Automation Continuous Deployment across Releases Continuous Development across Builds

8. Testing Process • Intelligent Testing: • Change Impact Based Testing • Optimized Regression Suite • Continuous Development: • Correlating code Analytics with Test Analytics • Shift Left Performance Testing: • Find Performance issues in non-production stages • Service Virtualization in non-production stages • Shift Left Monitoring: • Infra and Application monitoring on demand with environment provisioning for non-production stages • Model Based Approach: • Infra as a Code • Topology Modelling • Test Design Modelling • Integrated Platform for Automation & Traceability: • Data Integration and Correlation

9. Productivity Index • Factors Contributing to Productivity Index are: • Speed • Velocity • Faster Code Development • Impact Analysis • Build & Test Automation • Configuration Automation • Time to Market

10. Quality Index • Factors Contributing to Quality Index are: • Improved Availability • Deeper Requirements Analysis • Early Business stakeholder support & involvement • Security & Compliance Risk Reduction • Identifying Issues earlier through continuous testing & integration

11. Operating Expense Index • Factors Contributing to Operating Expense Index are: • Cost Avoidance/Optimization • Doing more with what you have • Fail fast and Fail Cheap • Cost Modelling • IT Allocation

12. Capital Expense Index • Factors Contributing to Capital Expense Index are: • Improved Utilization • Technology Transformation • Convergence

13. BENEFITS TO BUSINESS • Agility in • Architecture • SOA • Micro services $$ Reduced defects in later test phases by up to 30% and overall higher quality Operational state is more stable and secure and changes are systematically auditable • Agility in • Operations • CD • Cloud $ Model Based Testing provide more options for Exploratory Testing DELIVERY RISK RESILENCY SPEED TO MARKET • Agility in • Development • / Testing • CI • TDD • BDD Test Coverage Test Pyramid help us to maintain a balance between the different types of test $$$ Up to 50% increase in speed to market through streamlined software delivery Increased Test Coverage and reduced manual Effort due to Model Based Testing Exploratory End to End • Agility in • Process • Scrum • Scaled Agile Component Greater Agility Integration Test Unit Test

14. Author Biography B V S S R S Sastry works as a Senior IT Quality Analyst at Optum Global Solutions, Hyderabad and have 5+ years of experience in Integrated Test Environment Services, ITIL & CMMI Level 5 assessment Process Improvement in Insurance domain. He holds a Master’s Degree in Technology from JNTU Hyderabad. He is a certified ISTQB professional, ITIL V3 certified. He has published 17 International white papers till date. Nitin Upreti works as a Project Manager at Optum Global Solutions, Gurgaon. He has a vast experience of 14 + years in the IT industry with expertise ranging from White Box testing, Mainframes, Web technologies and transforming Legacy applications into Big data based solutions. He is a certified professional from ISTQB and the Academy of Health care Management, USA. He Holds a Post Graduate Diploma in Business Management along with a Bachelor degree in Computer Applications.

15. Thank You!!!