Michael Burnside Twitter: @ SQAEvangelist Blog: http:// sqaevangelist.blogspot.com /

1. Effective Quality Assurance using agile software development process – The Quality-Centric approach to developing the best software possible Michael Burnside Twitter: @SQAEvangelist Blog: http://sqaevangelist.blogspot.com/ Software Quality Assurance, Quality Engineering, and Web and Mobile Test Automation Expert 17 May 2013

2. Effective Quality Assurance using Agile Software Development Process Table of Contents: • Prerequisites • Forward • Example of devices used every day that use and run software programs for successful operation • Software Usage Statistics • Necessary Stakeholders • Process Goals • Process Activities • Milestone Timelines • References

3. Effective Quality Assurance using Agile Software Development Process Prerequisites: • The Reader has basic knowledge and familiarity of the Agile process and how it is used in regards to software development. • The Reader has basic knowledge of Quality Assurance activities.

4. Effective Quality Assurance using Agile Software Development Process Forward: The use of software programs in society today is so ubiquitous, transparent, and executed on such a massive scale that most people in almost every non 3rd-world society use devices that run software that requires for successful execution of that software and is now entirely crucial to the success of the desires and wishes of people using the software and to all societies, in general. So, now we have entire societies whose normal life activities and productivity are entirely dependent on working software for the next level of human activities (Assuming that food, water, and sleep are the basic human needs and activities).

5. Effective Quality Assurance using Agile Software Development Process Example of devices used every day that use and run software programs that human beings depend on for successful operation Examples of devices that can be generally regarded as a used device on an hourly/daily basis that run software programs: • Watches • Personal and Work Computer (laptop or desktop) • Mobile device such as a tablet computer, such as iPad, Android, Windows CE (tablet) or “smart” phone (iPhone, Android, Windows CE). • Microwave oven for cooking/reheating food. • Regular oven for cooking food. • Databases / data storage. This data is used for a variety of reasons. • Nuclear energy producing power plants and military-controlled devices of mass destruction. • Cable TV set top boxes • Digital HD, Non-CRT Televisions

6. Effective Quality Assurance using Agile Software Development Process Software Usage Information (and this is only includes mobile phone information, not the many other types of products that run on software that humans rely on) For simplicity, this presentation will use usage data from the mobile device market. Highlights (next 2 slides):

7. Effective Quality Assurance using Agile Software Development Process

8. Effective Quality Assurance using Agile Software Development Process

9. Effective Quality Assurance using Agile Software Development Process Do I have your attention now? Do you see how important the quality of software also corresponds with the quality of life for those of us whom are fortunate enough to live in a country or society wealthy enough to allow for use of devices such that we are dependent on them for positive life-enhancing experience? Hello? McFly? Do you get it now? Yes? Good! Then we can move onto the next part of the presentation: your team that will build the best possible quality of software for your company and/or organization.

10. Effective Quality Assurance using Agile Software Development Process Necessary Stakeholders: At the very minimum, your team needs to include the following stakeholders WITH NO EXCEPTIONS. • Product Manager • Software Developer and/or team • Quality Assurance person and/or team • Scrum/Project Master to handle the Agile process aspects of the project That’s it! If one of these people does not exist in your team right now, THEN GO AND HIRE THEM! Nice to have: • Development and/or QA Manager involved in all updates and progress of the project • Project Manager to help and assist in controlling the timelines and milestones being met and help with task prioritization if involvement is in a large company where software may affect many released products whose tasks cannot be reasonably known from a smaller, more focused, Agile team.

11. Effective Quality Assurance using Agile Software Development Process Process Goals • To deliver to your customers the highest quality of software possible. • To make your customers love using your software and become dependent on it for good enhancement of daily life or job experience. • Become dependent on it for their own job/personal life success and happiness. • To maximize efficiency and purpose of each member in the Agile workgroup. • To eliminate any possible ambiguity in product requirements, acceptance criteria per test case, and product deliverable dates.

12. Effective Quality Assurance using Agile Software Development Process Process Goals (Continued) • If you fail, you fail as a team, not because of an individual or group of individuals on a particular team. For example, if a critical/show stopper bug appears in a production environment, the first question that you should NOT be asking is: how did the QA Team miss that one? Who on the QA team was responsible for this? The QA team is entirely dependent on the software being developed by the software development team and pushed into the QA environment. The QA team cannot manually possibly test every single test case. Automating tests can help and be of great assistance, but that is not the focus of this presentation and, it takes much time to build a set of automated test cases to test and have adequate test coverage to assist a manual QA tester in their job. The correct question should be: How did the bug get into production and let’s find the fail mode and correct it immediately and for the future; but how did we AS A TEAM miss this one and what can be improved IN OUR SOFTWARE DEVELOPMENT PROCESS so that this does not happen again? Very rarely, a bug enters the production environment because of the incompetence or failure of a QA person. More often than not, it is because not enough thought went into developing, testing, and understanding the impact of the change in an environment where it may not be testable (developer: local environment; QA person: QA testing environment; Release Engineer: Staging environment). The most common cause is inadequate and unprepared test environment or intense product schedule release pressure. If this is the case, then you have what is called a “Development-Centric” software development process. Your organization should move away from this type of process. What will be done now is to define a “Quality-Centric” software development process. If you follow it, the process goals will be easily achieved.

13. Effective Quality Assurance using Agile Software Development Process The Quality-Centric software development process. Milestones (Part 1): • Test cases corroboratively developed per story by the following stakeholders: Product Manager, QA, and Development team members. This includes: purpose of test case (what are we testing?), intricately and well-defined steps to execute the steps of the test case, and lastly (and most importantly) Acceptance Criteria (what result data or user experience will validate that the test passed?). • Once a complete list of test cases are created for each story in the iteration, an email is sent from the QA person to the developer and Product Manager asking for approval of all identified test cases, steps, and acceptance criteria. At this point, the Product Manager and any software developers have a chance to review the test cases purpose, steps, and acceptance criteria. Feedback may be given to change any part of the 3 identified data set for the test case, but eventually, THE SET OF TEST CASES (WHICH IS ULTIMATELY A TEST PLAN) MUST BE agreed to via an email from the Product Manager and Developers to the QA person. This action gives a SHARED RESPONSIBILITY if there is a problem during testing of the software or a critical bug reaching into the production environment.

14. Effective Quality Assurance using Agile Software Development Process The Quality-Centric software development process (Continued). Milestones (Part 2): • As the software developer starts to write the software to implement the features in the story, a QA person may or may not (but usually can) start to implement the execution of test cases. When the software is ready to be tested, the developer sends an email to the QA person that indicates the software is checked in and the feature is ready to be tested. If not, in some cases mock testing implementation can be created (use of JMock or other interfaces, etc) by the QA person to mock test the software. • Development on each story feature needs to be completed by at least 30% of time before the end of the iteration. If not, most likely not enough time will be available to test the story feature (and also test regression) and it is recommended to move the story completion to next sprint, and back out or comment out the code to avoid product risk. The team must determine how any unfinished story (development or QA task) can potentially cause risk to a released product.

15. Effective Quality Assurance using Agile Software Development Process The Quality-Centric software development process (Continued). Milestones (Part 3): • The QA manual and automated tester implement the test cases. Sometimes there are companies that employ a separate/disconnected manual QA (subject matter expert – SME) and automated test implementation team per product and then a QA test automation team to write automated tests. This disconnect is a risk to the company’s test validations. It is incredibly important that if the manual and automated test case implementer are not the same person, that they need to be in complete sync to verify the test of the story is working. Most likely, the most competent subject matter expert on the QA side is the manual tester, not the automated tester (if on a separate team that provides basic automation work for the company). If so, the manual QA tester MUST VALIDATE the acceptance criteria of the feature whether it be of a manual or automated test implementation and be a constant future validator or passing tests. The manual QA tester is responsible for running the test cases and it may be easy for them to do that through a Continuous integration (CI) mechanism. But they are responsible for getting updated on the results of each test run and perform the appropriate actions if there is a test error. • Agile stories are NOT COMPLETE unless all tasks have been finished, and that includes any QA tasks (manual or automated). QA team should validate with development and Product Management that any test cases are indeed working and any regression errors are dealt with.

16. Effective Quality Assurance using Agile Software Development Process The Quality-Centric software development process (Continued). Milestones (Part 4): • The QA team and Product Management team are the stakeholders who determine when a product is of adequate quality and ready to be released to the end user. • The software development team NEVER decides when a product is ready to be released.

17. Effective Quality Assurance using Agile Software Development Process

18. Effective Quality Assurance using Agile Software Development Process References • http://www.smartinsights.com/mobile-marketing/mobile-marketing-analytics/mobile-marketing-statistics/

19. Effective Quality Assurance using Agile Software Development Process Thanks! I sincerely hope this presentation was useful to you and that your company or organization implement the information and process in this presentation to the fullest extent. If you have any feedback, please feel free to get in touch with me (via Twitter) at @SQAEvangelist. I would love to hear very constructive comments on how to improve this presentation and make it more effective.