First delivery of the course Software Quality and Testing

1. First delivery of the course Software Quality and Testing Katerina Zdravkova, Anastas Mišev {keti,anastas}@ii.edu.mk

3. Syllabus of M.Sc. course • Introduction to testing fundamentals • Structural testing • Functional testing • Foundation for combining formal methods and testing • Assertion based testing • Model based formal methods • Finite state machine based testing • Testing from a process algebra • Testing with UML's dynamic models • Temporal logic, model checking and their role in testing • Tools for automatic testing and continuous integration • The management process of software testing

4. Study pack • Exists • Slides are nice • Incomplete • No lecture notes • No supportive literature, or electronic version of a book • And, we had no experience in the area

5. CSII Course Sophomore Course Software Engineering Course Senior Course MS Course PhD Course Industry

6. http://www.cs.gmu.edu/~offutt/softwaretest/contents.html

7. Syllabus of the course (stream 4) • Introduction • Graph Testing • Logic Testing • Input Space Partitioning • Syntax Testing • Practical Considerations

8. Input Space Graphs Logic Syntax Applied to Applied to Applied to FSMs Source DNF Specs Source Models Source Specs Integ Input Design Use cases Syllabus ~ book topics Four Structures for Modeling Software

13. Grading

14. Sample of a student assignment • Provide reachability conditions, infection conditions, propagation conditions, and test case values to kill mutants 1- 6 in the figure below

15. Students project Given the method Proekt1 (in C#) that returns: (a + b) / (a * b) if c = true and d = true square root (a*b)ifc = false andd = true square root(a/b)ifc = true andd = false -1 otherwise public double Proekt1(int a, int b, Boolean c, Boolean d) { if (c && d) { return (a + b) / (a * b); } else if (!c && d) return Math.Sqrt(a * b); else if (c && !d) return Math.Sqrt(a / b) ; else return -1; } • Code and compile in a language of choice • Partition the input space with respect to the values of the variables a and b, whether the method raises an error. The blocks should be both complete and disjoint. • Choose test values from each block and derive the tests that satisfy All Combinations Coverage (ACoC) • Identify the faults and produce a method Project1_no_Faults • Derive a new method from the Project_no_Faults, called Project_1_if,such that each if statement tests only one variable • Write a program that will execute all the test from 3, over the Project_if and Project_no_Faults methods.

16. Statistics

17. Exams and mid term exams • The preferred way was through mid term exams • 45 students took the mid term exams(both) • 43 of them passed • The rest of the students took the exams • Only 3 left for the September exams • 3 students dropped out

18. Conclusions about the course • The course is in the 8th semester, and it had to start for the first time at out Institute • Keti, Anastas and Saško and had no choice but to start the course • Slides by Ammann and Offutt are fantastic • We find the book fantastic too • It demystifies the topics well • The approach contains all the theoretical knowledge

19. Conclusions • Although it was hard to prepare the lectures, the A&O’s approach was exciting, and the effort was worthy • We learned a lot about quality and software testing • We plan to introduce tool and practical testing in the next delivery • Any suggestions how to improve the course are welcome • We are ready to deliver the same course in the framework of the Joint M.Sc. studies wherever needed

20. Thank you for your attention