70 likes | 81 Views
Background on Testing and Maintenance. CISC 879 Fall 2008. Validation and Verification. SW Specs. Actual Requirements. System. Validation. Verification. Includes usability testing, user feedback. Includes testing, inspections, static analysis. Validation and Verification Activities.
E N D
Background on Testing and Maintenance CISC 879 Fall 2008
Validation and Verification SWSpecs Actual Requirements System Validation Verification Includes usability testing, user feedback Includes testing, inspections, static analysis (c) 2007 Mauro Pezzè & Michal Young
Validation and Verification Activities validation verification (c) 2007 Mauro Pezzè & Michal Young
You can’t always get what you want ever Correctness properties are undecidable the halting problem can be embedded in almost every property of interest Property Decision Procedure Pass/Fail Program (c) 2007 Mauro Pezzè & Michal Young
Getting what you need ... • optimistic inaccuracy: we may accept some programs that do not possess the property (i.e., it may not detect all violations). • testing • pessimistic inaccuracy: it is not guaranteed to accept a program even if the program does possess the property being analyzed • automated program analysis techniques • simplified properties: reduce the degree of freedom for simplifying the property to check (c) 2007 Mauro Pezzè & Michal Young
Some Terminology • Safe: A safe analysis has no optimistic inaccuracy, i.e., it accepts only correct programs. • Sound: An analysis of a program P with respect to a formula F is sound if the analysis returns true only when the program does satisfy the formula. Sound = Safe = Conservative Unsound = Optimistic • Complete: An analysis of a program P with respect to a formula F is complete if the analysis always returns true when the program actually does satisfy the formula. (May have optimistic inaccuracy) (c) 2007 Mauro Pezzè & Michal Young
Application Representation Test Case Generator Test Cases Application Implementation Test Cases Test Harness Actual Results Expected Results Pass/ Fail Oracle Traditional Software Testing Process Application Specification