50 likes | 154 Views
Verification through User Value: Or ‘How to Avoid Drinking Your Own Bathwater in Ubicomp Evaluations’. Dr. Christopher A. Miller Harry B. Funk 30 September 2001 Ubicomp-01 Atlanta, GA. Validation – did we do what was spec’ed?. Verification – did we provide intended benefit?.
E N D
Verification through User Value:Or ‘How to AvoidDrinking Your Own Bathwaterin Ubicomp Evaluations’ Dr. Christopher A. Miller Harry B. Funk 30 September 2001 Ubicomp-01 Atlanta, GA
Validation – did we do what was spec’ed? • Verification – did we provide intended benefit? Validation and Verification • Evaluation – did we do a good job?
Bed of nails testing • Functional paths testing Comprehensive Test • Want entire system tested
? = Gold Standard requires knowing the “right” outcome • Testing complex systems…
Independently verify benefit of use cases Expand cases to cover functional logic Take care to ensure metrics are broad enough Recommendations • Start with use cases – known, specific examples of ‘correct’ behavior