80 likes | 184 Views
Evaluation of Current Requirements Analysis Tools Capabilities for IV&V in the Requirements Analysis Phase. SAS 2007 Executive Galaxy Global Corporation Presented by: Valerie Jones & Jennifer Murray NASA POC: Jeffrey Northey. Problem Statement.
E N D
Evaluation of Current Requirements Analysis Tools Capabilities for IV&V in the Requirements Analysis Phase SAS 2007 Executive Galaxy Global Corporation Presented by: Valerie Jones & Jennifer Murray NASA POC: Jeffrey Northey
Problem Statement • A Requirement Analysis tool that performs comprehensive automated analysis does not exist • Existing tools available for use do not provide guidance or automated assistance in identifying potentially problematic requirements • Requirements analysis is a long and tedious process. • An automated tool could decrease the time required during the requirements analysis phase as well as improve the process.
Tool Evaluation Study • Tools Evaluated: • NASA E-Smart/ARM • Lexior • QuARS • Requirements Assistant • SAT • TEKChecker • Tools evaluated on a predefined set of technical and quality attributes. • Model problem defined to do comparison between manual analysis and analysis with automated assistance
Tool Study Results • Two evaluation studies were performed • Results indicated automated analysis tools correctly identified technical issues consistent with manual analysis. • Requirements Assistant performed best technically in both studies • Analysis results were consistent with manual analysis and additional key issues identified • Key issues identified including: missing requirements and inconsistencies in requirements
Benefits of RA • Leads analyst to identify key issues outside capabilities of other tools evaluated • Could allow the analyst to prioritize analysis based on identification of potentially problematic requirements first. • Better results for both novice and experienced analysts • Novice analyst identified key issues with a total analysis time of 3 days compared to a team of analysts working for 3 weeks • Developers would have positive ROI if using this tool for tracking requirements across stages of development • Can assist in Requirements Validation with UML modeling. • Knowledge base behind the tool allows for very versatile use for various aspects of software development to stay consistent
Recommendations • Proposed facility adopt Requirements Assistant (RA) for further use. • RA requires additional upgrades before it can be used facility wide. • Upgrades • Improve user interface for analyst efficiency • Increase speed • UML support • Domain term library
Proof of Concept • Current tasking is to evaluate RA capabilities for requirements validation and verification to UML modeling of systems. • Working with NASA IV&V Facility project currently performing requirements validation and verification of 4 components of System Reference Models • Initial results from the first component analyzed were provided to the project • Project implemented additional updates based on findings • Through the POC we will work to develop an appropriate user interface for the tool and analyst at the IV&V Facility.
What’s Next? • Continue the Proof of Concept Study for Requirements Validation • Recommended updates to Requirements Assistant for user interface development. • Evaluating Eclipse platform • Develop additional requirements. • Proposal submitted for Research Infusion.