1 / 10

IV&V Requirements Tracing using Information Retrieval Techniques

This research focuses on automating requirements tracing during IV&V using IR techniques. It offers RETRO, a specialized tool to improve productivity and quality for NASA. The approach involves metrics, analyst feedback, and integration with SAIC’s SuperTracePlus. Test results show promising performance. Future steps include implementing more IR methods and productizing RETRO for widespread use.

robertgoodman
Download Presentation

IV&V Requirements Tracing using Information Retrieval Techniques

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. IV&V Requirements TracingusingInformation Retrieval Techniques Jane Hayes Alexander Dekhtyar Department of Computer Science University of Kentucky

  2. The Problem How can we automate tracing requirments during IV&V? Relevance to NASA • Alleviate work of NASA IV&V analysts • Improve quality of IV&V for NASA software Importance/Benefits Improve analyst productivity on one of the most time-consuming IV&V tasks

  3. Approach • Use Information Retrieval Techniques for Requirements Tracing • Build RETRO (REquirements TRacing On-target) • Evaluate performance • TF-IDF, Thesaurus, Probabilistic IR, LSI • Analyst Feedback • Metrics • Special-purpose requirments tracing tool • Standalone version • Integrated with SAIC’s SuperTracePlus • MODIS, LOFAR, CM-1 datasets

  4. Analyst Approach: IR for Requirements Tracing Matching algorithm 2 1 3 Design Document representation Feedback Yes Yes No Requirements Document

  5. Approach: Metrics Recall:percentage of correct design specifications retrieved out of all correct design specifications Precision:percentage of correct design specifications amongall design specifications retrieved Time:time it took to produce the result Secondary Metrics(Lag, DiffR):good links rising, bad links sinking

  6. Accomplishments: I RETRO: REquirements TRacing On-target

  7. Accomplishments:RETRO Architecture documents Analyst Feedback processor Filter Build Representation IR toolbox

  8. A SFEP STP Interactive Link Anlysis STP Report Generation Accomplishments: RETRO + SuperTracePlus requirements documents Analyst Review RETRO Build RETRO IR Toolbox RETRO Feedback Representation Traceability Reports STP RETRO

  9. Accomplishments II: Test ResultsMODIS, TF-IDF, Thesaurus Above 70%

  10. Next Steps, Conclusions, Plans, Ideas • IR methods work : need to implement more • Productize RETRO (Check!) • Data Integration with existing tools (Check!) • Other IV&V problems may be alleviated

More Related