Crossing the Longest Yard: Eight Strategies for Creating Knowledge from a Glut of Data

1. Crossing the Longest Yard: Eight Strategies for Creating Knowledge from a Glut of Data Dr. David L. Hall School of Information Sciences and Technology The Pennsylvania State University Sonya A. H. McMullen Teach Reach Inc.

2. The Evolving Problem • Assessing and digesting enormous quantities of data • Developing an accurate threat or situation assessment • Decision making • Assessing the result Crossing the Longest Yard By: Hall and McMullen

3. Multitude of Data Sources • National SIGINT Assets • Tactical SIGINT Assets: • Aircraft • Unmanned Aerial Vehicles (UAVs) • Ground-based Sensors • Nano and Micro-scale sensors • Smart Dust • HUMINT • Open Source Crossing the Longest Yard By: Hall and McMullen

4. Traditional View of Processing Intelligence Data Crossing the Longest Yard By: Hall and McMullen

5. Glut of Data “Problem” • Lots of data in multiple forms: • COMINT • SIGINT • IMINT • HUMINT • Data is not housed in a single repository or data base • Not enough analysts • Collaboration limitations Crossing the Longest Yard By: Hall and McMullen

6. Proposed Solutions • More: • Pattern Recognition • Machine Learning Methods • Advanced Filtering • Data Mining Crossing the Longest Yard By: Hall and McMullen

7. Proposed Solution Fallacies • It is just a matter of “finding the needle in the haystack” • Knowledge creation involves human collaboration • Knowledge is inherently a human product • The approach starts at the “wrong end” Crossing the Longest Yard By: Hall and McMullen

8. Strategies for Resolving the Knowledge Creation Problem • Increase the bandwidth: Make computer displays larger • Fly-by-wire: Use gaming techniques to “physically” access data • Use multiple senses: Vision + hearing + haptic Crossing the Longest Yard By: Hall and McMullen

9. Gaming Concept for Data Crossing the Longest Yard By: Hall and McMullen

10. Strategies for Resolving the Knowledge Creation Problem • Conserve analyst attention: • Deliberate synesthesia – Transforming data from one sensory domain to another • Use other techniques to focus the attention of the analyst • Leverage the power of language • Focus on negative space Crossing the Longest Yard By: Hall and McMullen

11. Negative Space Example Crossing the Longest Yard By: Hall and McMullen

12. Strategies for Resolving the Knowledge Creation Problem • Create cyber cognitive multipliers: • “The Matrix Approach” – Agents in cyber-space can replicate themselves • Mixed teams of analysts, intelligent team-based agents, and decision-makers • Adapt to individual users: Interfaces that learn the preferences of and “fit” individual users Crossing the Longest Yard By: Hall and McMullen

13. “The Matrix Approach” Crossing the Longest Yard By: Hall and McMullen

14. Summary of Improvement Strategies Crossing the Longest Yard By: Hall and McMullen

15. Recommendations • Develop two realistic scenarios and associated data sets to test strategies • Conduct some knowledge elicitation from “real” analysts Crossing the Longest Yard By: Hall and McMullen

16. Recommendations • Evaluate the effectiveness of implemented tools using the Living Laboratory approach • Transition selected tools to real environments Crossing the Longest Yard By: Hall and McMullen

17. Living Laboratory Concept Crossing the Longest Yard By: Hall and McMullen

18. Questions? Crossing the Longest Yard.doc