Approaches to the Evaluation of Intelligence Data

1. Approaches to the Evaluationof Intelligence Data Workshop IST-036/RWS-005 Massive Military Data Fusion and Visualisation: Users Talk with Developers

2. Definitions • Visualisation should generate an environment supporting the perception process of presented information. • Visualisation should help average users to produce better results and help the ”artist” to become more creative. • SIGINT makes contributions to describe the situation for military and political decision-makers on the basis of information intercepted from communication and signal distribution processes.

3. Overview • Data model • Information processing tasks • Visualisation examples • Further aspects

4. VisualisationAnalysisEvaluation Archive Clean up Data archive Report Raw Data Coll Rep old Audio Text Fax ... ... ... Aggregation Tolerable access time DataLink actual Selection  Collection SEL Link Data fusion MD • Add valuable meta data • Technical operational parameters • Feature extraction results Data reduction Pre-processing Classification Acquisition Signal Input Cl G TM S Garbage Target / mission data base Sensor / source Data Model Visualisation

5. Information Processing Tasks S F *** *** R *** Visualisationneeded ! Aggregation: Data Fusion – Reporting Drill Down: ~ confidence, security, permission

6. Visualisation Examples:Raw Signal - Audio Traditional 2D representation of signal analysis results incl. audio processing

7. Visualisation Examples:Raw Signal - Text VIDA – Visual Document AnalysisDr. Michael Towsey, MEDAV • Keyword Analysis • Feature vector generation forautomatic classification processes • Grafical summary • Textual summary • Example: the Arthur Enderson / enron story

8. The full display Menu Bar Graph panel Information panel List of topics in document Selected topic List of word associations Information text box Analysis Tool Bar Movable panel divide Redraw arcsbutton Hide ArcsButton Slider

10. Automatic Keyword Extraction

11. n-gram analysis

12. Association Analysis – ”Arthur Anderson”

13. Visualisation Examples:Collection – E-mail • Command & Control structures • Using statistical methods of pattern recognition

14. Visualisation Examples:Collection – Radio network I • Visual terrain models • Fusion of communication events • Drill-Down into the raw data • Additional information by background projection • Use of virtual reality projection methods

15. Background Information: Simulated radio wave propagation COMINT-Situation displayed in a terrain model Network: 4711 TOA: 010700B Apr 01 Frequency: 5815 Location: alpha Comment: Increased communication activity after event Yankee

16. Receiver Time Trans-mitter Visualisation Examples:Collection - Radio network II • technical parameters: • Call sign sender • Call sign receiver • Time of ArrivalFrequency of contact is described by the size of the sphere

17. Activities of a transmitter Activities of a receiver Communication - one transmitter / one receiver - gaps - unequal intensity

18.  Models for the automatic generation of reports can be trained and tested using archived operational data sets Raw Data Coll Rep Audio Text Fax ... ... ... Further Aspects: Archive • The archive contains the complete data set – including: • Raw data • Definitions of collections • Reports • All links from aggregated data to original raw data

19. Thank you