Surveillance Imagery Over An Agent-Based Platform

1. Surveillance Imagery Over An Agent-Based Platform Dr. Willie Thompson, II Dr. Damian Watkins

2. Agenda • Overview of Problem Space • Project Motivation & Significance • Project Methodology • Ongoing Work • Future work

3. Environment Challenges • Limited Resources • Limited energy, processing, & storage • Very limited bandwidth • Wireless Communications • Open communication medium • Hidden Terminal Effect, Channel contention, noisy channel • Monitoring may be difficult w/ security infrastructure • Tactical Environment • Difficult to characterize normal behavior • Nodes prone to enemy capture • Limited analyst intervention • Dynamic Environment • Mobile nodes and mobile infrastructure • No single concentration points for traffic analysis

4. Role within BORG Research

5. Contributions • Real-time data management and processing of data streams • Situational aware and intelligent presentation • Autonomous and secure agent interaction

6. Project Methodology • Data Source • Server • Camera • Archive

7. Real Time Video Transmission • Real Time Transport Protocol • Java Media Framework • Low power, low CPU power, small form factor devices

8. Real Time Transport Protocol(RTP) • Enables steaming media • End-to-end network delivery services • Transport independent( usually UDP) • Creates sessions between application • Connectionless protocol

9. Java Media Framework • Acquisition, Processing, and Delivery of Time-based media • Time-> nanosecond precision • Create and manage players w/ multiple RTP sessions • Compatible w/AIFF, AU, AVI, GSM, MIDI, MPEG, QuickTime, RMF, and WAV formats

10. Intelligent Agents • Software Program • Agency and intelligence are the fundamental underlying capabilities • Autonomy – separate process/thread • Intelligence – hard-coded logic, complex reasoning, learning. • Implemented w/ JAVA

11. Why use Intelligent Agents? Command Level Detection Analysis Soldier (Node) Level Detection Analysis • Need an answer quickly • Few data sources • Limited Bandwidth • Solution: • Autonomous & Intelligent process to gather and display relevant info • Intelligent Agents are autonomous and intelligent • Have the luxury of time • Abundant Data sources • Bandwidth • Solution: • Autonomous processes may be used but not necessary

12. Test Methodology • Invoke JMF methods within Agent based platform. • Agent Creates RTP session with data source and/or other agents. • Analyze Performance of RTP and agent communication over wireless network.

13. Test Scenario Streaming Source node Peer-to-Peer network RTP Session1/UDP RTP Session2/UDP

14. Test Platform Streaming RTP Video Session flyovervideo150m Video Source

15. DATA traffic • Rendering streaming tends to be slow • Packet Errors and congestion over wireless network • High broadcast, network management traffic • Approx. 82% of total traffic • Large packet sizes for video frames • 1 Mega Byte packet size

16. Agent BroadcastTraffic

17. RTP BroadcastTraffic

18. Shortcomings • Connectionless RTP • Frames are not guaranteed to arrive • Frames arrive out of order • Inconsistent multiple RTP sessions • High broadcast overhead • Network management traffic • Agent Communication overhead

19. Future Work • Agent Cooperation • Create and Manage RTP session • Authenticate and secure hosts • Run RTP over reliable UDP • Construct Representative Environment • Real MANET environment • TEALAB CTA04 • D. Watkins, C. Scott, “Methodology for Evaluating the Effectiveness of Intrusion Detection in Tactical Mobile Ad-hoc Networks”, IEEE Wireless Communications and Networking Conference 2004. • Virtual Environment (VMware)

20. References • V.S. Subrahmanian, et al, Heterogeneous Agent Systems, MIT Press, 2000 • Java Media Framework, 2.0. Guide: http://java.sun.com/products/java-media/jmf/reference/docs/index.html • RTP Specification: http://www.faqs.org/rfcs/rfc1889.html

21. Questions? Comments?