Random Research Thoughts from Distributed Multimedia Systems 2004

1. Random Research Thoughtsfrom Distributed Multimedia Systems 2004 PEDS Presentation Bob Kinicki September 20, 2004

2. Talk Objectives • To present several research ideas and to trigger new, creative ideas. • To get everyone thinking about future directions. • To present futuristic applications that seem to mesh well with current PEDS research activities. • To plant the seeds for a near-future grant topic. PEDS September 20, 2004

3. Titles of Talks along our Random Walk 1. “Visualization for RFID/Auto-ID Initiative” 2. “Re-envisioning Visual Information Systems: From Signal Analysis to Context-Aware Media Computing” 3. “Design of Multimedia Instant Messaging System with Annotation” PEDS September 20, 2004

4. Titles of Talks along our Random Walk 4. “PARIS: Fusing Vision-based Location Tracking with Standards-based 3D Visualization and Speech Interaction on a PDA” 5. “TANDEM – Transmitting Asynchronous Non Deterministic and Deterministic Events in Multimedia Systems over the Internet” 6. “AudioPeer: A Collaborative Distributed Audio Chat System” 7. “A Case for A Mobility Based Admission Control Policy” PEDS September 20, 2004

5. Visualization for RFID/Auto-ID Initiative Keynote given by Tao Lin, SAP Research Center • Lead article in Boston Globe today! • Auto-ID initiative was started by MIT in 1998. • “RFID mandate” from Wal-Mart (and others including D0D) for all supply providers by 2006! • Requires a world-wide standardized EPC (Electronic Product Code) to be used as tags on all products. PEDS September 20, 2004

6. Visualization for RFID/Auto-ID Initiative • EPC Network will consist of mobile products with EPC tags that become “passive” elements in collection of wireless LANs that read EPC tags with RF technology. • Need to get the cost of the passive tag device down to 5 cents. • Requires global object naming services similar to DNS. PEDS September 20, 2004

7. Re-envisioning Visual Information Systems: From Signal Analysis to Context-Aware Media Computing Keynote given by Mark Davis, Professor at UC Berkeley • Basic premise: Research to solve the problem of multimedia content analysis and media asset management has failed! • Instead, make a paradigm shift to leverage the spatio-temporal context of media and … PEDS September 20, 2004

8. Re-envisioning Visual Information Systems: From Signal Analysis to Context-Aware Media Computing • Interaction between people and devices (especially by using programmable networked mobile media capture devices.) • The major premise: Cameras are going to become obsolete. Everyone will use their cell phone to take photographs. • Is this far-fetched? PEDS September 20, 2004

9. Mark’s cell phone photo at CC meeting PEDS September 20, 2004

10. Re-envisioning Visual Information Systems: From Signal Analysis to Context-Aware Media Computing • He focused on photographs as his example – e.g. the Berkeley tower. • The idea is to build in all the mechanisms in the mobile device to permit recording of contextual metadata in online databases such that later this context data can be used to provide correlation information. PEDS September 20, 2004

11. Design of Multimedia Instant Messaging System with Annotation Dr. Zon-Yin Shae, IBM • The idea is to expand the instant messaging paradigm. • Three modes: text, ink, annotation. • Ink – implies an image of handwritten text. • Objects could also be pictures. • Annotations imply displaying superimposing active ink on top of pictures. • Includes the concept of ‘scrolling’ in IM and merges with whiteboard interface. PEDS September 20, 2004

12. PARIS: Fusing Vision-based Location Tracking with Standards-based 3D Visualization and Speech Interaction on a PDA Stuart Goose, Siemens • PARIS (PDA-based Augmented Reality Integrating Speech) • Mobile node is a PDA with a camera, VRML engine, speech recognition and tracking and location components. • PDA connects wirelessly to plant network where real-time plant management software resides. • Utilizes visual-based localization using coded visual markers. PEDS September 20, 2004

13. PARIS: Fusing Vision-based Location Tracking with Standards-based 3D Visualization and Speech Interaction on a PDA • Paris automatically locates roaming maintenance person and then displays appropriate picture of equipment. • Maintenance person gives simple commands to query equipment state, repair equipment, and make post-repair requests to check validity of repair. PEDS September 20, 2004

14. TANDEM – Transmitting Asynchronous Non Deterministic and Deterministic Events in Multimedia Systems over the Internet Angela Guercio, Professor at Hiram College • Authors believe in the importance of distributed reactive multimedia systems. • The reaction consists of generating events that respond to thepresence of some phenomena. PEDS September 20, 2004

15. TANDEM – Transmitting Asynchronous Non Deterministic and Deterministic Events in Multimedia Systems over the Internet Tandem is an XML-based multimedia language with an application model consisting of : • Sources and sinks • Transformer nodes apply funtions to modify the attributes of the multimedia stream. e.g., change the rendering rate of a group of streams, reduce the channels of a video for rendering. • Triggers activate events in response to conditions being satisfied. e.g., monitoring external sensors. • An active repository that samples and analyzes the media content for required conditions, and transmits the outcome to the triggers. PEDS September 20, 2004

16. AudioPeer: A Collaborative Distributed Audio Chat System Beomjoo Seo, Ph.D. student at USC • A multiuser audio chat system using a multicast peer topology and a new audio streaming protocol. • Allows groups of students to discuss assignments. • Permits TAs to conduct lab sessions. • Enables students to ask questions during questions and teacher to get feedback during lectures. PEDS September 20, 2004

17. AudioPeer: A Collaborative Distributed Audio Chat System • The authors argue against a star topology due to single point of failure and bottleneck concerns. • Instead, they adopted a distributed peer architecture where a newly joining user may be connecting to a peer who is already participating in an ongoing audio chat session. • YimaCast – a low bandwidth consuming overlay network. PEDS September 20, 2004

18. AudioPeer: A Collaborative Distributed Audio Chat System • Authors worry about exceeding 250 milliseconds latency to support natural conversation. • Each peer node is equipped with an audio mixing module that relays the incoming audio from remote nodes to the outgoing connections. • Authors have actually used this system experimentally in USC courses. PEDS September 20, 2004

19. “A Case for A Mobility Based Admission Control Policy” Bhaskar Krishnamachari, Ph.D. student at USC • The authors application is streaming video over wireless, ad hoc, car-to-car, peer-to-peer networks (C2P2). • Note – mobile wireless networks are hard to deal with because of the routing issues. • Authors focus only on admission control policy related to QoS metrics. PEDS September 20, 2004

20. “A Case for A Mobility Based Admission Control Policy” • They modeled thirteen road stretches with three stationary servres. • They built their own simulator using C# programming language. • C2P2 devices implemented with DSR routing policy. PEDS September 20, 2004

21. Conclusions • So What? • Working with a real futuristic application opens doors to funding and paper acceptance. • Give your system a spiffy name. • These researchers believe wireless, mobile multimedia distributed systems are the future. • No consideration for security issues. PEDS September 20, 2004

22. Questions? Thanks! DMS04 Technical Program link: http://www.ksi.edu/seke/dms04pgm.html PEDS September 20, 2004