1 / 24

Sreekar Krishna Committee: Dr. Sethuraman ( Panch ) Panchanathan , Chair

CUbiC. C ENTER FOR C OGNITIVE U BIQUITOUS C OMPUTING. Mediated Social Interpersonal Communication Evidence-based Understanding of Multimedia Solutions for Enriching Social Situational Awareness. Sreekar Krishna Committee: Dr. Sethuraman ( Panch ) Panchanathan , Chair

wilton
Download Presentation

Sreekar Krishna Committee: Dr. Sethuraman ( Panch ) Panchanathan , Chair

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. CUbiC CENTER FORCOGNITIVEUBIQUITOUS COMPUTING Mediated Social Interpersonal Communication Evidence-based Understanding of Multimedia Solutions for Enriching Social Situational Awareness Sreekar Krishna Committee: Dr. Sethuraman (Panch) Panchanathan, Chair Dr. Baoxin Li Dr. Michelle (Lani) Shiota Dr. Gang Qian Dr. John Black ARIZONA STATE UNIVERSITY

  2. Scope of this dissertation Multimedia Technologies • Interactions between individuals • Physically isolated. • Sensory deprived. • Sensory overload. • Communication breakdown. • Evidence-based understanding of the social interaction enrichment technologies • Work on this

  3. Social Interactions Social Situational Awareness Face Body Social Cognition Social Reciprocation Social Hearing Voice Social Sight Social Touch Social Stimulation Social Stimulation Social Cognition Social Reciprocation

  4. SSA in Various Settings Remote Collaborations Social Assistance Decision Making TeamSTEPPS • Expressing Opinion • Managing Conflict • Making Decision • Speed of Decision • Interaction with Colleagues • Difficulty Establishing Rapport • How many people? • Where are they located? • What are their facial expressions? • Eye Gaze • Eye Contact • Body Mannerisms • Leadership • Mutual Support • Communication • Attitude • Situation Monitoring • Patient Safety

  5. Group Vs. Dyadic Interactions

  6. Case Studies of People who are Blind

  7. Self-Report Importance of Non-Verbal Cues Focus Group on 8 Social needs • 27 participants - 16 blind, 9 low vision and 2 sighted specialists.

  8. Contributions from this Dissertation Future work Focus 8 8 6 7 7 6 Ground Work in Social Assistance 3 5 Importance 1 4 3 2 5 2 1 4 High Feasibility

  9. Stereotypy • Any non-functional repetitive behavior • Two main causes for stereotypy • Lack of sensory feedback • Lack of cognitive feedback • Methods of control Stereotypy Body Rocking is the most prevalent stereotypy for people who are blind and visually impaired

  10. Proposed solution Rocking Z Non - Rocking Y Rocking action can be recognized with an accuracy of 94% within 2 seconds X Behavioral Psychology literature shows that one rock action is approximately 2.2 seconds long. Effectively, recognizing a rocking behavior well within one rock cycle.

  11. Social Gaze & Interaction Space Interpersonal Space 1.5’ 4’ 12’ 25’ 0’ Intimate Social Public Personal

  12. Modeling Distance & Direction through Face Detection Module 1: Color Analysis Module 3: Evidence Aggregation Module 2: Markov Random Field LPCD

  13. Structured Mode Searching Particle Filter (SMSPF) Step 1 Step 2 Initial Estimate Motivation: Weak Temporal Redundancy Motivation:ComplexObject Structure & Abrupt Motion Approach: Deterministic Search over a small probable search space (Histogram of Gradients with Chamfer Match) Approach: Stochastic Search over a large search space (Color Histogram Comparison) Result: Approximate Estimate Result: Accurate Estimate Example Search Windows Corrected Estimate

  14. Face/Person Detection/Tracking Face Detection Person Detection Tracking Model Deliver

  15. Social Scene Delivery System

  16. Social Scene Information Delivery Easy Learn Interaction Partner Number Easy Recall Haptic Annunciator System Distance Somatosensory Encoding Intuitive Direction Hard to Overlook

  17. Person Specific Feature Selection Chromosome:

  18. Person-Specific Feature Selection Fitness Function: Correlation Metric: Distance Metric:

  19. Design Considerations for Social Interaction Aid

  20. Group Interaction Assistant Miniature Motion Sensors Wearable Camera User Interface Haptic Belt

  21. Facial Expression

  22. Impact

  23. Awards & Recognitions

  24. Thanks

More Related