1 / 26

Analyzing Interactions between a Pair Out Together Real and Virtual

Analyzing Interactions between a Pair Out Together Real and Virtual. Ching-Tzun Chang, Shin Takahashi and Jiro Tanaka IPLAB Department of Computer Science, University of Tsukuba, Japan. Backgrounds. Most video communication system are focus on face and body(like Skype and etc…)

wesley
Download Presentation

Analyzing Interactions between a Pair Out Together Real and Virtual

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Analyzing Interactions between a Pair Out Together Real and Virtual Ching-Tzun Chang, Shin Takahashi and Jiro Tanaka IPLAB Department of Computer Science, University of Tsukuba, Japan

  2. Backgrounds • Most video communication system are focus on face and body(like Skype and etc…) • Most of video communication system are executed indoor, hard to use them at outside Here, we purposed… • Provide the feeling of go out together with remote user – we called “Out Together Feeling” • Execute experiments to find the best interaction method to provide “Out Together Feeling”

  3. The Out Together Feeling • 2 user in a pair, indoor user and outdoor user • Feel to go out together with remote user To realize it, we needed • Indoor user can look around the environment of the outdoor user • Indoor user can knows where theoutdoor are facing to • Outdoor user can also knows where the indoor user are facing to • A Prototype system – WithYou to provide “Out Together Feeling” Indoor user look around the remote environment Knows each other’s facing

  4. System Overview

  5. Demo

  6. Interaction Method Free view for indoor user Sharing the focus Joint Attention

  7. Free view for indoor user • If indoor user turns his head to right, camera will turns to right too • Camera remains its facing even outdoor user turns around

  8. Sharing the focus Indoor user to outdoor user Indoor user Outdoor user knows indoor user’s facing by • Check out the camera directly • Check out LCD display (lines on top) Outdoor user Showed on GUI GUI Camera turns Facing of indoor user Notify to outdoor user

  9. Outdoor user to indoor user Indoor user knows outdoor user’s facing by • Check out the information on GUIRedline means the facing direction of outdoor user Outdoor user HMD GUI Showed on GUI Red Line Graph Facing of outdoor user Indoor side GUI

  10. Joint Attention • Concept : When you are looking at something and I am also try to look at it too • Let the indoor user & outdoor user focus on the same direction • Joint Attention help user knows remote user are also looking at the same direction

  11. Indoor user Flow of Joint Attention Live image Indoor user facing front Indoor user facing right and focused on the object Outdoor user Camera facing to right and outdoor user noticed it Camera facing front Outdoor user also facing to right (look at the object) STEP1 STEP2 STEP3

  12. Then • Joint attention activated • Play sound & show message to inform both indoor and outdoor user

  13. Experiment

  14. Purpose of experiment • To decide the best methods of interaction to provide the Out Together Feeling, We like to knows following issues • How people communicate with each other in real • When use videophone to go out together virtually, how they overcome problems • Compared to 1 & 2 and find the advantages and disadvantages of our prototype system – WithYou

  15. Experiment Design 3 Experiment • People go outside together in real • People go outside together virtually by videophone • People go outside together virtually by our system-With You Condition • We let examinee go shopping in the street in real & virtual(Place : Akihabara Electric Town, Tokyo, Japan) • Examinees may chose their own mission target freely(like buy or survey something) • 2 pair of examinees participated • We observe communication skills & interaction method between examinees during the experiment

  16. Experiment A • 2 examinees went shopping together as usual • They have 20 minutes to achieve their own mission target • 2 staff followed them1 took video record Another staff observed & noted the examinee’s actions & communication skills Scene from experiment A

  17. Result of Experiment A • We observed several important communication skills • Check partner's facing then look together 10.4Times/10Min • Pointing with a finger 4.6Times/10Min • Look where the partner is focusing4.6Times/10Min • Turn around to check partner is following 3.9Times/10Min • Pick something up and look at it together 3.3Times/10Min • Describe by gesture 2.6Times/10Min By these results, we knows • Knows the facing direction of each other is important • Hand gesture is also important

  18. Video Record of Experiment A

  19. Experiment B • Use videophone call to go out together virtually • Evaluated at a shopping center, indoor user stay in rest place & outdoor user went to shopping floors by indoor user’s request Outdoor User Indoor User

  20. Result of Experiment B (1/2) We observed several important communication skills • Outdoor user shows product information(price, etc) to indoor user via camera 7.5Times/10Min • Outdoor user read the price/information for indoor user 4.0Times/10Min • Indoor user requests outdoor user to move somewhere 4.0Times/10Min • Outdoor user finding product for indoor user 3.5Times/10Min • Indoor user requests to turn the camera 3.0Times/10Min Problems • The shooting direction is fully controlled by the outdoor user • Indoor user is difficult to know where the outdoor user is moving

  21. Result of Experiment B (2/2) Questionnaire results • Q: Is videophone suitable for realizing the Out Together Feeling?A: Outdoor user: disagree, indoor user: disagree Comments from examinees • Q: Please give your general impression of this experiment • A: Outdoor user turns camera  indoor user checks the live image and requests the outdoor user to turns camera again • A: No time to look at the indoor user • A: I felt no different from a voice call • A: Due to the low image quality and poor focus, small text on products was difficult to read.

  22. Experiment C • Use our system – WithYou to go out together virtually • Indoor user stay in a car, outdoor user goes out • Indoor user choose his own mission target(buy or survey something) Indoor User Outdoor User

  23. Questionnaire Result of Experiment C • Q: Did you feel doing something together with remote partners?Outdoor user: Agree=1, Neither of them=1Indoor user: Agree=1, Neither of them=1 • Q: Did you looked around the surroundings freely?Indoor user: Agree=1, Neither of them=1 • Q: Do you think "Joint attention" improved activities with remote partners?Outdoor user: Agree=1, Neither of them=1Indoor user: Agree=1, Neither of them=1

  24. Related Work • Teroos by Kashiwabara et al. • A wearable avatar is remote-controlled by the local user • Avatar with pan-tilt-roll camera and a rotatable eye • Compare to Related Work • We focused on the interaction method of “facing direction” • Indoor user can look around by turning his head but not by keyboard or mouse • For greater telepresence, We use an HMD to build an immersive space Avatar mounted on shudder Control interface of local user

  25. CONCLUSION • We performed 3 experiments to know what types of communication skills people take when 1. They actually go outside together2. Go out together virtually by videophone3. Go out together virtually by our system – WithYou • We collected the result of experiments and analyzed the advantage & disadvantages of each experiment • Based on experiment's results, we will improve our system in the future

  26. Thank you for your kindly attention

More Related