Download
1 / 28
280 likes | 523 Views
Provide "Out Together Feeling" by Sharing Panorama Iive Image between Outdoor and Indoor Users. Ching-Tzun Chang, Shin Takahashi and Jiro Tanaka IPLAB Department of Computer Science, University of Tsukuba, Japan. Backgrounds.
E N D
Provide "Out Together Feeling" by Sharing Panorama Iive Image between Outdoor and Indoor Users Ching-Tzun Chang, Shin Takahashi and Jiro Tanaka IPLAB Department of Computer Science, University of Tsukuba, Japan
Backgrounds • Most video communication system are focus on face and body(Skype and etc…). • Most of video communication system are executed indoor, hard to use them at outside • We found users may want to focus on other information, such as someone’s surroundings, gestures, or to both look at something. • However, we found most video communication system cannot satisfy this requirement Here, we purposed… • A new system that focus to one's environment and his facing direction and provide the feeling of go out together with remote user
The Out Together Feeling • Two people, an indoor user and an outdoor user • Share an experience as they were both outdoors together and equally feel doing something together with each other • It is a kind of telepresence technology for use in outdoor environments
Elements to Realizing Out Together Feeling • We defined the 3 basic elements to realize the Out Together Feeling as following • Indoor user can look around the environment of the outdoor user • Both user can knows where theother user is facing to • Gestures Communication Indoor user look around the remote environment Knows each other’s facing
Our Early Work - WithYou System • Indoor user wears HMD and watches live video from a pan/tilt/zoom (PTZ) camera mounted on the outdoor user’s chest • Indoor and outdoor user can know where the other user is looking by watch GUI and PTZ camera Direction of camera is linked to direction of indoor user’s head Outdoor User in WithYou
Related Work • Telecommunicator: A Novel Robot System for Human CommunicationsYuichi Tsumaki, Yutaro Fujita, Akiharu Kasai, Chiaki Sato, Dragomir N. Nenchev, and Masaru Uchiyama, Proceedings of the 11th IEEE International Workshop on Robot and Human Interactive Communication, pp. 35-40 (2002). • Telecommunicator is a wearable robotic device mounted on the user's shoulder • Consists of a pan-and-tilt video camera and a simple arm • Local-site user wears an HMD and controls a camera mounted on the remote site user by turning his or her head Robot mounted on user’s shoulder Local-site user wears an HMD and sees Live image of remote side
Related Work • MeBot: A robotic platform for socially embodied telepresenceSigurdur OrnAdalgeirsson, and Cynthia Breazeal, Proceedings of the 5th ACM/IEEE international conference on Human-robot interaction (2010). • Mebot is a telepresence robot to provide social expression • Two arms and a head with pan-and-tilt ability • A smartphone mounted on robot's head to show the face of the indicator Mebot V4 operator control the robot's head by moving their head
WithYou2 A system to realize Out Together Feeling
WithYou2System • Indoor user wears an HMD can view 360º panoramic live video images from two cameras placed on the outdoor user’s shoulder • The outdoor user wears a see-through type HMD and see an image of the indoor • Provide the outdoor/indoor user’s view, image of face and gesture to each other in the same time 360º panoramic live video images
Indoor user’s facing direction on GUI Indoor user facing to right 45 degrees Indoor user facing to right 90 degrees Indoor user facing front
Outdoor user’s facing direction on GUI Outdoor user facing right 45 degrees Outdoor user facing right 90 degrees Outdoor user facing front
Interaction Method Free view for indoor and outdoor user Sharing the focus& Joint Attention Gesture Interaction
Free viewing for indoor user • Indoor user can look at the outdoor user's surroundings by turning his head • Indoor user also can see the image and the view of outdoor user WithYou2 System
Free viewing for outdoor user Outdoor user can see following images in his HMD • Indoor user’s image • Indoor user’s View Indoor user’s image Indoor user’s view
Sharing the Focus • User knows each other’s facing by checking GUI or watch the image of remote user Focus Detection • We assumed an user was in "focusing" mode if his or her gaze remained static for more than 2 seconds Joint Attention • When one user is in focusing somewhere and the other is facing the same direction • System sends a notification to both users and help user knows the other user is also looking at the same direction
Indoor user Flow of Joint Attention Live image Indoor user facing front Indoor user facing left and focused on the object Outdoor user Outdoor user noticed whatindoor user is focusing Outdoor user facing front Outdoor user also facing to left (look at the object) STEP1 STEP2 STEP3
Remote Image Gesture Interaction Self Image Outdoor user’s gesture • Indoor user can sees outdoor user’s gesture via camera Indoor user’s gesture • Gestures image overlaid to remote imageIndoor User’s image is overlaid to remote image • Pointing with fingerControl the view area by pointing with the controller Gestures image overlaid to remote image Pointing by finger gesture
Purpose of Experiment • Determine the achievement of Out Together Feeling and effectiveness of interaction methods in our system • Seven subjects (six pairs by two examinees reversed their roles) • One subject(outdoor user) went outside, the other subject (indoor user) remained indoors • Subjects were asked to buy something by discuss with the remote user, and they were told to use the system freely to achieve their jobs.
Photo of experiment Outdoor User Indoor User The frame rate of the video during the experiment in the range 1–6 FPS
3.75 Result of Experiment (Questionnaire) 4.2 I felt a sense of Out Together Feeling with my remote partner 4.25 Meaning of point5: Strong agree 4: Agree 3: Neither of them 2: Disagree 1: Strong Disagree 4.6 I was able to see the face of remote user 3.25 3.8 Do you think that looking the face of remote user improves the Out Together Feeling with remote user? 3.75 4.6 Did you understand the information displayed on the GUI? 4.75 Did you able to determine what the indoor user was looking at?
Result • Result of the experiment showed both users felt Out Together Feeling to a greater extent • Outdoor users were able to see the image that the indoor user is currently viewing • Both users were able to see the face and view of indoor user • Overall, WithYou2 was evaluated positively by the subjects, and were able to overcome many of the problems of the WithYou system.
CONCLUSION • We provided a video communication system called WithYou2, which provides an enhanced and more equal level of the Out Together Feeling • Compared with our previous system, WithYou2 provide more information and interaction methods to outdoor and indoor users. • We carried out a experiment of our system, which was evaluated positively by the subjects • WithYou2 system had overcome problems of the WithYou system.
