90 likes | 116 Views
3D Gesture-Based View Manipulator for Large Scale Entity Model Review. T. Xiao, L. Zhang, and M. Fei (Eds.): AsiaSim 2012, Part I, CCIS 323, Springer- Verlag Berlin Heidelberg 2012. Introduction.
E N D
3D Gesture-Based View Manipulatorfor Large Scale Entity Model Review T. Xiao, L. Zhang, and M. Fei (Eds.): AsiaSim 2012, Part I, CCIS 323, Springer-VerlagBerlin Heidelberg 2012
Introduction • Hand gesture-based Human Computer Interaction (HCI) is one of the most natural and intuitive methods of communication between humans and machinesbecause it closely mimics how humans interact with each other. • We developed a 3D gesture interface to manipulate the display of a 3D entity model.
Introduction • For gesture recognition • use theKinect as a depth sensor to acquire depth image frames • track the position of the user’s skeleton in each frame • By simple gestures • the user can pan, zoom, rotate, and reset the view and freely navigate inside the 3D entity model in the virtual space
An Overview of the Stereoscopic 3D Model Viewer • The system consists of • the SIMDIS , the stereoscopic 3D model viewer, a plug-in to connect the viewer to the SIMDIS, and the Microsoft Kinect sensor
View Manipulation by Gesture Interface • The OpenSceneGraph(OSG) Manipulator • The OSG library controls the virtual scene using amanipulator • A manipulator consists of a camera for the user viewpoint and commands (e.g., translation, rotation and zoom)for camera movement that are controlled by the user through input devices • The OSG toolkit offers trackball, flight, drive, terrain, orbit and spherical manipulators • offer different capabilities • switch between them according to the characteristic of the virtual scene
View Manipulation by Gesture Interface • User Tracking Using the Kinect • dynamic gestures characterized by the spatial-temporal motion structures in frame sequences to discriminate between actions • provide an unambiguous method for specifying the start and end points of gestures, both in time and space, the gesture interface adopts the concept of an activation area
View Manipulation by Gesture Interface • Gesture Interaction for View Manipulation • RightHand:Rotating • LeftHand :Panning • TwoHands :Zooming & Reset
Conclusions • The 3D gesture interface • control the view of the 3D model with hand gestures in real-time and without using special input devices • Questions • the issue of rapid onset of fatigue remains a problem when using gesture interactions for precise control • only four hand gesture interactions • allows only a single user to manipulate the view