1 / 16

GESTURE BASED COMPUTING

GESTURE BASED COMPUTING. Team Members: D. Sai Goud - 08211A0569 Satya Swarup Sahoo - 08211A0574 G. Shivadeep - 08211A0576 Rohit Reddy - 07211A0561. Project Guide: Mr. B.RAVINDER Assistant Professor (CSE) Batch No .: CSB33. Agenda. Abstract Kinect

najila
Download Presentation

GESTURE BASED COMPUTING

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. GESTURE BASED COMPUTING Team Members: D. Sai Goud - 08211A0569 Satya Swarup Sahoo - 08211A0574 G. Shivadeep - 08211A0576 Rohit Reddy - 07211A0561 Project Guide: Mr. B.RAVINDER Assistant Professor (CSE) Batch No.: CSB33

  2. Agenda • Abstract • Kinect • Working with Kinect • iRobot Create • Working with Create • Integrating Kinect and Create • Use Case Diagram • Class Diagram • Implementation • Progress • Sample Code • Conclusion GESTURE BASED COMPUTING

  3. Abstract • Technology has advanced at a very higher rate in the recent years and has made lives of humans very easy and comfortable. In the field of electronics and computers, people have grown a higher affinity towards comfortable devices that involve very less interaction of the users. One such technology developed is the Gesture Based Computing, where users have minimal physical involvement. And this kind of computing uses sensors that can sense the user and detect the gestures made by the user. Hence, a good 3D sensor KINECT is used for this purpose. It is a 3D sensor which can capture the user's movements and make it computable by using its software development kit. It has its impact even in the field of robotics, where user can control and operate a robot with his gestures. GESTURE BASED COMPUTING

  4. Kinect: • Kinect is the product of Microsoft's Project Natal and launched in America on November 4th, 2010 • It's a well equipped 3D sensing device. It has sensors for RGB image, depth image, and multi-array microphone GESTURE BASED COMPUTING

  5. Kinect: GESTURE BASED COMPUTING

  6. Working with Kinect • Using Microsoft Visual Studio 2010 and Kinect SDK. • We don’t have any simulation environment while working on Kinect. • It supports many different Languages like VB.NET, C++, C#.NET. GESTURE BASED COMPUTING

  7. iRobot Create: GESTURE BASED COMPUTING

  8. iRobot Create: GESTURE BASED COMPUTING

  9. Working with iRobot Create: • Using Microsoft Robotics Developer Studio. • Real time and Simulation Environment while working with iRobot Create. • Support many different Languages like VB.NET, C++, C#.NET. GESTURE BASED COMPUTING

  10. Integrating Kinect and Create: User’s gestures are scanned by the Kinect and the corresponding action to be performed by the iRobot will be initiated to it via Bluetooth. GESTURE BASED COMPUTING

  11. Use Case Diagram: Getting connected through services Robot Make gestures Capture gestures from user User Convert the gesture to a functionality KINECT Perform the operation GESTURE BASED COMPUTING

  12. Class Diagram: Kinect skeleton; joints; User identifyGestures(); compute(); makeGestures(); performAction(); Robot _mainPort; getConnection(); performAction(); GESTURE BASED COMPUTING

  13. Implementation Details: GESTURE BASED COMPUTING

  14. Progress: • We have successfully provided functionalities to some gestures through which we can implement the usage of various keys of the keyboard (such as BACKSPACE, ARROW KEYS, TAB, etc.) • We have been successful in controlling a robot through our system. And are now working on integrating the gesture based computing in it and controlling the robot through our gestures. GESTURE BASED COMPUTING

  15. Conclusion A good part of our project is that it can be integrated with many user applications and reduce the physical involvement to a large extent. Currently we areintegrating it with the iRobot Create robot using the Microsoft Robotics Studio. The outcome of the project will provide the user with the power of controlling the robot using his/her gestures. GESTURE BASED COMPUTING

  16. Thank You !!

More Related