1 / 25

Exploring Kinect Development: History, Components, Solutions, and Demos

Dive into the world of Kinect development with this comprehensive guide covering the history, components, development issues, solutions, and hacking possibilities of Kinect. Learn about major components like the IR projector, cameras, and microphone array, as well as solutions to development challenges such as background noise in voice recognition. Discover how the Kinect's depth sensor works and how it enables skeletal recognition. Explore the hacking community around Kinect, including OpenKinect and the Microsoft SDK. The demo showcases the capabilities of Kinect, including skeletal and voice recognition, in different programming languages. Get insights into the future possibilities and commercial applications of Kinect technology. Sources for further learning are provided for those interested in delving deeper into Kinect development.

vinson
Download Presentation

Exploring Kinect Development: History, Components, Solutions, and Demos

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Kinect Development By: Richard Isely III

  2. Outline • What is the Kinect • History • How it started • Microsoft Project • The Components of the Kinect • What they are/How they work • Development Issues • Solution • Hacking the Kinect • OpenKinect • Microsoft SDK • Demo

  3. What is the Kinect? Image from: http://uncrate.com/p/2010/11/kinect-xl.jpg

  4. History • It all started with the Wii • Moore’s Big Plans • Project loses momentum

  5. Project Natal • Alex Kipman takes over project • PrimeSense Chosen to Create Prototype • Demo for Executives

  6. Components of the Kinect Image From: http://guide-images.ifixit.net/igi/xKZqFJXNYEGTvYbI.medium

  7. Components of the Kinect • Major components • IR Projector • IR Camera • VGA Camera • Microphone Array • Motorized Tilt Image From: http://www.everybodyplays.co.uk/images/screenshots/picsforarticles/kinect.jpg

  8. VGA Camera • Allows the Player to be shown on screen. • Take still shots.

  9. Microphone Array • Four Microphones • Position Detection • Noise Cancelation http://social.microsoft.com/Forums/getfile/18629/

  10. Microphone Array(Development Issue) • Voice Recognition • Background Noise • Various Accents

  11. Microphone Array(Solution) • Background Noise • MSR Team develops Audio processing Solution • Audio Processing Tricks • Various Accents • Acoustical Model built into the Array

  12. Motorized Tilt • Built into the base of the Kinect • 54 Degree tilt range • 27 Degrees up • 27 Degrees down • Records Actual angle of Kinect

  13. IR Projector and Camera(Depth Sensor) • What’s being projected • Time of Flight • How the Kinect does it Image From: http://bbzippo.files.wordpress.com/2010/11/dsc00014s_thumb.jpg?w=700&h=528

  14. IR Projector and Camera (Depth Sensor) Continued • ps1080 Chip • What it produces • Depth Image Image From: http://www.primesense.com/images/technology/Chip_Diagram.gif

  15. Using the Depth Image • Pixel Data • 16-bit number • Depth Data • Given in millimeters • Player Data • Range 0-6

  16. Depth Image(Development Issue) • Initializing Recognition • Losing Player Mid-Game • Body Type Issue

  17. Depth Image(Solution) • Breaking up the data • From 1 Blob to 31 body parts • Body parts to joints • Joints to Skeletal image • Decision Tree

  18. Depth Image(Solution)

  19. Depth Image(Solution)

  20. Hacking the Kinect • Race to create a driver • Bounty set • Cracked in 7 days • OpenKinect • PrimeSense Releases Libraries

  21. Microsoft SDK • First Release (June 17th, 2011) • Skeletal Recognition • Voice Recognition • Beta Version • Latest Release and new Kinect • Near mode • Commercial Development • C++, C#, and VB

  22. Demo

  23. Conclusion • What the future may hold • Possible Application • Cheap form of motion detection • Commercial Availability

  24. Sources • [1] Ashley, James and Jarrett Webb. Beginning Kinect Programming with the Microsoft Kinect SDK. Apress, 2012. [eBook]. • [2] Hall, Jonathan, Sean Kean, and Phoenix Perry. Meet the Kinect: An Introduction to Programming Natural User Interfaces. Apress, 2011. [eBook] • [3] Borenstein, Greg. Making Things See: 3D vision with Kinect, Processing, Arduino, and MakerBot. Make, 2012. [eBook] • [4] “Kinect for Windows.” Microsoft Support. Sat. 10 Mar. 2012. <http://support.xbox.com/en-US/kinect-for-windows/kinect-for-windows-info>

  25. Sources (continued) • [5] “OpenNI.” PrimeSense. Sun. 11 Mar. 2012. <http://75.98.78.94/default.aspx> • [6] “About PrimeSense.” PrimeSense. Sun. 11 Mar. 2012. <http://www.primesense.com/en/company-profile> • [7] “OpenKinect: About.” OpenKinect. Sat. 17 Mar. 2012 <http://openkinect.org/wiki/Main_Page> • [8] “Kinect for Windows Quickstart Series.” Channel9. By: Dan Fernandez. Sat. 17 Mar. 2012 <http://channel9.msdn.com/Series/KinectQuickstart>

More Related