1 / 25

Kinect Development

Kinect Development. By: Richard Isely III. Outline. What is the Kinect History How it started Microsoft Project The Components of the Kinect What they are/How they work Development Issues Solution Hacking the Kinect OpenKinect Microsoft SDK Demo. What is the Kinect?.

bette
Download Presentation

Kinect Development

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Kinect Development By: Richard Isely III

  2. Outline • What is the Kinect • History • How it started • Microsoft Project • The Components of the Kinect • What they are/How they work • Development Issues • Solution • Hacking the Kinect • OpenKinect • Microsoft SDK • Demo

  3. What is the Kinect? Image from: http://uncrate.com/p/2010/11/kinect-xl.jpg

  4. History • It all started with the Wii • Moore’s Big Plans • Project loses momentum

  5. Project Natal • Alex Kipman takes over project • PrimeSense Chosen to Create Prototype • Demo for Executives

  6. Components of the Kinect Image From: http://guide-images.ifixit.net/igi/xKZqFJXNYEGTvYbI.medium

  7. Components of the Kinect • Major components • IR Projector • IR Camera • VGA Camera • Microphone Array • Motorized Tilt Image From: http://www.everybodyplays.co.uk/images/screenshots/picsforarticles/kinect.jpg

  8. VGA Camera • Allows the Player to be shown on screen. • Take still shots.

  9. Microphone Array • Four Microphones • Position Detection • Noise Cancelation http://social.microsoft.com/Forums/getfile/18629/

  10. Microphone Array(Development Issue) • Voice Recognition • Background Noise • Various Accents

  11. Microphone Array(Solution) • Background Noise • MSR Team develops Audio processing Solution • Audio Processing Tricks • Various Accents • Acoustical Model built into the Array

  12. Motorized Tilt • Built into the base of the Kinect • 54 Degree tilt range • 27 Degrees up • 27 Degrees down • Records Actual angle of Kinect

  13. IR Projector and Camera(Depth Sensor) • What’s being projected • Time of Flight • How the Kinect does it Image From: http://bbzippo.files.wordpress.com/2010/11/dsc00014s_thumb.jpg?w=700&h=528

  14. IR Projector and Camera (Depth Sensor) Continued • ps1080 Chip • What it produces • Depth Image Image From: http://www.primesense.com/images/technology/Chip_Diagram.gif

  15. Using the Depth Image • Pixel Data • 16-bit number • Depth Data • Given in millimeters • Player Data • Range 0-6

  16. Depth Image(Development Issue) • Initializing Recognition • Losing Player Mid-Game • Body Type Issue

  17. Depth Image(Solution) • Breaking up the data • From 1 Blob to 31 body parts • Body parts to joints • Joints to Skeletal image • Decision Tree

  18. Depth Image(Solution)

  19. Depth Image(Solution)

  20. Hacking the Kinect • Race to create a driver • Bounty set • Cracked in 7 days • OpenKinect • PrimeSense Releases Libraries

  21. Microsoft SDK • First Release (June 17th, 2011) • Skeletal Recognition • Voice Recognition • Beta Version • Latest Release and new Kinect • Near mode • Commercial Development • C++, C#, and VB

  22. Demo

  23. Conclusion • What the future may hold • Possible Application • Cheap form of motion detection • Commercial Availability

  24. Sources • [1] Ashley, James and Jarrett Webb. Beginning Kinect Programming with the Microsoft Kinect SDK. Apress, 2012. [eBook]. • [2] Hall, Jonathan, Sean Kean, and Phoenix Perry. Meet the Kinect: An Introduction to Programming Natural User Interfaces. Apress, 2011. [eBook] • [3] Borenstein, Greg. Making Things See: 3D vision with Kinect, Processing, Arduino, and MakerBot. Make, 2012. [eBook] • [4] “Kinect for Windows.” Microsoft Support. Sat. 10 Mar. 2012. <http://support.xbox.com/en-US/kinect-for-windows/kinect-for-windows-info>

  25. Sources (continued) • [5] “OpenNI.” PrimeSense. Sun. 11 Mar. 2012. <http://75.98.78.94/default.aspx> • [6] “About PrimeSense.” PrimeSense. Sun. 11 Mar. 2012. <http://www.primesense.com/en/company-profile> • [7] “OpenKinect: About.” OpenKinect. Sat. 17 Mar. 2012 <http://openkinect.org/wiki/Main_Page> • [8] “Kinect for Windows Quickstart Series.” Channel9. By: Dan Fernandez. Sat. 17 Mar. 2012 <http://channel9.msdn.com/Series/KinectQuickstart>

More Related