330 likes | 511 Views
KINECT CONTROLLED PC. George (Hank) Schultz Eastern Kentucky University NET Program. OUTLINE. My presentation explores the possibility of what is possible with the Microsoft Kinect I’ll cover what people around the world are doing with Kinect functionality
E N D
KINECT CONTROLLED PC George (Hank) Schultz Eastern Kentucky University NET Program
OUTLINE • My presentation explores the possibility of what is possible with the Microsoft Kinect • I’ll cover what people around the world are doing with Kinect functionality • Also, go over the history of Kinect ‘hacking’
OUTLINE • I’ll discuss some interesting articles I found on the subject • Will talk about my project • Show a video • Take questions
MOTIVATION • Biggest motivation is interest • I have read a lot of information online prior and wanted to research further • There have been many great projects done in the past
Motivation • Happened to have a Kinect that I didn’t use a lot • A lot of great resources and articles on the topic online
introduction • Microsoft released the Kinect in November of 2010 • Originally only for use with the Xbox 360 • Not long after release people were already looking for exploits • Within six months hundreds of different hacks were out
Introduction • Most of research done was through discussion boards and forums • Other research was articles written on the topic of using the Kinect with the PC
Problem statement • What I wanted to with my project was be able to control a PC in some fashion using the Kinect • Basically, what I wanted to do, was emulate in some form what I had seen so many others do. • How can I use my Kinect device that I got for my Xbox, as a PC controller?
assumptions • I assumed it would have been a lot more difficult to interface the Kinect with my PC • Initially it was not difficult, but I was unable to do as much with it as I initially wanted.
Proposed solution • My final project is able to use the Kinect as a mouse (with limited functionality) • Easy to use and activate program • Combined with other programs to get to work correctly • End result works great! • Help from the following programs
Proposed solution • OpenNI • Program to start testing drivers • Helpful with Kinect hacking • Open source Kinect framework for PC
Proposed solution • PRIMESENSE • NITE • This software helps the Kinect view what it sees as a 3D space, which is neccesary to recognize the user and the user’s commands
Proposed solution • This program really drives the whole project • After everything is set up, this one powers the Kinect and is the interface between it and the computer
results • After much research, troubleshooting, uninstalling, reinstalling, and messing around with the different software and drivers, I was able control my PC with the Kinect
results • My original plan was to have a media center controlled Kinect, but I did not have the resources I thought I did, but included is a clip of somebody else’s • clip
results • Here is a video of me setting everything up and actually controlling my PC with the Kinect • And yes before you ask, I felt a little like a Jedi. • Clip -excuse the watermark, I had to reduce size and this was the only way that worked
results • As I stated earlier there are a lot really interesting projects going on with the Kinect right now, I’ll share a few of them with you right now. • NAVI3D-Image
conclusions • Before I started this project, I just had a passing interest in Kinect ‘hacking’ • After actually doing it myself, and seeing what others have done, I will definitely keep up on the research, and continue to see what else I can do with the Kinect
conclusions • I learned a lot about trouble shooting • Through this project I gained a lot of knowledge of forums and message boards and was able to obtain a lot of help using them.
conclusions • I think that this type of technology will only get more advanced, and used more widely as time goes on. • Kinect technology has already improved the field of robotics quite a bit.
Future work • I really enjoyed working on this project, and even though I basically just have the beginning framework done, I’m excited to see what else I can do. • Eventually, when I have more resources I’d like to something like this.
Future work • Other ideas • Kinect controlled room, lights, fan, media center etc. • 3D model capturing • Add voice control
Future work • Any questions or suggestions?
contact • My name is Hank Schultz • My permanent email address ishank3hank@gmail.com
Project references • Fish, E. (2011, June 4). Kinect Hack Creates Actual 3D Telepresence. Retrieved March 26, 2012, from PCWorld: http://www.pcworld.com/article/229405/kinect_hack_creates_actual_3d_t elepresence.html • Giles, J. (2010). Inside the race to hack Microsoft's Kinect. New Scientist. • Jared. (2011, February 2). Beginners Guide to Setting Up Your Microsoft Kinect for Windows PC Hacking. Retrieved March 22, 2012, from KINECT- HACKS: http://kinect.dashhacks.com/kinect- guides/2011/02/02/beginners-guide-setting-your-microsoft-kinect- windows-pc-hacking • Joel. (2011, January 17). Control Windows Games & Apps with an XBoxKinect camera. Retrieved March 27, 2012, from Kinemote: http://www.kinemote.net/community/viewtopic.php?f=12&t=24 • Pirrilo, C. (2011, June 24). How to Hack Kinect (Officially). Retrieved March 22, 2012, from YouTube: http://www.youtube.com/watch?v=-j8y4iMYxSI • Tanz, J. (2011, June 28). Kinect Hackers Are Changing the Future of Robotics. Retrieved 22 March, 2012, from Wired: http://www.wired.com/magazine/2011/06/mf_kinect/all/1
Video references • Griffindod. (2010 December 23). KinEmote Control Windows Media Center, Boxee, XBMC & more Microsoft Kinect. Retrieved April 29, 2012, from Youtube: http://www.youtube.com/watch?v=3y0JT0xR_a4 • HCiKonstanz. (2011 March 22). NAVI -- Navigational Aids for the Visually Impaired. Retrieved April 29, 2012, from Youtube: http://www.youtube.com/watch?feature=player_embedded&v=l6QY- eb6NoQ • Ikaziso. (2011 January 12). Control the Humanoid Robot by Kinect. Retrieved April 20, 2012 from Youtube: http://www.youtube.com/watch?v=w8BmgtMKFbY • KinectHacks. (2012 November 14). Using Kinect to Capture Video in 3D. Retrived April 29, 2012 from Youtube: http://www.youtube.com/watch?v=KW9of1Ud0uo
Image acknowledgements • Taken from www.xbox.com • Taken from www.xbox.com • Taken from http://75.98.78.94/default.aspx
Image acknowledgements • Taken from www.kinemote.net • Taken from http://timstephenson.blogspot.com/2010/11/return-of-jedi.html