140 likes | 313 Views
Creative Uses for Kinect in Teaching. Rob Miles Department of Computer Science. The Kinect Sensor . Microsoft Kinect was released in 2011 as a new kind of controller for the Xbox 360 Great Kinect games include “Kinect Sports”, “Dance Central 2” and “ Gunstringer ”. Inside a Kinect Sensor.
E N D
Creative Uses for Kinect in Teaching Rob Miles Department of Computer Science Teaching with Kinect
The Kinect Sensor • Microsoft Kinect was released in 2011 as a new kind of controller for the Xbox 360 • Great Kinect games include “Kinect Sports”, “Dance Central 2” and “Gunstringer” Teaching with Kinect
Inside a Kinect Sensor • The Kinect contains two cameras, an infra-red projector and four microphones • Software can use video, sound and gesture recognition driven interactions Teaching with Kinect
Kinect Video Camera • The Kinect sensor contains a high quality video camera which can provide up to 1280x1024 resolution at 30 frames a second Teaching with Kinect
Kinect Depth Sensor • The Kinect depth sensor uses an IR projector and an IR camera to measure the depth of objects in the scene in front of the sensor IR Projector IR Camera Teaching with Kinect
View from the Depth Sensor • The image on the right shows the depth camera view of a scene • The sensor projects an array of infra-red dots Teaching with Kinect
From Dots to Depth • The pattern of dots that is used to measure depth may look random but it is repeatable • The further away the dot is reflected, the more it is displaced in the image the camera sees Teaching with Kinect
Depth Camera Limitations • Because of the way the camera works some parts of the scene will be in “shadow” and their distance can’t be measured • The resolution of the camera reduces as objects get further away from the sensor • The camera interpolates distances between the points it can read Teaching with Kinect
The Kinect Microphones • The Kinect sensor contains four microphones • These can perform background noise cancelling • Allow a program to determine the direction to a sound source Teaching with Kinect
Kinect for Windows • The Xbox 360 version of the sensor is optimised for tracking people playing a game • Between 80cm and 4M from the sensor • The Kinect for Windows sensor has a wider range • Between 40cm and 4M from the sensor • The Kinect for Windows sensor can be used to track individual fingers in gestures Teaching with Kinect
Making Kinect for Windows applications • If you want to sell products based on the Kinect sensor you should base these on the Kinect for Windows platform • The Kinect for Xbox sensor will work, but it should be used for personal development only, not as the basis of product development Teaching with Kinect
The Kinect for Windows SDK • You can download the Kinect for Windows SDK from www.kinectforwindows.org/ Teaching with Kinect
Using the Kinect for Windows SDK • The SDK works with either the Xbox or Windows sensor bar • You will get a warning if you use an Xbox 360 sensor Teaching with Kinect