1 / 45

Connect with your

Connect with your. Wow!. 3D Depth Sensors. Microphone Array. Motorized Tilt. RGB Camera. openkinect.org. www.openni.org. kinectforwindows.org. Kinect for Windows. Xbox Kinect. You’ll need this. That’s not USB. What you Need. SDK. Demo 0 Hello Tilt. BGR32 Format. Byte Array:.

habib
Download Presentation

Connect with your

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Connect with your

  2. Wow!

  3. 3D Depth Sensors Microphone Array Motorized Tilt RGB Camera

  4. openkinect.org www.openni.org kinectforwindows.org

  5. Kinect for Windows

  6. Xbox Kinect You’ll need this That’s not USB

  7. What you Need SDK

  8. Demo 0 Hello Tilt

  9. BGR32 Format Byte Array: 4 Bytes Per pixel Stride= Bytes Per Row = bytes per pixel * width = 4 * width width in pixels height in pixels

  10. Demo 1 Hello Colorful World

  11. Depth data 500mm 500mm 500mm 500mm 500mm 500mm 500mm 2500mm 2000mm 2000mm 2030mm 2010mm

  12. Depth data Max resolution for raw depth data is 640 x 480 2 bytes per pixel of depth data (short) • 000 00001 11101010 11011110 00001 11101010 • 000 • 000 00000 pixel pixel pixel depthInMM = pixel >> DepthImageFrame.PlayerIndexBitmaskWidth

  13. Demo 2 Depth

  14. Depth + Player Data SkeletonStream.Enable(); player 1 player 1 player 1 player 1 500mm 500mm 500mm 500mm player 1 player 1 player 1 500mm 500mm 500mm 2500mm 2000mm 2000mm 2030mm 2010mm var player = pixel & DepthImageFrame.PlayerIndexBitmask; 11011110 00001 • 010

  15. Demo 3 Depth + Player Data

  16. Skeletal Tracking

  17. from skeleton inskeletonFrame.Skeletons whereskeleton.TrackingState == SkeletonTrackingState.PositionOnly skeletonFrame.Skeletons skeletonFrame.Skeletons whereskeleton.TrackingState == SkeletonTrackingState.Tracked

  18. hand_right hand_left head wrist_right wrist_left shoulder_center elbow_left elbow_right shoulder_left shoulder_right Skeleton.Joints[JointType] spine hip_right hip_left hip center Joint.Position (X,Y,Z) Skeletons are mirrored X, Y, Z in meters Origin(0,0,0) = center of camera. +Z is out +X is to the right +Y is up knee_right knee_left ankle_right ankle_left foot_left foot_right

  19. Demo 3 Skeletal Tracking

  20. Composites + + Color

  21. Composites Color + MapSkeletonPointToColor MapDepthToColorImagePoint Color + MapDepthFrameToColorFrame MapDepthToSkeletonPoint + MapSkeletonPointToDepth

  22. Demo 4 Green Screen

  23. Kinect Audio

  24. Echo Cancellation

  25. Echo Cancellation • EchoCancellationMode: None, CancellationOnly, CancellationAndSuppression • intEchoCancellationSpeakerIndex: Index of speaker to cancel

  26. Noise Suppression

  27. Noise Supression • boolNoiseSuppression – true, false

  28. Automatic Gain Control

  29. Automatic Gain Control • boolAutomaticGainControl– true, false

  30. Beam Forming

  31. Beam Forming 0.875 radians 50 degrees -0.875 radians -50 degrees .0175 radians 10 degrees

  32. Demo 5 Speech Recognition

  33. Audio @!%!#!! Gotchas Must run in an MTA AEC SystemModes crash if no speaker output. Use Microsoft.Speech not System.Speech DevicePairGuid / Qualitymetrics= crash Should run in ThreadMode Priority Highest? Must plug Kinect into Wall

  34. Demo 6 Beam Forming

  35. Kinect SDK 1.5! Seated Skeletal Tracking Kinect Studio Face Tracking Joint Rotation

  36. Creative Commons Acknowledgments • Flickr by Ian Lewis • Flickr by major nelson • Flickr by markodesign • Flickr by stephantom • Flickr by Abstract Machine • Flickr By Aixo.co.kr • Flickr By Andresmh • Flickr by Antony Bennison • Flickr by Ars Electronica • Flickr By bm.iphone • Flickr by campuspartymexico • Flickr by Chris Jagers • Flickr By ci_polla Paola Sucato • Flickr by creepyhalloweenimages • Flickr by cvander • Flickr by IMAL.org • Flickr by Institut Douglas • Flickr by Joshua and AmberFlickr by Logon Sakai • Flickr by openexhibits • Flickr by Paul_Clarke • Flickr by petyr.rahl • Flickr by pt • Flickr by Stilldavid • Flickr by y3rdua • Flickr by yesyesnono • Flickr by yum9me • Flickr by Jeff Howard • Flickr by jhscreenwm • Flickr by Kyle McDonald • Flickr by Morten Rand-Hendriksen • Flickr by Stuart Herbert • Flickr by Visiophone • Flickr by orkomedix • Michael Zöllner and Stephan Huber at the University of Konstanz • Openclip by J_Alves • Openclip by jetxee • Openclip by molumen • Openclip by shokunin • Openclip by Jhnri • Openclip by Machovka • Adafruit image of Hector Martin Thanks!!

More Related