Unleashing Creativity With the Xbox Kinect

1. Unleashing Creativity With the Xbox Kinect A Microsoft Mindsumo ChallengeSubmission By Grant Buster Design Engineering Collaborative at UC Berkeley

2. For this challenge I focused on: • Using the Xbox Kinect to: • Create an empowered design tool • Promote 3D artistic expression • Make freeform modeling capable and fun • Remove limits on creative expression Design Engineering Collaborative at UC Berkeley

3. Traditional sketching is… • Beautiful • Freeform • Limited to a 2D plane Design Engineering Collaborative at UC Berkeley

4. 3D printing pens (3Doodler) are… • Awesome for sketches but cannot make computer models Design Engineering Collaborative at UC Berkeley

5. Current 3D modeling software is great at… • Engineering modeling • Extrusions • Rotations Design Engineering Collaborative at UC Berkeley

6. Current 3D modeling software is also bad at… • Abstract shapes • 3D Art Design Engineering Collaborative at UC Berkeley

7. But why limit design of 3 dimensional objects to a 2 dimensional computer screen? Design Engineering Collaborative at UC Berkeley

8. This is where the Xbox Kinect comes in… Design Engineering Collaborative at UC Berkeley

9. Let’s develop a 3D drawing software. Design Engineering Collaborative at UC Berkeley

10. Design Engineering Collaborative at UC Berkeley

11. You could draw anything in 3D using… An Infrared Pen with variable intensity A standard computer The Xbox Kinect Design Engineering Collaborative at UC Berkeley

12. The GUI would be a combination of… Photoshop tools & Solidworks tools With visual feedback as to where your pen is Design Engineering Collaborative at UC Berkeley

13. The software would… • Acquire the 3D location of the infrared pen using the Kinect’s stereo imaging. • Read the intensity of the infrared signal and translate it to the “brush stroke” weight. • Determine the orientation of the pen for ideal brush paths. • Correlate the velocity of brush strokes with brush weight. • Use the GUI’s user input to apply the specified 2D cross section for the “brush”. • Output a 3D model of what the user draws. Design Engineering Collaborative at UC Berkeley

14. This would be a better interface than Leap Motion because… • Leap Motion’s sensor is limited to a 2x2x2 foot cube. The Xbox Kinect can image an entire room. • Current Leap Motion software is good at using you hand positions to manipulate, rotate and exhibit current models. • From the Leap Motion website: “you can point, wave, reach, and grab. Even pick something up and put it down.” Creating something is a different story… • This Kinect software would change the way people create things from scratch in 3D, as opposed to just manipulating them. Design Engineering Collaborative at UC Berkeley

15. This proposed software would fuse the raw creativity of drawing with the beauty of 3D modeling in a revolutionary new experience. Imagine play dough for the 21st century. Design Engineering Collaborative at UC Berkeley

16. The Kinect has been used for gaming, robotics, education, and even fitness. I think it’s time to be used to empower the design community. Design Engineering Collaborative at UC Berkeley

17. Thank you for your consideration! Design Engineering Collaborative at UC Berkeley