1 / 20

Virtual painting project

Virtual painting project. By: Leetal Gruper Tsafrir Kamelo Supervisor: Michael Kolomenkin Advisor from 3DV systems: Sagi Katz. Introduction. The following project introduces a new type of interface based on the user's hand and body movements as captured by the novel 3DV systems Zcam™.

preston
Download Presentation

Virtual painting project

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Virtual painting project By: Leetal Gruper Tsafrir Kamelo Supervisor: Michael Kolomenkin Advisor from 3DV systems: Sagi Katz

  2. Introduction • The following project introduces a new type of interface based on the user's hand and body movements as captured by the novel 3DV systems Zcam™

  3. Project goal • User will be able to paint on a virtual surface • The program is intended for small children • The user will stand in front of the camera, paint with any part of their body they wish, and see the painting on the computer screen

  4. System description • The system consists of the 3DV systems Zcam™ and a program that runs on windows • The program includes inside: • Ogre – a 3D engine. • Depth camera interface. • Upper body tracking interface.

  5. The virtual paint software

  6. The program flow • The user stands in front of the Zcam™ • Selects a color to paint • Starts painting with every part of his body that cross the depth threshold

  7. The program • Starts with a configuration dialog to setup

  8. Modes of operation • Painting mode • Color selection mode: • Red, green and blue • Cyan, magenta and yellow • White, orange and brown • The user can paint in both modes. The only difference is in the interface presented on the screen

  9. First color selection screen

  10. Second color selection screen

  11. Third color selection screen

  12. Press the Passing between modes • To move from color selection mode to the painting mode, one needs only to select a color or the eraser • To move from the painting mode to the color selection mode, one should just press the arrow button • To move between different color options, one needs to press the 2 arrows appearing on each side

  13. Fine resolution painting • An entire hand is to crude for fine painting • Need for doing some pre-processing on the input depth image

  14. Fine resolution painting cont. • The algorithm we finally used was based on the assumption that we mainly paint homogenous objects • The number of layers removed (which translate to a more or less finer resolution) is controlled from the keyboard numbers. 9 is the finest resolution possible and 1 is not removing layers at all

  15. The algorithm • Scan the frame in an interlace order • For every pixel in depth range • Has at least one pixel from 4 surrounding neighbors that are at a certain distance that isn't in our depth range? • Don’t paint the pixel • Else • Paint the pixel

  16. Conclusions • We created software that uses an RGBD camera as an input interface and creates a fun game intended for children • This project was our first encounter with computer graphics • We have acquired knowledge in basic computer graphics • We have also learned how to use a rendering platform as OGRE to create all our graphical needs • For the students that will follow us and want to use OGRE, we have created a tutorial comprising all our knowledge

  17. Thank you Michael and Sagifor all your help and guidance

More Related