1 / 19

Application in Computer Vision

A web-cam based game to help kids learn about nature through simple motor skills, colors, and sound effects. Features motion detection and animal identification by sounds.

jonwhite
Download Presentation

Application in Computer Vision

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Application in Computer Vision Final Project Nir Slakman, Oren Zur and Noam Ben-Ari

  2. The Goal . To Create: • A game for kids, to assist them getting familiar with the world of nature. • Using simple motor skills, sound effects and colors.

  3. Description. • Web-cam based. • Few different screens (levels). • Motion detection. • Identifying the animals by the sounds they make.

  4. Motivation. • To create an educational game for kids. • An interesting game, using colors and sounds effects. • An EyeToy look-like game.

  5. What is Eye Toy? • Color digital camera device. • Usually used for the PlayStation consoles. • Allows the player to play the game by using his hands movements instead of using a joystick or a keyboard.

  6. The Technology. • uses computer vision to process images taken by the camera. • allows players to interact with games using motion, color detection and sound.

  7. Video Capturing Motion Detection Color Recognition Location Effects The Algorithm.

  8. Video Capturing. • Captures frames using Matlab. • Each frame being converted to a 3D matrix (X*Y*3). • X and Y are the dimension of the frame. • The third value means 3 layers of color – RGB.

  9. Motion Detection. • A five frames buffer. • A median matrix was computed for each five matrixes. • If the value of a pixel is different from the value of the median – there was a motion!

  10. Color Detection. • The software is looking for a blue object in motion. • Each pixel’s RGB values are being examined for a dominant value of blue.

  11. Location detection. This is easy… • The location is actually the values of x and y in the matrix (frame – [x,y]). • When the object being located is signed with a square.

  12. Location detection. • The square is drawn on the game’s screen according to the camera screen window’s coordinates. • The moving object is being followed by the square online.

  13. Effects. • When the software locates the square in one of the pictures’ location range, it recognize the animal, mark the picture and create sounds effects.

  14. Example.

  15. EyeToy - Example. Short Movie - YouTube

  16. In The Future. • Expand the system for different subjects. • Include competitions and High-scores. • Time based levels.

  17. Any Questions?

More Related