1 / 19

Real-Time Motion Detection in Video Games: Object Recognition Project

Explore detecting motion in video games by differentiating character from enemies in real-time. Learn to recognize motion direction by subtracting frames and analyzing differences. Experiment with Super Mario Bros screenshots. Enhance detection in real-time using a web camera and Xbox controller interface. Keep track of object details like size and color, and develop a scoring system.

ekatz
Download Presentation

Real-Time Motion Detection in Video Games: Object Recognition Project

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Object Recognition in Video Games Tony Morelli CS674 Digital Image Processing

  2. Project Description • Can my character be differentiated from enemies? • Can this be done in real time?

  3. Detecting Motion • Take 2 Frames and Subtract them. • Result is the difference/motion • Frame 1 Frame 2

  4. Detecting Motion • Difference • Which direction is the shape moving?

  5. Detecting Motion • To find the direction of change, look 1 frame forward. Frame2 Frame 3 Diff/Motion

  6. Detecting Motion • Compare Difference from 1-2 and 2-3 • Since the regions are the same size, the location of the region that is the same between the 2 pictures is the current location

  7. Detecting Motion • Examining where the object is for the 3 frames tells you direction

  8. Detecting Motion • Try Concept with a video game • Used Super Mario Bros – Simple 2d game • Game was played in emulator, screenshots were taken as game was played

  9. Detecting Motion • Frames were stored as P6 PGM • 3 Bytes per pixel • Resolution 320x240

  10. Detecting Motion • Program was written in C++ • Images read in from disk and stored in memory • Pixels were subtracted as in example

  11. Detecting Motion Frame 1 Frame 2

  12. Detecting Motion Differences Regions with motion

  13. Detecting Motion • As shown in the previous slides, differences are taken between First/Second and Second/Third • This results in motion and direction for all regions • Since I was pushing right, any region moving left is considered an enemy, everything else is what I am controlling

  14. Detecting Motion • Calculation of object motion took a little over 1 second. • Region recognition was easy as the colors were perfect (coming directly from emulator) • Program had to be told what buttons I was pressing to determine which object I was controlling and which were enemies

  15. Real Time Motion Detecting • Instead of reading from disk, get images from web cam directly from memory • Examine a more ‘real world’ example by using web cam instead of perfect emulator image • Have application control the direction, so it knows which direction to expect itself and enemies to be moving

  16. Real Time Motion Detecting • ReWritten in VB.NET to better interface with web cam

  17. Real Time Motion Detecting • Emulation moved to run on XBOX • Computer will now control the emulator • Modified XBOX Controller

  18. Real Time Motion Detecting • Computer controls XBOX controller via parallel port

  19. More Image Processing • More details need to be kept about objects • Size, Color • Not all objects approaching me are bad • Score needs to be recognized

More Related