200 likes | 387 Views
Virtual Me. Motion Capture. The process of recording movement and translating that movement onto a digital model Games Fast Animation Movies Bio Medical Analysis VR. Types of Tracking. Facial tracking Full body tracking Hand tracking Partial body tracking. 1- Mechanical Motion Capture.
E N D
Motion Capture • The process of recording movement and translating that movement onto a digital model • Games • Fast Animation • Movies • Bio Medical Analysis • VR
Types of Tracking • Facial tracking • Full body tracking • Hand tracking • Partial body tracking
1- Mechanical Motion Capture • Using an exoskeleton • Each joint is connected to an angular encoder • The value of movement of each encoder is recorded by a computer • Pros: • Not being influenced by external factors • Cons: • Freedom of movement is limited • Absolute positions are not known
2- Magnetic Motion Capture • Magnetic sensors and a magnetic field generator • Detect sensor position based on field strength • Pros: • Data captured is accurate • Cons: • External disruptions by electrical/magnetic fields by other devices
3- Optical Motion Capture • Using Markers (Reflective or Emitting) • Uses light intensity to determine marker position • Pros: • Free movement • Very clean and detailed data(?????) • Cons: • Reflective dots can be blocked, causing loss of data • Rotations of body parts are not absolute and must be solved for(????)
4- Marker less Tracking • Using computer vision • Detect Humans in the picture • Uses techniques to extract motion information from the image • Silhouette detection • Joint detection
PhaseSpace <search impulse> • 4:24 Impulse cams • 20:100 impulse active LED • Price:$29,950.00 to $123,950.00 • feature: full body motion tracking (including fingers using gloves)
Nintendo Wii • Accelerometer , Optical sensors<search> • Gaming System • Price:$199 • Limitations: • Can only track the motion of the hand • Only useable with the Wii
Sony PS3 Eye • Web Cam • price: cam:$34.99 , playstation 3:$299.00 • feature: recognizes hand and body movements • Limitations: • Officially Works only with Sony PS3 • Low resolution 640x480
The Virtual Me Approach • A frame work for Human motion capture • Color based markers • Arbitrary number of cams • Detect major limbs motion and orientation • Hopefully real time
Sample application • A simple game will be used as a demonstration • Virtual Goal • The player will defend his goal from multiple footballs
Body Constructor Constraint module History Merging Module Capture Marker Detector Image Processing Pipelines IPP(1) IPP(2) IPP(K) Camera Interface
Development • Language • C++ • Tools • Visual Studio 2008 • Open CV 2.0