110 likes | 403 Views
Multi-Cam Video Stitching. Panoramic Video Option During a Skype Call. Goal. Integrate a panoramic video feature into Multicam Feature takes the inputs of multiple webcams and stitches them together Output is produced in real time Works using hardware of the average user. Applications.
E N D
Multi-Cam Video Stitching Panoramic Video Option During a Skype Call
Goal • Integrate a panoramic video feature into Multicam • Feature takes the inputs of multiple webcams and stitches them together • Output is produced in real time • Works using hardware of the average user
Applications • Conference calls • Absentee lecture
Background: Image Stitching • Homography • Computer Vision by R. Szeliski • Types of algorithms • Improving the image
Background: Video Stitching • Efficient stitching made use of GPU • Good quality videos not real time • Good quality but required user input
Our Approach and Research Question • OpenCV • Basic hardware components • Can a good panoramic video be stitched in real time during a Skype call with the equipment of the average person? • “good” • “real time” • “equipment of the average user”
Progress: Preliminary work with OpenCV • Install OpenCV on Mac • Simple image stitch
Progress: Simple Videos • Still camera videos • 640 x 480 resolution • Compute homography for each frame • Compute homography once • Results • Typical video has 24 FPS • Approach #1: .89 FPS • Approach #2: 2.12 FPS
Future Work: Speed • Create a mask of videos, only quarter-sized, calculate the homographies and then scale the homographies up to match real size. • Modify variables included within the Stitcher class. • Allow user to select position on slidebar to adjust precision and performance.
Future Work: Quality • Exposure, Gain • Use built in methods in the stitcher class • Observe effects on time • Try videos in different light, observe effects of built in methods