1 / 28

Video Processing

Video Processing. BY: Maria, Ben, Jason. Overview:. Video basics Video compression Manipulation of video Stitching multiple videos Reducing errors in stitching The future of processing. How Is Video Captured.

geordi
Download Presentation

Video Processing

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Video Processing BY: Maria, Ben, Jason

  2. Overview: • Video basics • Video compression • Manipulation of video • Stitching multiple videos • Reducing errors in stitching • The future of processing

  3. How Is Video Captured The CMOS Sensor Captures the light and converts it to an electrical signal. This happens numerous times a second to compose a video.

  4. Basics of Video A video is simply a sequence of images that changes rapidly. The human eye can distinguish the difference in images that change about 15-20 times per second (fps). When the images change at a rate quicker than 15-20 fps our eye can not distinguish them and therefore we are fooled into seeing a continuous stream.

  5. Video Compression Uncompressed video files are Extremely Large - 1 minute of 1280 x 960 uncompressed video = 4 GB Compressed files can be almost infinitely times smaller depending on how much video quality you are willing to sacrifice. Simply put, compressing a video will tell the computer to ignore everything that isn't moving to save processing power.

  6. Video Compression

  7. Over Compression

  8. Over Compression VIDEO TRAILS

  9. Video Encoding Codec - Compression Decompression algorithms - H.264, Divx, FFMpeg - These are the algorithms that reduce the file size of a video Container - File type that is output after compression - MOV, AVI, MP4 - Containers can hold more than one codec - Most common container on the web is Flash which is compatible with H.264, VP6, and Spark Codecs

  10. Geometric Transformations Translation (x',y') ΔY (x,y) ΔX

  11. Geometric Transformations Scale X' X Y' Y

  12. Geometric Transformations Rotation (x',y') (x,y) Ө

  13. Alpha Blending Standard Video has 3 Channels: Red, Green, and Blue, totaling 24 bits (8 bits per channel). A 4th channel, called the alpha channel is sometimes available in 32 bit video sources, and if not, can be created within the computer. The alpha channel is represented by transparency and is understood by the computer on a scale of 0 to 255.

  14. Do we want the alpha channel of every video to be the same, or individually adjustable? Alpha Blending

  15. Stitching Conventional stitching algorithms leave a visible seam in the overlapped region (due to accuracy limitations, vignetting, difference in exposure times, and white balance) Most are also too complicated to be practical in real-time. They require too much computational energy.

  16. Choosing the right endpoints is important when aligning the images, so that there are no obvious seams. Picture (b) shows an alignment with poorly chosen endpoints, so there are visible seams shown in the circled regions.

  17. Process: • Start with videos that share an overlapping region • Use a Block Matching Algorithm (BMA) to find corresponding points of the images to line them up • You need to account for motion in the frames, using phase correlation. • Phase Correlation: a method to estimate how far offset two images are • Finally, blend the images together at the overlapping region.

  18. Determining where to overlap the images in each frame individually creates a more seamless image than if the overlap remains the same for all the frames.

  19. Ghost Images

  20. Some steps for eliminating ghost images: Calculate the size in pixels of the overlapping region, then find the center point of this region, shown as P in the diagram. This gives you a focal point for the overlap. The article gives an equation to create a gradual change in the overlapping region, blending the images gradually from one to the next. *Be sure to account for differences in color and position of moving objects http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=5541517

  21. Current Video Processing Research • Researchers in india are creating algorithms to improve face recognition technology.

  22. Continue In the medical field, there has been a big focus on improving quality in every image that a piece of equipment makes. MRI

  23. Ultrasound

  24. Bronchoscopy

  25. Reconstruction from Brain Activity Measuring the blood flow and other actvitity in the brain, researchers have been able to project what the person sees in their head

  26. <iframe width="420" height="315" src="http://www.youtube.com/embed/KMA23JJ1M1o" frameborder="0" allowfullscreen></iframe>

  27. Questions?

More Related