Image Compression

1. Image Compression

2. Image Compression • Image compression is the art and science of reducing the amount of data required to represent an image. • It is one of the most useful and commercially successful technology in the field of Digital Image Processing. • The number of images that are compressed and decompressed daily is staggering, and the compressions and decompressions themselves are virtually invisible to the user. • Any one who owns a digital camera, surfs the web, or watches the latest Hollywood movies on Digital Video Disks (DVDs) benefits from the algorithms and standards discussed in this chapter.

3. Image Compression • To better understand the need for compact image representations, consider the amount of data required to represent a two-hour standard definition (SD) television movie using 720 x 480 x 24 bit pixels arrays. • A digital movie(or video) is a sequence of video frames in which each frame is a full-color still image. Because video players must display the frames sequentially at rates near 30 fps (frames per second), SD digital video data must be accessed at: 30 frames/sec x (720 x 480) pixels/frame x 3 bytes/pixel = 31,104,000 bytes/sec And a two-hour movie consists of: 31,104,000 bytes/sec x (602 ) sec/hr x 2 hrs = 2.24 x 1011 bytes Or 224 GB of data.

4. Image Compression • Twenty-seven 8.5 GB dual-layer DVDs (assuming conventional 12 cm disks) are needed to store it. • To put a two-hour movie on a single DVD, each frame must be compressed-on average- by a factor of 26.3. • The compression must be higher for high definition (HD) television, where image resolutions reach 1920 x 1080 x 24 bits/image. • Web page images and high-resolution digital camera photos also are compressed routinely to save storage space and reduce transmission time.

5. Image Compression • For example: residential Internet connections deliver data at speeds ranging from 56 Kbps via conventional phone lines to more than 12 Mbps for broadband. • The time required to transmit a small 128 x 128 x 24 bit full-color image over this range of speeds is from 7.0 to 0.03 seconds. • Compression can reduce transmission time by a factor of 2 to 10 or more. • In addition to these applications, image compression plays an important role in many other areas, including televideo conferencing, remote sensing, document and medical imaging, facsimile transmission (FAX). • An increasing number of applications depend on the efficient manipulation, storage, and transmission of binary, grayscale, and color images.

6. Image Compression • In this chapter we introduce: • 1. the theory and practice of digital image compression • 2. examining the most frequently used compression techniques and describe the industry standards that make them useful. • 3. the material is introductory in nature to both still images and video applications

7. Fundamentals • The term data compression refers to the process of reducing the amount of data required to represent a given quantity of information. • Representations may contain irrelevant or repeated information this is considered redundant data. • Compression is a technique which increases efficiency by removing redundancy from representations, and hence representations without redundancy cannot be compressed. • Lossless compression techniques do not lose any significant aspect of the original representation. • Lossy compression, on the other hand, loses parts of the original in a controlled way. • Decompression is the reverse operation, where the redundant parts are put back into the representation to restore it to its initial form.

8. Fundamentals • In the context of digital image compression, usually is the number of bits needed to represent an image as a 2-D array of intensity values. • The 2-D intensity arrays are preferred formats for human viewing and interpretation and the standard by which all other representations are judged. • When it comes to compact image representation, however, these formats are far from optimal. • Two - dimensional intensity arrays suffer from three principal types of data redundancies that can be identified and exploited: • 1. Coding redundancy • 2. Spatial and temporal redundancy • 3. Irrelevant Information

9. Fundamentals • Coding redundancy: a code is a system of symbols (letters, numbers, and bits) used to represent a body of information or set of events. Each piece of information or event is assigned a sequence of code symbols, called a code word. The number of symbols in each code word is its length. The 8-bit codes that are used to represent the intensities in most 2-D intensity arrays contain more bits than are needed to represent the intensities. 2. Spatial and temporal redundancy: because the pixels of most 2-D intensity arrays are correlated spatially( i.e., each pixel is similar to or dependent on neighboring pixels), information is unnecessarily replicated the representations of the correlated pixels. In a video sequence, temporally correlated pixels also duplicate information

10. Fundamentals 3. Irrelevant Information: Most 2-D intensity arrays contain information that is ignored by the human visual system and/or extraneous to the intended use of the image. It is redundant in the sense that it is not used.

11. Image Compression Models

12. Image Compression Models • As Fig. 8.5 shows, an image compression system is composed of two distinct functional components: an encoder and a decoder. The encoder performs compression and the decoder performs the complementary operations of decompression. • Both operations can be performed in software, as is the case in Web browsers and many commercial image editing programs, or in combination of hardware and firmware, as in commercial DVD players. A codec is a device or a program that is capable of both encoding and decoding.

13. Image Compression Models • Input image f(x,y) is fed into the encoder, which creates a compressed representation of the input. This representation is stored for later use, or transmitted for storage and use at remote location. • When the compressed representation is presented to its complementary decoder, a reconstructed output image f∧(x,y) is generated. • In still image application, the encoded input and decoder output are f(x,y) and f∧(x,y) , respectively; in video applications, they are f(x,y,t) and f∧(x,y,t) , where discrete parameter t specifies time.

14. Image Compression Models • In general, f∧(x,…) may or may not be an exact replication of f(x,…). • If it is, the compression system is called error free, lossless, or information preserving. • If not, the reconstructed output image is distorted and the compression system is referred to as lossy.

15. The encoder compression process • The encoder in Fig.8.5 is designed to remove the redundancies through a series of three independent operations. • In the first stage of the encoding process, a mapper transforms f(x,…) into a (usually non visual) format designed to reduce spatial and temporal redundancy. • This operation generally is reversible and may or may not reduce directly the amount of data required to represent the image. • Run-length coding is an example of mapping that normally yields compression in the first step of the encoding process.

16. The encoder compression process • The quantizer: reduces the accuracy of the mapper’s output in accordance with a pre-established fidelity criterion. The goal is to keep irrelevant information out of the compressed representation. This step is irreversible. It must be omitted when error-free compression is desired • In third and final stage of the encoding process, the symbol coder: it generates a fixed- or variable – length code to represent the quantizer output and maps the output in accordance with the code. In many cases, a variable length code is used. The shortest code words are assigned to the most frequently occurring quantizer output values thus minimizing coding redundancy. This operation is reversible. • Upon the completion of the process, the input image has been processed for the removal of each of the three redundancies described before.

17. The decoding or decompression process • The decoder contains only two components: • A symbol decoder and an inverse mapper. • They perform in reverse order, the inverse operation of the encoder’s symbol encoder and mapper. • Because quantization results in irreversible information loss, an inverse quantizer block is not included in the general decoder model.

18. Image formats, Containers, and Compression Standards • In the context of digital imaging, an image file format is a standard way to organize and store image data. • It defines how the data is arranged and the type of compression – if any – that is used. • An Image Container is similar to a file format but handles multiple type of image data. • Image compression standards, on the other hand, define procedures for compressing and decompressing images that is for reducing the amount of data needed to represent an image. • These standards are the underpinning of the widespread acceptance of image compression technology.

19. Image formats, Containers, and Compression Standards

20. Image formats, Containers, and Compression Standards

21. Image formats, Containers, and Compression Standards

22. Image formats, Containers, and Compression Standards

23. Compression Standards • Most common compression standards are JPEG (Joint Photographic E xperts Group) and GIF (Graphics Interchange Format). • Both standards reduce the number of bits used to store each pixel. • GIF condenses each pixel from 24 bits to 8, by reducing the set of colors used to a smaller set, called a palette. • JPEG is designed to take advantage of certain properties of our eyes, namely, that we are more sensitive to slow changes of brightness and color than we are to rapid changes over a short distance. • Image data can sometimes be compressed to one twenty-fifth of the original size. • For video, the dominant standard is MPEG (Moving Picture Experts Group), which is now used in most digital camcorders.

24. Some basic Compression Methods: • Huffman Coding • Golomb Coding • Arithmetic Coding • LZW Coding • Run-Length Coding • One-dimensional CCITT compression • two-dimensional CCITT compression • Symbol-Based Coding

25. Some basic Compression Methods: • In this section, we describe the principle lossy and error-free compression methods in use today. Our focus is on methods that have proven useful in mainstream binary, continuous-tone still images, and video compression standards. The standards themselves are used to demonstrate the methods presented.

26. Some basic Compression Methods: Huffman Coding • One of the most popular techniques for removing coding redundancy is due to Huffman (Huffman 1952). • When coding the symbols of an information source individually, Huffman code yields the smallest possible number of code symbols per source symbol. • The resulting code is optimal for a fixed value of n.

27. Huffman Coding • The first step in Huffman’s approach is to create a series of source reductions by ordering the probabilities of the symbols under consideration and combining the lowest probability symbols into a single symbol that places them in the next source reduction. • The second step in Huffman’s procedure is to code each reduced source, starting with the smallest source and working back to the original source from

28. Huffman Coding The Fig. 8.7 illustrates this process for binary coding.

29. Golomb Coding • In Golomb Coding we consider the coding of non-negative integer inputs with exponentially decaying probability distributions in terms of log and exponent. • Inputs of this type can be optimally encoded using a family of codes that are computationally simpler than Huffman codes. • Both Huffman and Glomb coding depends on the variable-length codes.

30. Exercise Consider a two-hour film to be displayed on a computer at 24 fps. Each frame is 640 x 380 pixels and a 24-bit RGB color encoding is being used. How many bytes will be required to represent the whole film? • The number of pixels in one frame = 640 * 380 = 243200 pixels. • The number of bytes needed to represent one frame = 243200 * 3 =729600 bytes. • The number of seconds in 2 hours = 2 * 60 * 60 = 7200 seconds. • The number of frames in 2 hours = 7200 * 24 = 172800 frames. • The number of bytes needed to represent the whole film = 172800 * 729600 = 126074880000 bytes. • = 12607488 0000 / 230 = 117.416 GB.

31. Questions ???...