Windows Media Photo A new format for end-to-end digital imaging

1. Windows Media PhotoA new format for end-to-end digital imaging Bill CrowPrincipal Program ManagerDigital Media DivisionMicrosoft Corporation

2. Overview Enabling technology to significantly improve end-to-end digital imaging • Superior Image Quality • Better Performance • New Opportunities

3. Overview • Support for the Widest Range of Pixel Formats • 8, 16 or 32 bits per channel, multiple packed bit formats • Unsigned integer, fixed point, floating point • RGB, CMYK, Grayscale, n-Channel; planar or interleaved alpha • High Performance, Low Footprint Algorithm • Optimized for device implementation • Small buffer requirements, no complex math • Advanced Decoding and Transformation Operations • Mipmaps (variable frequency decode), region decode • Compressed domain crop, rotate/flip and resolution reduction • 2x Compression Improvement Over Today’s Standard • The same image quality in a file that is ½ the size of JPEG • Smaller files encode/decode/transfer faster, with less power • Lossless plus lossy compression with the same algorithm

4. Preserving All The ContentToday’s unsigned integer formats discard useful information 12+ bpclinear RGB 8+ bpc non-Linear RGB 16+ bpc linear HDR scRGB CameraSourceDevices DisplayDestinationDevices Intermediate Storage, Editing and Management 8bpc non-linear RGB Intermediate Storage, Editing and Management ScannerSourceDevices PrinterDestinationDevices 12-16+ bpc linear RGB 8+ bpc non-Linear CMYK

5. Unprocessed Source Data

6. Processed Source Image

7. Unsigned Integer RGB Image

8. Unsigned Integer RGB Image

9. Fixed Point Or Float RGB Image

10. Fixed Point Or Float RGB Image

11. Exposure Adjustment sRGB Original 16bpc unsigned integer sRGB Adjusted -1.5 stops 16bpc unsigned integer scRGB Original 16bpc fixed point scRGB Adjusted -1.5 stops 16bpc fixed point

12. Compression Versus Quality • WMPhoto • JPEG-2K • JPEG

13. Windows Media Photo Bill CrowPrincipal Program ManagerDigital Media Division

14. Benefits • An efficient, standardized photo interchange format that preserves the entire dynamic range • Significantly improved ability to correct poor images • Images look better with more shadow and highlight detail • Exposure and color corrections don’t discard dynamic range • Supports end-to-end acquisition, editing, rendering, printing • Better photos that are ½ the size of JPEG • Faster transfer, less device power consumption • Significant reduction in storage space requirements • 25x compression or more is reasonable for typical photos • Allows higher resolution images for email and web

15. Color And Compression • Flexible color space support • 8 or 16 bpc unsigned integer • 16 or 32 bpc fixed point, floating point • RGB, CMYK, Grayscale, n-channel • 5-5-5, 5-6-5, 10-10-10 packed-bit RGB • 1bpc black/white, mask • 4:4:4, 4:2:2, 4:2:0 color sampling • Interleaved or planar alpha channel • High performance compression technology • Lossy and lossless compression with a single algorithm • No complex math; can be implemented with low gate counts • Minimal memory requirements, no full frame buffer required • Symmetric algorithm, equal complexity for encode and decode

16. Advanced Operations • Structured compressed domain organization • Progressive decode – fast previews and thumbnails • Region decode • Compressed domain transforms • Cardinal rotation, flip • Down-sample • Crop • Spatial versus frequency data re-organization • Two optional levels of overlap encoding • Bit stream and decoder support for custom dynamic Q • Per channel • Per macro-block • Very large image dimensions • 216 x 216 macro-blocks per tile, 28 x 28 tiles, 268m2 pixels

17. Container And Metadata • TIFF-like IFD structure • Provides maximum compatibility with existing code • Multiple images supported via linked IFD tables • 32-bit internal byte pointers, 4Gb max file size • To be addressed in future version • Flexible Metadata • WMPhoto-defined IFD tags for image format and structure • Pixel Format GUID • Width, Height, Resolution • Transformation • Image and Alpha data pointers, size • Industry-compatible IFD tags for descriptive info • XMP metadata • ICC profile • TIFF-compatible descriptive tags • EXIF metadata

18. Describing The Bitmap • Multiple current solutions • TIFF uses basic colorimetric info basedon predefined photometric interpretations • TIFF/EP uses ICC Profile • JPEG carries basic RGB colorimetric info • WMPhoto: PixelFormat GUID and ICC Profile • PixelFormat GUID is unambiguous, compact and extensible • ICC Profile for legacy unsigned integer pixel formats • “Default” color context when no ICC profile is present • Unsigned integer RGB: sRGB • Unsigned integer CMYK: SWOP • Signed/float RGB: scRGB (linear, unprofiled) • Gray: Luminance-only component of equivalent RGB context

19. Windows Imaging Component (WIC) • New imaging infrastructure for Windows • Windows Vista, Windows Presentation Foundation and WIC-only redistributable • Extensible pixel formats and codecs • Provides an HDR image processing pipeline • Windows Media Photo fully supports WIC API’s

20. WIC Encoder Parameters Canonical Parameters Windows Media Photo Specific Parameters

21. WIC Advanced Decoding • Supports IWICBitmapSourceTransform for high performance decoding options • Arbitrary rectangular regions • 2x mipmaps for nearest size decoding • Native decode at 1x, 4x, 16x • Interpolated decode at 2x, 8x, >16x • Natively supports all rotate/flip transforms • Pixel format conversion during decode under consideration for future support

22. Compressed Domain Operations • Specifying a WMPhoto decoder as the source for a WMPhoto encoder invokes compressed domain operations, when possible • Rotate/flip transformation • Crop • Resolution reduction • Spatial versus frequency reorganization • Significant benefits by avoiding lossy compressed decode and re-encode • No additional image quality loss • Dramatically faster operations

23. Additional Resources • Device Porting Kit RTM 1.0 is available now • http://www.microsoft.com/windows/windowsmedia/wmphoto • Bit stream spec is final • Includes reference ANSI-C source code • Support for both little-endian and big-endian architectures • Windows Imaging Component (WIC) codec available now • Functionally complete in Windows Vista Beta 2 • Same codec is also distributed via WinFX and WIC redists • WIC Info: http://windowssdk.msdn.com/library/en-us/wic/wiclh/wiclh.asp • Power Toys (viewer, converter) coming for Windows XP • Related Sessions • Windows Color System / High Dynamic Range Imaging • Developing XPSDrv Printer Drivers • Using XPSDrv Printer Drivers • Technical questions: wmphoto @ microsoft.com

24. Call To Action • Use WinFX or WIC for Windows imaging applications, including drivers • Support high dynamic range workflows • Add support for Windows Media Photo anywhere your device or application reads or writes image files • Enhance the features and performance of your device or application with compressed domain operations • Implement XPS with Windows Media Photo support for printers, drivers and applications

25. © 2006 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.