Robert Buckley Imaging & Services Technology Center

1. Robert BuckleyImaging & Services Technology Center JPEG 2000 and Color Image Archiving

2. Key Messages • JPEG2000 for video archivists • As a compression architecture • As a format architecture • Who is using JPEG2000 • DP, NDNP • DCI • Activities to watch (and join) • ISO – JPSearch • ICC – Digital Motion Picture WG • CIE – Archival Colour TC

3. Embedding JPEG2000 in Applications Activities Application Format Imagestream Color Spec Metadata

4. What is JPEG 2000? • JPEG 2000 is a wavelet-based image-compression standard, developed by the same ISO committee that previously developed JPEG, although with a different group of participants and contributors. • JPEG 2000 was conceived as a next generation image compression standard that would improve on the performance of JPEG while, more significantly, adding features and capabilities not available with Baseline JPEG compression.

5. Why use JPEG 2000? • Open Standard • Royalty free • One master supports multiple derivatives • One file for both lossless and lossy data • Progressive display and scalable rendering • One algorithm for both lossless and lossy compression • Region-of-Interest (ROI) on coding and access • Easily handles large images • Multiple components and high bit-depth images • Generous metadata support

6. JPEG 2000 Standard - Parts 1-6 ISO/IEC 15444 / ITU-T Rec. T.800 Part 1: Core Coding System Part 3: Motion JPEG2000 Part 4: Conformance Testing Part 6: Compound Image File Format Part 2: Extensions Part 5: Reference Software

7. JPEG 2000 Standard - Parts 8-13 Part 8: JPSEC Secure JPEG2000 Part 9: JPIP Interactivity Tools Part 10: JP3D 3D & Floating Pt Part 11: JPWL Wireless Part 12: ISO Media File Format Part 13: Entry-Level JPEG2000 Encoder Key Under Development Encode Published

8. One Master  Multiple Derivatives • A single JPEG2000 master can serve multiple uses • Scale by resolution • Thumbnail image • Screen resolution image • Print quality image • Scale by quality • Lossless  Lossy • Preset file size • Key enabling technologies • Wavelet transform • Embedded block coding

9. One Master  Multiple Derivatives Codestream truncated by quality Packets reordered by layer Region of Interest Selected Master Image Derived Image Low res image Thumbnail Medium res image

10. JPEG 2000 Codestream • The number of bits allocated to parameters in the JPEG 2000 codestream allow images up to 4 Gpixels square, with 16,384 components and 38 bits per component. • Part 1 defines 5 profiles that restrict the size and use of various codestream structures • Examples: image size, codeblock size, tile size • Part 4 defines 3 compliance classes that limit what a decoder has to support • Compliance Class 2 guarantees support for images up to 16 Kpixels square, with 256 components and 16 bits per component

11. Embedding JPEG2000 in Applications Activities Application Format Color Spec Metadata Imagestream

12. Basic JPEG 2000 File Box Stack • JPEG 2000 Signature Box • Identifies file as member of the JPEG 2000 file format family, same for all files • File Type Box • Specifies brand, version, compatibility, profile • Header Box • Contains image parameters and color spec • Codestream Box • Contains image stream • Metadata boxes • XML-formatted or user-specific metadata JPEG 2000 Signature File Type Header Codestream XML UUID

13. JPEG 2000 File Format Family • JP2 (JPEG 2000 Core, Part 1) • Single image, continuous codestream • JPX (JPEG 2000 Extensions, Part 2) • Multiple codestreams, possibly fragmented • MJ2 (Motion JPEG 2000, Part 3) • Timed sequence of JPEG 2000 images • Intra-frame coding only • JPM (JPEG 2000 Multi-Layer, Part 6) • MRC model for compound document images • Multiple images (binary and contone) and pages

14. Metadata • The JPEG 2000 File Format family provides a frame- work for embedding domain-specific metadata in a file • XML boxes for XML-formatted metadata • e.g. DIG 35, Dublin Core, GML, MIX • Searchable text coming • UUID boxes for non-XML metadata • e.g. IPTC, GeoTIFF • MPEG-7 Binary Box for metadata in BiM format • Examples • Associate metadata with the entire image or with specific regions of the image • JPEG2000-specific preservation metadata in Z39.87

15. Color Specification • Direct • Identify the color space or encoding by name • Index into a list of enumerated color spaces • Examples • sRGB, ProPhoto RGB (ROMM RGB), CIELAB • Indirect • Give the transform to a standard color encoding • Use pre-defined transform elements for which you supply the parameters • Example • ICC profiles define the transform to a PCS or Profile Connection Space, i.e. XYZ or CIELAB • ICC has started a Digital Motion Picture WG

16. Color Spaces

17. Color Spaces XYZ ProPhoto RGB Adobe RGB 98 sRGB (Rec. 709) y x

18. Embedding JPEG2000 in Applications Activities Application Format ImageStream Color Spec Metadata

19. JPEG2000 – Digital Photography Activity ANSI • ANSI defined a JPEG2000 profile for Digital Still Cameras • Based on JP2 (JPEG2000 Part 1) file format • Readers conform at least to Compliance Class 1 Application Digital Photography FormatJP2 Profile-1 JPEG 2000 8-bit sRGB, sYCC, sGray Color Spec Restricted ICC profile DIG-35 with extensions, Metadata uses XML box

20. National Digital Newspaper Program • NDNP is an NEH/LoC Program to enhance access to all American newspapers • Two-year pilot began May 2005 • Each page to be delivered as TIFF and JPEG2000 images Activity NDNP Application Production FormatJP2 Resolution progressive, visually lossless JPEG 2000 8-bit sGray, Restricted ICC 8-bit Gray RDF/Dublin Core, uses XML box RDF/DC

21. Digital Cinema • Digital Cinema uses JPEG 2000 for image compression in the DC Distribution Master • Compressed image size limited to 1.25 MBytes at 24 fps Activity DC Initiative Application Distribution FormatMXF Profile-3: 2K - up to 2048 x 1080 JPEG 2000 Profile-4: 4K - up to 4096 x 2160 12-bit non-linear XYZ 12-bit XYZ’ Metadata Frame and image parameters

22. JPSearch • Linked to JPEG2000 but not part of the standard • Destined to become ISO 24800 • Start with Technical Report and Whitepaper • Technical report • to provide the JPEG user community with a clear understanding of the entire image retrieval process • to identify the components involved in search process, the linkages between them, and the components and links that should be standardized • Whitepaper • To articulate the benefits of a standardized image search framework and components • Drafts produced at July 2005 JPEG2000 meeting • Technical report proposes 4-layer framework for digital image search • user—query—result—content • Whitepaper proposes ISO MPEG-7 content description technology

23. Motion Picture and Archival Color • ICC – Digital Motion Picture WG • Status: Started in early 2004 • Rationale: Current ICC technology is print-centric • Charter • Codify an open, vendor-neutral, cross-platform color management system architecture for DMP production that will enable utilization of ICC color management • CIE - Archival Colour TC • Status: In planning stage • Rationale: No activity specifically aimed at color preservation • What it would do • Develop a Technical Report that documents the needs of archival color and that can be communicated to other standards and development organizations.

24. Conclusions • JPEG2000 is a privileged format for access and distribution • Offers a compression and format architecture • Your profile waiting to be developed • Leverage DCI work • There are related activities worth following • JPSearch and CIE Archival Color