MPEG-21

1. MPEG-21 Dwight Borses MTS FAE SW Region Multimedia Framework OCCS Nov 25, 2002

2. Acknowledgement Special acknowledgement and gratitude to Anthony Vetro, Mitsubishi Electric Research Labs, Murray Hill, New Jersey, Todd Schwartz, Intel Corporation, Beaverton, Oregon, and Barney Wragg, Universal Music Group, eLabs, London, UK, for their contributions to the MPEG-21 standardization efforts and for their sharing of educational materials for this presentation.

3. MPEG 1 (ISO/IEC 11172) • Completed in 1991 • Digital storage media with bit rates up to ~1.5Mbps • Removes intra- and inter-frame redundancy with block-based DCT and motion compensation • Generates I, P and B-frames • Progressive pictures only • Optimized for SIF (352x240) resolution • Fixed 4:2:0 color format

5. MPEG-2 (ISO/IEC 13818) • Completed in 1994 • Greater input format flexibility • Higher data rates • Better error resilience • Field/frame prediction modes (interlace support) • Field/frame DCT coding syntax • Downloadable quantization matrix • Scalability extensions • Spatial • Temporal • SNR • Display syntax • 3:2 pull-down • pan-and-scan • color formats

6. MPEG-4 (ISO/IEC 14496) • 1993: “Very Low Bit-Rate Audio/Visual Coding” • 1994: Updated to “Coding of Audio/Visual Objects” • Key objectives • Common technology for multiple services • interactive • Broadcast • Conversational • Extension of interactivity as with elements in a multimedia scene • Integration of natural and synthetic content • Coverage over wide range of access conditions • low bit-rates, • error prone channels • scalable coding • Management and protection of intellectual property

7. MPEG-7 (ISO/IEC 15938) • Content Management • Increasing availability of multimedia content • Finding, selecting, filtering desired material difficult • Desire for information about the content • Objective • Standardized content-based descriptions for multiple types of audio-visual information • Enable rapid and efficient content identification • Suitability for large range of applications • MPEG-1, -2 and -4 represent the content “the bits” • MPEG-7 represents information about the content “the bits about the bits”

8. MPEG-21 (ISO/IEC 21000) • What? • Multimedia Framework for multimedia delivery and consumption • Content creator and content consumer as focal points • Why? • Many elements (standards) exist for delivery and consumption of multimedia contents • Absence of 'big picture” to describe how elements relate to each other • Increase interoperability to allow existing components to be used together by filling gaps • Why now? • HW building blocks and infrastructure in place • Compression, transmission, description standards are ready

9. Multimedia Framework Context • Ubiquity of international communication networks such as the Internet challenges traditional business models • Shift from physical to electronic commerce • Rights management complexities • Increasingly complex consumption infrastructure • Deployment of coexisting heterogeneous networks • Wide range of powerful and flexible terminals • Standards can provide a common infrastructure for trading digital assets

10. Author Publisher Distributor Author Publisher Distributor Consumer Consumer Agent Aggregator Wholesaler eTailer Agent Aggregator Wholesaler Publishing S/W Content Packaging WWW. Store Front Authoring Tools User Interface Asset Management Content Hosting Rights Clearing Digital Identification Meta Data Digital Rights Digital Supply Chain Digital Content Products & Services

12. Multiple Flows and Transactions Between any two points there are flows: • Information about content • Authentication between peer entities • Content • Content usage rights • Technology usage rights • Delivery usage rights • Money

14. Current Practice Today’s media contain implicit or explicit rules • A book can be read and resold • A CD may be played, but may not be copied • A video cassette is for private consumption, can be rented but may not be copied • A public broadcast can be watched because license fee has been paid • A commercial broadcast can be watched because one undertakes to watch commercials • A pay TV broadcast can be watched because one has paid a monthly subscription

15. Future Practice? • The Multimedia Framework gives unlimited flexibility: • One can buy an MPEG-21 Digital Item and: • Copy it to a portable device once only • Rent it for 24 hours • Rent it for 10 playbacks • Distribute it to 10 friends and get a copy for free • Access it for free at a low quality, and for a fee at high quality • ??????

16. MPEG-21 Objectives • Vision • To define a multimedia framework to enable transparent use of multimedia resources across a wide range of networks and devices used by different communities • Purpose • Enable electronic creation, delivery, trade of digital multimedia content • Goals • Provide access to information and services from almost anywhere at anytime with ubiquitous terminals and networks • Identify, describe, manage, and protect multimedia content to support delivery chain of contentcreation, production, delivery, and consumption

17. Fundamental Concept: The Digital Item • A structured digital object with a standard representation, identification and meta-data • The fundamental unit of distribution and transaction in the MPEG-21 framework • Digital Item = resource + metadata + structure • Resource: individual asset, e.g., MPEG-2 video • Metadata: descriptive information, e.g., MPEG-7 • Structure: relationships among parts of the item

18. Digital Item Resources New Metadata & Resource Forms Metadata MPEG-1 MPEG-2 MPEG-4 MPEG-7 Structure MPEG-21

19. Benefits of Digital Item • Tangibility • content is more than files on a disk • Deliverability • more automated, less end-user involvement • Configurability • express options/augmentations for specific users, groups, locales, prices, etc.

20. ISO/IEC 21000-1Technical Report (TR) • Published Sept 2001 • Outlines objectives and vision of 7 elements for the MPEG-21 • Digital Item Declaration • Digital Item Representation • Digital Item Identification and Description • Digital Item Management and Usage • Intellectual Property Management and Protection • Terminals and Networks • Event Reporting

21. Digital Item Declaration ISO/IEC 21000-2 • Reached FDIS in May 2002 • Purpose & Conceptual Model • Declare a Digital Item’s makeup and structure • Composite whole composed of various parts • Syntactic Representation • XML-based Digital Item Declaration Language (DIDL) • Features • Hierarchical, generic structure • Flexible meta-data expression • Reusable and configurable elements FDIS Final Draft Information Standard

22. Digital Item Identification ISO/IEC 21000-3 • Provides means to uniquely identify and describe Digital Items • Defines the relationship between Digital Items and existing ID systems • This part does not specify any new ID systems • Identification • syntax: URI of the form urn:mpeg:mpeg21:diid:sss:nnn • sss denotes the identification system • nnn denotes a unique identifier within that identification system FCD – Final Committee Document

23. IP Management & ProtectionISO/IEC 21000-4 • Multimedia Digital Rights Management (DRM) • Enables users to express their rights, interest, and agreements related to Digital Items (DI’s) • Enables users to derive appropriate levels of assurance that those rights, interests and agreements will be persistently and reliablymanaged and protected across a wide range of networks and devices

24. Intellectual Property Management & Protection (IPMP) • Management and protection • MPEG-4 audio-visual objects • MPEG-7 descriptors and description schemes • Other DI types including personal data and rights to its use • Three parts to the standard underway: • IPMP Framework • Rights Expression Language (REL) • Rights Data Dictionary (RDD)

25. Rights Expression Language ISO/IEC 21000-5 • Current WD 3.0 based on XrML • XrML is serving as the basis for further work • ODRL also evaluated • Targets for Standardization • Machine-readable language • Declare rights and permissions using the terms as defined in the Rights Data Dictionary • RDD-REL are intended to provide flexible, interoperable mechanisms to support transparent and augmented use of digital resources • REL supports guaranteed end-to-end interoperability, consistency and reliability between different systems and services CD Committee Draft

26. Rights Data Dictionary ISO/IEC 21000-6 • Scheduled for CD July 2002 • WD3.0 based on <indecs>2rdd data dictionary • This was the starting point used for RDD • Targets for Standardization • Model • Core set of terms • The relation between the RDD and the core set of descriptive terms in the REL

27. Digital Item Adaptation ISO/IEC 21000-7 • Scheduled for CD Dec 2002 • Targets for standardization • Usage Environment Description Tools • Resource Adaptability Tools • Systems Related Tools • Recent activity • Call for Proposals on Digital Item Adaptation issued March 2002 • Responses processed May 2002 • WD1.0 issued based on those (25) responses

28. MPEG-21 Part 2 Digital Item Declaration DID

29. Digital Item • “A structured digital object with standard representation, identification, and metadata” Digital Item = Resources + Metadata + Structure • Resource – an individual asset • Metadata – data about or pertaining to a resource or other part of an Item • Structure – relationships about parts of the item

30. Digital Item Declaration (DID)Purpose Declares the authors intent with respect to • Digital Item’s makeup and structure • Metadata associated with the Digital Item • Relationship among Digital Item’s parts

31. Digital Item Declaration (DID)Features • Domain-neutral • Flexible abstract structural model provides wide applicability • Metadata untangled from content • Metadata left more accessible • Diverse media and metadata types supported • Integrates existing standards • Permits mixing multiple standards and proprietary formats • Configurable • Allows generation of multiple Dis from single source DI • After-Market markup • Where user may not be authorized to modify the original, comments and highlights on DI is supported

32. DID Provides • Abstract Digital Item model • Structural elements • Configuration elements • Referential elements • Special purpose elements • Schema for concrete DID representation • XML-based Digital Item Declaration Language (DIDL)

33. Basic Structural Elements • Resource • Identifies or encapsulates a single media resource • Places no restrictions on media types or formats • Statement • Expresses structured set of specific metadata values • MPEG-7 or other XML-based metadata • Component • Resource combined with relevant Descriptors

34. More on Basic Structural Elements • Descriptor • Expresses metadata for an element through encapsulation • Statement (structured metadata) • Component (unstructured metadata) • May contain (sub)-Descriptors • Item • Atomic unit of content • Embodies DI • May contain (sub)-Items • Container • Logical grouping of related Items

35. Abstract Model

36. Resource

37. Statement

38. Component

39. Item

40. ITEM

41. Digital Item Declaration Language

42. MPEG-21 Part 3 Digital Item Identification DII

43. Digital Item Identification DII PURPOSE • Uniquely identify Digital Items and related entities FEATURES • Globally unique, like a Universal Product Code (UPC) • URN based Syntax STANDARDIZES • Syntactical mapping to commonly used identification systems • cIDF, • DOI • ISBN • etc

44. DII Example (abstract)

45. XML Binary EncodingBiM BiM is the MPEG-7 Systems Binary Encoding Format MPEG-21 Design Goals • Optimize MPEG-7 descriptionsprocessing and transport • Broaden and enhance usage of MPEG-7 descriptions to highly constrained environments, e.g. broadcasting • Extensible to generic XML

46. MPEG-21 Part 4 Intellectual Property Management and Protection IPMP

47. Intellectual Property Management and Protection • Provides a tools framework for Intellectual Property Management • Major goal of Content Industry • No single secret • No monopoly • Different companies’ offerings can interoperate • One terminal can access to all content • Content companies may select IPMP vendors with the trust model that suites their own needs

48. Conditional AccessDigital Rights Management • Conditional Access (CA) • Encryption unlocked by a simple YES/NO system • End user given key allowing access • Involves encryption/decryption functionality • Digital Rights Management (DRM) • Complex system • Based on satisfaction of specfic requirement associated with content consumption • License is given to party who has agreed to satisfy requirements • End user can only use license after proving identity as party having agreed to satisfy requirements

49. MPEG-21 Part 5 Rights Expression Language REL

50. Rights Expression Language • Objective • Clear, Concise, Unambiguous, Machine-Readable expressions of the content owners intended permissions for use • Serves all members of the value chain • Complex expressions need root of distribution • Simple expressions at point of consumption