1 / 16

Video Web Architecture: Annotating, Linking, and Composing Video Content

Explore the architecture of a video web experience with Annodex, allowing for deep linking, metadata, searchability, discoverability, and personalization.

arebecca
Download Presentation

Video Web Architecture: Annotating, Linking, and Composing Video Content

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Architecture of a Video Web - Experience with AnnodexW3C Video WorkshopSilvia PfeifferDec 2007Annodex Association, Xiph.Org, Vquence(originally: CSIRO)

  2. Aim • Make video an integral part of the Web • Everyone can author • Everyone can implement tools • Existing Web developers can apply their knowledge to video (e.g. URI, HTTP, CSS, Javascript) - not re-invent existing Web functionality • Imagine a Web consisting only of video

  3. Requirements • Deep Linking: timed URIs • Metadata: Time-aligned annotations & tags • Searchability: Searching media using text • Dynamic composition of video mashups • Discoverability: Hyperlinking from inside media to other Web resources • Share-ability: Integrated handling of metadata with the content • Personalisation: Dynamic composition of media web content

  4. The Technical Components • CMML: Continuous Media Markup-Language, the HTML of time-continuous data, which allows to markup media • Annodex: Annotated and Indexed Time-Continuous Data Container, which allows synchronised and interleaved exchange of CMML and multi-track binary data over networks • Hyperlinks into Annodex/CMML: temporal offsets & named clips, which allows direct addressing of information inside media using URLs

  5. The Technical Components Search Engine CMML URI Web Server CMML Annodex URI Browser URI Annodex Annodex Annodex URI Future IP-based Consumer Media

  6. CMML example <cmml> <stream basetime=“0” utc=“20040114T153500.00Z”> <import src=“galaxies.ogg” contenttype=“video/ogg" start=“npt:0"/> </stream> <head> <title>Hidden Galaxies</title> <meta name="author" content="CSIRO"/> </head> <clip id=“findingGalaxies” start=“15”> <a href=“http://www.aao.gov.au/galaxies.anx?id=radio”>Related video on Detection of Galaxies</a> <img src=“galaxy.jpg”/> <desc>What’s out there? </desc> <meta name=“KEYWORDS" content=“Radio Telescope, Galaxies"/> </clip> </cmml>

  7. Authoring Annodex from CMML and media continuous media file CMML file Merger Annodex file

  8. Conceptual Annodex File active Annodexed media anchor head galaxies.ogg head media media anchor <head> <title> Hidden Galaxies </title> <meta name="author" content="CSIRO"/> </head> <clip id=“findingGalaxies"> <a href=“http://www.aao.gov.au/> Related video on Detection of Galaxies"</a> <img src=”galaxy.jpg”/> <desc>What’s out there? </desc> <meta name=“KEYWORDS" content=“Astronomy,Radio Telescope, Galaxies"/> </a> start=15 timebase=0

  9. CMML: i18n <?xml version="1.0" encoding="UTF-8" standalone="yes"?> <!DOCTYPE cmml SYSTEM "cmml.dtd"> <cmml lang="pl"> <head lang="en"> <title>Types of fish</title> <meta name="Producer" content="Joe Ordinary"/> <meta name="DC.Author" content="Joe's friend"/> </head> <clip lang="de" id="intro" start="npt:0"> <a href="http://www.blah.au/fish.html">Lesen Sie mehr &#252;ber Fische.</a> <desc lang="en">This is the introduction to the film Joe made about fish.</desc> </clip> <clip lang="en" id="goldfish" start="npt:5:5.9"> <a href="http://www.blah.au/morefish.anx?id=goldfish">More video clips on goldfish.</a> <img src="http://www.blah.au/goldfish.jpg"/> <desc>Joe has a fishtank at home with many colourful fish.</desc> <meta name="Subject" content="goldfish"/> <meta lang="fr" name="sujet" content="poisson d'or"/> </clip> </cmml>

  10. CMML: multiple annotation tracks “track” attribute of clips allows grouping into multiple annotation tracks: <clip track="authors" start="npt:0"> <a href="http://www.blah.au/joe.html">Go to Joe’s home page.</a> <desc>Joe recorded and edited this part of the film.</desc> </clip> <clip track="default" start="npt:0"> <a href="http://www.blah.au/fish.html">Read more about fish.</a> <desc>This is the introduction to the film Joe made about fish.</desc> </clip> <clip track=”authors" start="npt:3.5"> <a href=”http://www.blah.au/claudine.html”>Got to Claudine’s home page.</a> <desc>Claudine recorded this bit of the film.</desc> <meta name="Author" content="Claudine"/> </clip>

  11. A multi-track Annodex file continuous media files CMML file Theora ... Merger (anxenc) Vorbis Annodex file Theora Vorbis

  12. Surfing Video A Firefox Web Browser extension allows streaming of videos. The components are: • A clip table to allow direct access to the sections of the video. • Free text annotation per video clip. • A hyperlink per video clip. • A data display section (for the video itself).

  13. Searching video Using keyword search. Direct access to the offset point of interest. The search engine uses metadata and free text annotations to index the files and retrieve the result list.

  14. Mashup Video - show video demo -

  15. Summary • CMML is simple, but extensible • CMML, timed URIs & Annodex enable a Video Web with CSS for styling and javascript interfaces • More work necessary to meet all requirements, e.g. CSS for video transitions, Web caching, dynamic track composition on the server • All work are open specifications and open source implementations • Standardisation through IETF envisioned, but could turn into a W3C work group and recommendation

  16. www.annodex.netwww.annodex.org

More Related