1 / 13

Multimedia Ontology Development Meeting - Status and Future Plans

Review of completed tasks related to upper ontologies, multimedia design, ontology definition for MPEG-7 descriptors, and methodology translation. Discuss models, modeling approach, tool requirements, and ongoing implementation plans.

lhomer
Download Presentation

Multimedia Ontology Development Meeting - Status and Future Plans

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Working meeting of WP4Task WP4.1 Richard Arndt, KU JRS, ITI, CWI, DFKI, UEP

  2. Status of previous APs • AP3.4.11 (UEP, KU, ITI, CWI)Survey on modelling upper OntologiesDate: 2006-06-30Status: Completed • AP3.4.12 (UEP, KU, CWI and ITI)Survey on existing upper OntologiesDate: 2006-07-15Status: Completed

  3. Status of previous APs • APs related to the design of the multimedia ontology • AP3.4.13 (ITI and KU)Define ontology for MPEG-7 visual descriptors • AP3.4.15 (KU)Define Ontology for MPEG-7 audio descriptors • AP3.4.18 (CWI, KU)Define Ontology for MPEG-7 multimedia descriptors • AP3.4.20 (KU, JRS, ITI and CWI)Define Ontology for MPEG-7 structuring descriptors • AP3.4.22 (UEP, CWI and ITI)Define Ontology for MPEG-7 based administrative meta data • Date: 2006-06-30Status: Completed through definition of a methodology to translate MPEG-7 description tools into DOLCE DOLCE-aligned multimedia ontology(Collaboration between KU and UEP)

  4. Status of previous APs • Additional work concerning design of multimedia ontology • AP3.4.13Define ontology for MPEG-7 visual descriptorsNew version of Visual descriptor Ontology (ITI) • AP3.4.17Define the Ontologies for textual descriptorsLingInfo ontology(DFKI) • AP3.4.20Define Ontology for MPEG-7 structuring descriptorsDefinition of an OWL ontology that covers a part of the DAVP MPEG-7 profile of JRS (Collaboration between JRS and CWI)

  5. Concept of the new Multimedia Ontology • Modelling approach: • Use of DOLCE and its two design patterns for Descriptions & Situations (D&S) and Information Objects (OIO) as a modelling basis • Creation of multimedia design patterns based on D&S and OIO to formalize • MPEG-7 decomposition descriptors(e.g. spatial image segmentation) • MPEG-7 annotation descriptors(e.g. visual descriptors, segment masks, media information) • Complex and/or nested MPEG-7 data types, ... • Patterns allow translation of MPEG-7 descriptors into DOLCE vocabulary Extensible multimedia ontology due to DOLCE-alignment • Details: Tomorrow in the plenary meeting ...

  6. Status of previous APs • AP3.4.24 (KU, UEP, CWI)Investigate the MPEG – 7 semantics partResult: Semantics part not feasible to express domain dependent knowledge  Semantics will be expressed by domain ontologies • AP3.4.25 (KU)Define additional semantic descriptionsResult: Not necessary any longer  Multimedia ontology will be linked with domain ontologies by applying an already defined design pattern

  7. Status of previous APs • AP3.4.27 (DFKI)Provide example data + domain for annotationDate: 2006-05-31Status: Completed • AP3.4.28 (UEP, ITI, KU, CWI and JRS)Conduct a functional study of manual annotation tools (requirements and survey of existing tools)Date: 2006-06-31Status: Completed • AP3.4.29 (KU)Specify the architecture and choose development toolsDate: 2006-07-30Status: Ongoing (M-OntoMat Annotizer 2.0, cooperation between ITI and KU)

  8. Open APs • Implementation of multimedia ontologyDate: 2006-09-30 • AP3.4.14 • AP3.4.16 • AP3.4.19 • AP3.4.21 • AP3.4.23 • AP3.4.26 • Ontology will be implemented according to the needs of the project  We need to know which MPEG-7 description tools are needed for content description in WP3  Implementation will start after this

  9. Open APs • AP3.4.30Implementation of first prototype of the annotation toolDate: 2006-11-15 • Implementation will start immediately after this meeting • Parallel development of two tools for: • Image annotation (M-OntoMat Annotizer 2.0, ITI and KU) • Video annotation (JRS annotation tool, JRS and CWI) • M-OntoMat Annotizer 1.0 and JRS annotation tool will be demonstrated tomorrow

  10. APs to prepare M12 DeliverablesMultimedia Ontology Infrastructure • AP1 (KU, UEP)Date: 2006-09-15 Write a detailed description of the design patterns and their usage (part of D4.1) • AP2 (JRS, KU, ITI, CWI)Date: 2006-09-15 Determine which MPEG-7 descriptors are needed for the annotation tool prototypes • AP3 (UEP)Date: 2006-10-15 Use the design patterns of the multimedia ontology to implement the descriptors from AP2 in an OWL ontology • Create a Protégé project and submit it to the K-Space SVN repository • Implement the design patterns based on the DOLCE OWL code • Implement the descriptors

  11. APs to prepare M12 DeliverablesMultimedia Ontology Infrastructure • AP4 (UEP, DFKI)Date: 2006-10-15 Ensure that the example domain ontology which was provided by DFKI can be used in combination with the OWL multimedia ontology to annotate the example images • Integrate the domain ontology in the multimedia ontology SVN repository • Add some example annotations to the SVN repository that demonstrate how the annotation is carried out (part of D4.1)

  12. APs to prepare M12 DeliverablesAnnotation Tool • AP1 (KU, ITI)Date: 2006-11-15 Implement the M-OntoMat Annotizer 2.0 plugin for OntoMat 0.82 according to the architecture draft. First prototype of M-OntoMat Annotizer 2.0 has to provide • Semantic annotation of image segments according to the new multimedia ontology infrastructure • Export to RDF (and probably storage in the new WP5 metadata store) • AP2 (JRS, CWI)Date: 2006-11-15 Implement a prototype for video annotation • The tool should be compliant with the new multimedia ontology infrastructure, If possible. • AP3 (KU, ITI, JRS, CWI)Describe the architecture of the tools and their functionalities (part of D4.1)

  13. Goals for the next 6 months • Cooperation with WP3 to determine MPEG-7 descriptors (or other annotations) that are used to describe multimedia content • Integration of the WP3 descriptors in the OWL multimedia ontology • Extension of the functionalities of the annotation tools • M-OntoMat Annotizer 2.0: • Extraction of low level features for segments • Querying of annotated data • JRS Video Annotation Tool: • ??

More Related