240 likes | 344 Views
Description of some multimedia ontologies. Rapha ë l Troncy. Thursday 1 st of December, 2005. Raphael.Troncy@cwi.nl. Multimedia Ontologies. Multimedia ontologies can be related to many works, standards, communities … Focus here on MPEG-7 ... as a whole
E N D
Description of somemultimedia ontologies Raphaël Troncy Thursday 1st of December, 2005 Raphael.Troncy@cwi.nl
Multimedia Ontologies • Multimedia ontologies can be related to many works, standards, communities … • Focus here on MPEG-7 ... as a whole • ISO Standard composed of 11 parts but it is still growing … • DDL = XML Schema + small extensions • Descriptors and Description Schemes • 1182 elements, 417 attributes, 377 complex types in the schema (MDS + Visual + Audio parts) • 40 Classification Schemes
Agenda • DSTC's Proposal • Jane Hunter & Suzanne Little (ABC model) • TUC's Proposal • Chrisa Tsinaraki (DELOS) • INA's Proposal • Antoine Isaac & Raphaël Troncy • DMAG/MTG's Proposal • Roberto Garcia & Oscar Celma
DSTC's Proposal (summary) • 1st proposal chronologically • MPEG-7 ontology developed in RDFS, then converted into DAML+OIL and now OWL • Contains 60 classes and 40 properties • OWL Full ontology • Cover the upper level of the MDS • segments and decomposition • agent, role, place, time and instrument • basic visual descriptors • Available at: http://maenad.dstc.edu.au/slittle/mpeg7.owl
TUC's Proposal • Software Engineering Framework aiming to facilitate Knowledge-based MPEG-7 Multimedia Application Development • Being developed in TUC/MUSIC • Consists of: • An Ontological Infrastructure • Methodologies for Interoperability between MPEG-7 and OWL • An underlying MPEG-7 Repository • Tools implementing the DS-MIRF approach
DS-MIRF Ontological Infrastructure • An Upper Ontology that fully captures the MPEG-7 MDS and a part of the MPEG-7 Visual • Being extended to capture the MPEG-21 DIA Architecture • Transformation Rules to transform OWL Ontologies and OWL/RDF metadata into MPEG-7 documents • Implemented in the GraphOnto Ontology and Metadata Editor
TUC's Ontology Definition Methodology • Manual definition based on the following rules: • MPEG-7 Simple Datatype Representation: Integration of the XML Schema simple datatypes (rdfs:Datatype) • MPEG-7 Complex Type Representation: Homonym OWL Classes • Attributes & Simple Type Elements: Datatype Properties • Complex Type Elements: Object Properties • Subclassing: • Simple Types: Datatype property with rdf:ID “type_nameContent” – where type_name is the type of the supertype • Complex Types: rdfs:subclassOf • Constraints: OWL Restrictions • MPEG-7 Classification Scheme Representation: Individuals of the MDS type “ClassificationSchemeType”
TUC's Proposal (summary) • Cover the full standard • Contains 420 classes and 175 properties for the MDS part • OWL DL • Cover also the CSs • The 40 CSs have been translated into simple OWL hierarchy • Available at: http://elikonas.ced.tuc.gr/ontologies/av_semantics.zip
INA's Proposal • Different uses of AV Document Descriptions • Archival and description of documents from a cultural heritage point of view: INA • Exchanging program identification and characterization for interactive TV: TV-Anytime • Diffusion of program information (news agencies): ProgramGuideML • Storing and sharing AV content descriptions (automatic extraction results): MPEG-7 standard
Can we find an AV core ontology? • There are many common needs amongst observed applications • Characterization of programs and sequences • Decomposition of programs and sequences • Ability to introduce description of the activities that constitute the context of AV documents (roles of people involved, ways production and broadcast are achieved) • These concepts are close to a "neutral" archival viewpoint
C.O. content • Concerning AV objects: • distinction sequence/program • decomposition and qualification of those objects • link to external world themes and entities (content description) • Underlying use patterns for elicited categories
INA's Proposal (summary) • Cover the MDS upper part, and partially the audio and visual parts • Contains 610 classes • OWL DL • Cover also (partially) the CSs • adapted to TV Anytime (and ProgramGuideML) • adapted to INA's needs • Linked to the DOLCE ontology • Available at: http://www.cwi.nl/~troncy/MPEG-7/
DMAG/MTG's Proposal • Reuse MPEG-7 implicit semantics. • XMLSemantic Web: • XSD2OWL: schema to ontology. • XML2RDF: XML instance data to RDF instances. • Tested as integration base for:MusicBrainz, Simac, Music Vocabulary, etc.
XML Schema OWL rdf:Property owl:DatatypeProperty owl:ObjectProperty element|attribute element@substitutionGroup rdfs:subPropertyOf element@type rdfs:range complexType|group|attributeGroup owl:Class complexType//element owl:Restriction extension@base|restriction@base rdfs:subClassOf @maxOccurs @minOccurs owl:maxCardinality owl:minCardinality sequence choice owl:intersectionOf owl:unionOf XMLSchema to OWL Mappings
DMAG/MTG's Proposal (summary) • Cover the whole MPEG-7 + the upper level of the Classification Schemes • Contains 2372 classes and 975 properties • OWL Full • Available at: http://dmag.upf.edu/ontologies/mpeg7ontos/
Towards an harmonization of these multimedia ontologies Raphaël Troncy Thursday 1st of December, 2005 Raphael.Troncy@cwi.nl
Preliminary results • Current state: • Proposals are made individually, for specific research project • The OWL files contains some errors • Corrected versions available for DSTC and DMAG/MTG ontologies • Different conceptualizations have been obtained … even if they start from the same MPEG-7 schema • No MPEG-7 endorsement
(Personal) Idea: Three step process • Aligning pair-wise ontologies • Visual part of aceMedia vs DMAG vs TUC • MDS part of Hunter vs DMAG vs TUC vs INA • CSs part of DMAG vs TUC vs INA • Merging and fusing • Re-engineering (manually) ! • Current proposals are based on automatic translation rules from XSD to OWL (except INA) • Does NOT go beyond what XML Schema can express
Open Issues • OWL DL vs OWL Full • Real modularization of MPEG-7 • upper part, visual, audio, CSs • requires breaking some existing relationships ! • Do we have to capture all MPEG-7 ? • people, agent, role, place are not multimedia-specific • Are there more multimedia ontologies currently developed ? • Proton: http://proton.semanticweb.org/ • Boemie: re-use the aceMedia ontologies (MDO, VDO)