1 / 32

PC Chairs Lynda Hardman Alex Hauptmann Nadia Magnenat-Thalman

SAMT 2008 Semantics and Digital Media Technology Koblenz, December 3-5, 2008 http://samt2008.uni-koblenz.de. PC Chairs Lynda Hardman Alex Hauptmann Nadia Magnenat-Thalman. General Chairs Dietrich Paulus Steffen Staab. Semantic Web as a Knowledge Infrastructure for Multimedia.

flint
Download Presentation

PC Chairs Lynda Hardman Alex Hauptmann Nadia Magnenat-Thalman

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. SAMT 2008 Semantics and Digital Media TechnologyKoblenz, December 3-5, 2008http://samt2008.uni-koblenz.de PC Chairs Lynda Hardman Alex Hauptmann Nadia Magnenat-Thalman General Chairs Dietrich Paulus Steffen Staab

  2. Semantic Web as a Knowledge Infrastructure for Multimedia Steffen Staab

  3. Depict ISWeb People! Precision 12/12 Recall 12/19 (FTE)  12/33 (all)  Context is missing!

  4. Depict ISWeb People! There is a picture of ISWeb in 2006 in the Wiki!

  5. Depict ISWeb People! Some more ISWeb members you find on our Web page!

  6. Depict ISWeb People! Outside of our Web Site you may also discover current members…

  7. Depict ISWeb People! For others, you need to integrate information from the Web and from Word documents of my mailbox

  8. Knowledge Infrastructure A Multimedia objects exist in an environment. This environment (context) can and should be used to find, access and present the objects. Well, known in the multimedia field Knowledge about Multimedia Objects exists in an environment, too. This knowledge infrastructure can and should be used to find, access and present the objects. Little explored until now

  9. Structure of the Environment • Knowledge in Portal • Knowledge in File System • Knowledge in Wiki • Knowledge in Outside Service • Knowledge in Mailbox

  10. Structure of the Environment • Collect or Access • Harvest/Query Knowledge • Collect & Organize Knowledge • Use Knowledge

  11. What does the Knowledge Infrastructure need? • Ontologies • Multimedia Ontologies • Context Ontologies • Domain Ontologies • APIs • Querying and reasoning

  12. How to structure this knowledge? Region Person

  13. Scenario Reg1 The "ISWeb" at Bad Kreuznach (team web page) Summer School Semantic Web-05 (video) • Localize a region (person) • Annotate the content (interpretation)Carsten Saathoff, aceMedia Project lead, ISWeb, Semantic Multimedia, KAT Annotation Tool • Link to knowledge on the Web:Reg1 foaf:depictskodemaniak:me • kodemaniak:me rdfs:label“Carsten Saathoff"kodemaniak:merdf:typefoaf:Person

  14. Problem Reg1 Seq1 Seq4 The "ISWeb" at Bad Kreuznach (team web page) Summer School Semantic Web-05 (video)  Multimedia O • Multimedia objects are complex • Compound information objects, fragment identification • Semantic annotation • Subjective interpretation, context dependent • Linked data principle • Open to reuse existing knowledge  Context O  Domain O

  15. Example: Fragment Identification with COMM http :// en . wikipedia . org / wiki / Image : Yalta _ Conference . jpg dns : realized - by core : image - data dns : plays loc : region - loc : spatial - mask - locator - descriptor role dns : played - by dns : defines loc : bounding - box 5 25 10 20 15 15 10 10 5 15 " ^^ xsd : string data : has - rectangle Reg1 http://isweb.uni-koblenz.de/People/isweb-2007.jpg http://isweb.uni-koblenz.de/People/isweb-2007.jpg

  16. Example: Region Annotation with COMM Reg1 http://isweb.uni-koblenz.de/People/isweb-2007.jpg What is important here, is what you don‘t see! http://kodemaniak.de/ foaf.rdf#me

  17. Another Scenario ... Noam Colleagues “Thanks for your application and here is some information about the NeOn project…” “Please prepare papers for his hire, Mrs. Werger“ Steffen “I apply for this position. Here is my cover letter and CV ...” Mrs. Werger Bercovici.pdf Bercovici.pdf

  18. Metadata from contexts other than file browsing is notavailable, we cannot • inspect conversations in which a file took part • find out about the web page from whichit was downloaded • view the event description for which it was created • see the task it is associated with (as input or output) … Contextualized Information Noam Bercovici.pdf ? Colleagues “I apply for this position. Here is my cover letter and CV ...” Context of multimedia information is lost

  19. … Communicating Communication Context of multimedia information is lost Noam Steffen VoIP

  20. …classifying information… Classification of multimedia information is lost

  21. X-COSIM Ontology Filing, Downloading, Modifying, Converting Sharing, Arguing, Explaining Communication Realization Descriptions and Situations Descriptions and Situations Classification (De)Composition Descriptions and Situations Descriptions and Situations Structuring, Summarizing, User-defined Ontologies Creating, Reusing, Copy & Paste

  22. DOLCE for Developers of E-mail Clients? X-COSIM Architecture File Manager, Browser, Mail Client, Task Manager, Text Processor, ... Apps,DomainModels Dublin Core, Calendar, Foaf, ... ? Map between contextualized representations and the reference model X-COSIMA DataAccess,Mapping RDF API SPARQL X-COSIMO ReferenceModel, Storage RDF Store Particular Perdurant Abstract Quality Endurant Situation Description // Create realization metadata for bikeImage: // Storage on harddisk, Format jpeg FileSystemRealization bikeImageRealization = new FileSystemRealization( bikeImage, new File(new URI("file:/myPics/bikeImage.jpg")), RealModule.I_jpeg); email.addAttachment(bikeImageRealization); // Create some addresses and agents carsten and thomas Address addressCarsten = new Address("saathoff@uni-koblenz.de"); Agent carsten = new Agent(addressCarsten); Address addressThomas = new Address("franz@uni-koblenz.de"); Agent thomas = new Agent(addressThomas); // Create an information object representing the information given by some image InformationObject bikeImage = new InformationObject("bikeImage");

  23. Resulting Meta Data Steffen Noam CommunicationAspect RealizationAspects ClassificationAspect Noam ProcessAspects

  24. What does the Knowledge Infrastructure need? • Ontologies • Multimedia Ontologies • Context Ontologies • Domain Ontologies • APIs • Querying and reasoning Jump to end

  25. Where are these metadata? Steffen Noam Email MMDB Nasir Server ProcessAspects

  26. Federation of Knowledge Nasir

  27. Networked Graphs Images of team members depict part of the group :NasirFOAF { :NasirFOAF dc:creator :Nasir . :Nasir :depictIn http://nas.jpg.} :ISWebFOAF { :ISWeb foaf:name „Info Syst…“. :ISWeb :member :Nasir. :ISWeb :depictIn http://..wiki1.jpg. :ISWebFOAF g:definedBy „CONSTRUCT {?X :depictIn...“ . } :ISWeb :depictIn http://nas.jpg . :ISWebWiki { kodemaniak:me :member :ISWeb . Kodemaniak:me:depictIn :WikiImg1 . :ISWeb :depictIn http://..wiki1.jpg .} Copy images that depict ISWeb

  28. Meta Knowledge :NasirFOAF { :NasirFOAF dc:creator :Nasir . :Nasir :depictIn http://nas.jpg.} :ISWebFOAF { :ISWeb foaf:name „Info Syst…“. :ISWeb :member :Nasir. :ISWeb :depictIn http://..wiki1.jpg. :ISWeb :depictIn http://nas.jpg . :ISWebFOAFMeta { :ISWebFOAF provenance :NasirFOAF . :ISWebFOAF provenance :ISWebWiki . } :ISWebWiki { kodemaniak:me :member :ISWeb . Kodemaniak:me:depictIn :WikiImg1 . :ISWeb :depictIn http://..wiki1.jpg .}

  29. Take home message • Knowledge Structures of Multimedia • Knowledge Infrastructure • Knowledge Capture • Semantic Web ties them together • Some first steps are done: • Standardization of Semantic Weblanguages • RDF carried along with some media: RDF in PDF, RDF-A in Open Document Format • Interesting Issues: • Standardization of generic protocols • Management of heterogeneity of data, applications and services • Mixed systems of reasoning and low level extraction • ….

  30. Systems & Literature • COMM Ontology & API: http://comm.semanticweb.org/ • X-Cosim Ontology & API:http://isweb.uni-koblenz.de/Research/x-cosim • Networked graphs: http://isweb.uni-koblenz.de/Research/NetworkedGraphs • Querying for meta knowledge:http://isweb.uni-koblenz.de/Research/MetaKnowledge • Distributed querying:http://isweb.uni-koblenz.de/Research/DistributedSPARQL ISWC-2007 K-Cap-2007 WWW-2008a WWW-2008b …to be written…

  31. Thank You!

  32. SAMT 2008 Semantics and Digital Media TechnologyKoblenz, December 3-5, 2008http://samt2008.uni-koblenz.de PC Chairs Lynda Hardman Alex Hauptmann Nadia Magnenat-Thalman General Chairs Dietrich Paulus Steffen Staab

More Related