1 / 26

Presenting Knowledge on the Semantic Web

Presenting Knowledge on the Semantic Web. Lynda Hardman Multimedia and Human-Computer Interaction Frank Nack Jacco van Ossenbruggen Lloyd Rutledge http://media.cwi.nl. Long-term goal. Develop knowledge-intensive models and document processing technologies that are able to:

hunter-blankenship
Download Presentation

Presenting Knowledge on the Semantic Web

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Presenting Knowledgeon the Semantic Web Lynda Hardman Multimedia and Human-Computer InteractionFrank NackJacco van Ossenbruggen Lloyd Rutledge http://media.cwi.nl

  2. Long-term goal • Develop knowledge-intensive models and document processing technologies that are able to: generate coherent multimedia presentations tailored to an individual user taking into account their preferences, abilities, device capabilities and environment.

  3. Goals of research • Understand how to • incorporate design and discourse knowledge into multimedia presentations • represent this knowledge in Web and Semantic Web technologies • Semantic Web provides • source content for inclusion in presentations • a means of expressing knowledge needed

  4. Vox Populi Noadster Topia, DISC Cuypers From syntax to semantics Semantics AmsterdamHypermedia Model Syntax Time

  5. Vox Populi Noadster Topia, DISC Cuypers From syntax to semantics Semantics AmsterdamHypermedia Model Syntax Time

  6. Space/time trade-offs

  7. Space/time trade-offs • Media repository from Rijksmuseum • Quantitative constraints insufficientusing pixel-based positioning • Qualitative constraints also usedspecification of constraints at higher levelA not-overlap B, B after C • If insoluble then backtrack to other solutions using Prolog • Joost GeurtsMMM 2001, WWW 2001

  8. Vox Populi Noadster Topia, DISC Cuypers From syntax to semantics Semantics AmsterdamHypermedia Model Syntax Time

  9. Inferring document structure

  10. Inferring document structure • Topia • Rijksmuseum ARIA database -> RDF • Clustering on results of query • Presentation showing “table of contents” and current focus • Lloyd RutledgeACM Hypertext 2003

  11. Semantic graph to presentation

  12. Semantic graph to presentation • DISC • Rijksmuseum repository of media items • Semantic graph is not enoughRembrandt married-to Saskiaalso need discourse structuresfor deriving grouping, ordering and priorities • Biography template createdpainter is-a profession • Stefano Bocconi, Joost GeurtsISWC 2003

  13. Vox Populi Noadster Topia, DISC Cuypers From syntax to semantics Semantics AmsterdamHypermedia Model Syntax Time

  14. Semantic Web browsing • Noadster • Generalised semantic web browsing • Integrating global and local browsing • Lloyd Rutledge,WWW 2005

  15. Vox Populi Noadster Topia, DISC Cuypers From syntax to semantics Semantics AmsterdamHypermedia Model Syntax Time

  16. Argument generation in video

  17. Argument generation in video • Vox Populi • Database of video clips • Annotated with topic and agree/disagree • Argumentation model (Toulmin) • User specifies query and video sequence generated • Stefano Bocconi,ICME 2005

  18. Scientific challenges • Making (multimedia) discourse and design knowledge explicit • Expressing re-usable semantics of media assets • Designing architectures for multimedia presentation generation

  19. Design dependencies Aesthetics Presentation structure abcdefghij abcdefghijk ABCDEFGHIJK abcdefghijk abcdefghijk Content

  20. cityscapes Vermeer 1623 1658 1665 1628 1665 genre Presentation structure depends on content

  21. DomainModel Domain selection Discourse organization UserModel MetadataDB Presentation design DiscourseModel Constraint layer MMDB DesignModel MediaModel DeviceProfile System architecture

  22. Conclusions • Long term goal since a long way • From projects described we have learned much: • distinguish stages in process • separate discourse knowledge • mappings between domain and discourse knowledge • User is still very much missing • new projects: CHIP user interaction, partner RijksmuseumPassepartout media installation, partner V2_ • Starting work on investigating properties of time • in order to display to the user: MultimediaN

  23. This research is supported by • NWO I2RPIntelligent Information Retrieval and Presentation • NWO CHIMECultural Heritage in an Interactive Multimedia Environment • NWO NASHNetworked Adaptive Structured Hypermedia • Telematica Instituut Topia • Images courtesy of Rijksmuseum, Amsterdam

More Related