1 / 18

Intelligent information services

Intelligent information services. The marriage of multimedia presentation and the Semantic Web Dipl.-Inf. Lyndon J B Nixon AG Netzbasierte Informationssysteme Freie Universität Berlin Takustrasse 9, D 14195 Berlin nixon@inf.fu-berlin.de. Introduction: multimedia presentation.

avak
Download Presentation

Intelligent information services

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Intelligent information services The marriage of multimedia presentation and the Semantic Web Dipl.-Inf. Lyndon J B Nixon AG Netzbasierte Informationssysteme Freie Universität Berlin Takustrasse 9, D 14195 Berlin nixon@inf.fu-berlin.de

  2. Introduction: multimedia presentation Multimedia presentation is about communicating an idea to a user through the use of synchronized mixed media The World Wide Web is becoming both ubiquitous and multimedia based Users want access to the information on the Web, and that access must be flexible to differing needs and contexts Text Video Image Audio

  3. Introduction: Semantic Web Knowledge representation techniques allow machines to process data according to its‘ meaning, as modelled in an ontology The Semantic Web is about extending the existing Web of content into a Web of knowledge that can be understood, reasoned about and intelligently processed by computers. An ontology for geneaology Reasoning on knowledge John is a parent of Lucy Maria is a child of Lucy It follows that -> Lucy is a parent of Maria John is a grandparent of Maria (1) A person can be a parent or child of another person (2) If another person is my child, I am their parent (3) The parent of a parent is a grandparent

  4. Introduction: a beautiful marriage? Idea: combine Semantic Web and multimedia presentation to offer users a flexible means for access to their desired information through • Web-based knowledge acquisition and reasoning • Multimedia-based presentation of the information result Internet Service Web of content User expresses an information wish

  5. State of the Art: IMMPS* KNOWLEDGE SOURCES Goal formulation A proposed generic model for Intelligent Multimedia Presentation Systems (IMMPS) Decision making at every stage based on knowledge provided from a server No concrete specification for knowledge representation, querying or manipulation LAYERS KNOWLEDGE SERVER semantics control application content context design user realizes presents design presents * „A Standard Reference Model for Intelligent Multimedia Presentation Systems“, Bordegoni, M. et al User EXTERNAL CONTENT EXTERNAL APPLICATION

  6. Multimedia IR System Semantic Structure Communicative Devices Qualitative Constraints Quantitative Constraints Final Form Presentation HTTP Web Client State of the Art: Cuypers* • A multimedia generation system using a constraint logic programming approach to support backtracking and best fit results Extensions into Semantic Web technologies: • RDF metadata used as basis to infer spatio-temporal relationships between media • OWL ontologies used to define domain and discourse models for the organisation and presentation of media • Acts as an interface to a multimedia database • Semantics limited to annotated media objects • Knowledge for use in generation is fixed before execution * „Towards Second and Third Generation Web-Based Multimedia”, van Ossenbruggen, J. et al

  7. State of the Art: CHIME* An Adaptive Hypermedia System A modular, interoperable architecture An ontological approach for a shared conceptual understanding Research direction multi-agent systems / Semantic Web Services * „CHIME: Service-oriented Framework for Adaptive Web-based Systems“, Chepegin, V.; Aroyo, L.; De Bra, P.; Houben, G.-J. Project focus limited: user modelling & personalisation

  8. Conceptual space Query Tool 1 Rules-based Application Logic Reasoner Resource Space Service Space Service Planner Multimedia model Modeller Formatter Multimedia presentation SWeMPS: architecture Based on a: Generic rule-base Conceptualisation of process Sets of resources and services Abstraction of the result presentation Using „plugged-in“ components to interface the application with external, distributed, heterogeneous data Information request

  9. SWeMPS: ontology The ontology provides a shared understanding of the definition of the multimedia generation process An instantiation of the ontology („knowledge base“) defines the operation of an individual multimedia generation task Three key distinctions made in the model, between subjects, resources and services.

  10. SWeMPS: rules Rule base written using PROVA, a language combining rule-based (Prolog) and object-oriented (Java) approaches. It supports extension with all Java APIs, such as Jena (Semantic Web) or Web Services. assert/retract query handler trigger rules Rulebase knowledge acquisition conceptual space Fact(X) :- Block of Prova code reasoner (Jena) service space service invocation

  11. Case Study: Searching on a user goal Query handler asserts an information goal in the factbase assert(goal(me:betty,gen:relationship,X)) This means „who is related to Betty?“ A rule is triggered by the goal assertion goal(X,Y,Z) :- [code for querying conceptual space] The executed code queries on the conceptual space, including the ontology for family relationships and metadata on my family SELECT ?k_obj WHERE (me:betty, gen:relationship, ?k_obj)

  12. Case Study: Mediation and Reasoning The family metadata is using the GEDCOM ontology which states that Individuals are spouseIn or childIn a Family The query fails, as the metadata has no gen:relationship properties The rulebase supports backtracking: as the rule fails, an alternative is triggered which attempts to map an unknown to a known ontology, e.g.: X gen:wife Y <- X spouseIn Z, X sex „F“, Y spouseIn Z The ontology for family relationships states that the derived properties are all subProperties of gen:relationship, and hence it can be reasoned that: X gen:relationship Y <- X gen:wife Y

  13. Case Study: Resource resolution The information goal‘s answer is that Betty is the wife of Bob, sister of Barb and daughter of Ben and Bessy. The conceptual space references a family photo album, in which the photos are annotated with RDF. A service is invoked to extract knowledge about the family members. Found resources are asserted in the factbase triggering a rule to adapt and add them to the multimedia model. The multimedia model has mappings from the conceptual relationships to communicative abstractions e.g. m_directLeft(R1,R2) :- represents(R1,S1), represents(R2,S2),query(S1,gen:wife,S2)

  14. Case study: Presentation result * Notes result derived from existing knowledge and annotated media information goal can be changed and other presentations generated gaps or mismatches in knowledge can be resolved with dynamic acquisition / mapping presentation can be adapted to additional knowledge Ben Bessy Bob Betty Barb * Images from clipart.freedesktop.org

  15. Conclusion: Needs • A complete framework needs extensions to meet real world needs, e.g.: • Mediation services for resolving ontology mismatches • Semantic Web services framework for the discovery and invocation of services • Ontology and rule management tools

  16. Conclusion: Gains • The SWeMPS framework intends to allow implementers to leverage the (soon..) existing knowledge infrastructure of the Semantic Web • It offers the Semantic Web community a means for making the stored knowledge intuitively accessible to users • It is to be built upon to realise individual Intelligent Information Services for communicating knowledge from given domains to users

  17. Conclusion: An e-business vision • Data providers contractually agree to provide trustworthy content and knowledge to a service provider, who is acting as the host for an Intelligent Information Service • Users make information requests to the service (for a charge, through registration, with an agreement to receive advertising) through various UIs on various devices, to which the final multimedia presentation is adapted Document Repository Media Repository Knowledge Repository Intelligent Information Service Interactive Television PC-based Web UI Mobile Phone

  18. That’s all folks! More at http://page.mi.fu-berlin.de/~nixon/ Thank you for your attention!

More Related