1 / 37

WP6: Integration

This document presents the theoretical analysis and design of integrated architectures for the integration of different anticipatory mechanisms in cognitive processes.

droberson
Download Presentation

WP6: Integration

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. WP6: Integration Overview D6.1: Theoretical Modelling and Design of Integrated Architectures MindRACES, First Review Meeting, Lund, 11/01/2006

  2. WP6: Integration • Goals of the project related to WP6 • Integration of different anticipatory approaches and mechanisms concerning different cognitive processes • Identification of complex cognitive tasks whose successful completion needs integrated anticipatory mechanisms MindRACES, First Review Meeting, Lund, 11/01/2006

  3. WP6: Main tasks • Task 1:Theoretical analysis of the mechanisms that are better suited to work together • Task 2:Implementation of preliminary integrated architectures • Task 3:Performance tests of fully integrated architectures and the final evaluation of their performance MindRACES, First Review Meeting, Lund, 11/01/2006

  4. Theoretical modeling and design of integrated architectures… • Deliverable 6.1 • Methodology for integration analysis • Results of the preliminary analysis • Starting point for Task 1: Identify the problems and tasks in the scenarios which can be solved only or much easier by the integration of two or more anticipatory mechanisms MindRACES, First Review Meeting, Lund, 11/01/2006

  5. Theoretical modeling and design of integrated architectures. • Integration analysis structure • Problems and situations in the scenarios requiring integration of anticipation mechanisms • Anticipatory mechanisms whose integration will provide the solution • Possible ways of integration • Evaluation of the effect of the integration MindRACES, First Review Meeting, Lund, 11/01/2006

  6. Background…(based on Deliverable 4.1) • General cognitive processesare the processes, different from prediction, needed by any architecture like perception, categorization, memory organization etc. • Prediction refers to the capability of predicting future properties or events • Anticipation refers to general processes that use predictions to improve behaviour/decisions/… MindRACES, First Review Meeting, Lund, 11/01/2006

  7. Background… General cognitiveprocesses Prediction Anticipation MindRACES, First Review Meeting, Lund, 11/01/2006

  8. Background… • Example I • General cognitive processes: Perception, learning • Prediction: Based on the perceived scene the system predicts which part of the scene might be relevant to the task • Anticipation: The system processes first and in more detail the part of the information predicted to be important MindRACES, First Review Meeting, Lund, 11/01/2006

  9. Background… • Example II • General cognitive processes: Perception, retrieval from memory, reasoning • Prediction: Based on the categorized scene and reasoning by analogy the system predicts which part of the scene is relevant to the task • Anticipation: The system processes first and in more detail the part of the information predicted to be important MindRACES, First Review Meeting, Lund, 11/01/2006

  10. Background… • Predictive capabilities can be classified according to: • the types of predictions • the quality or accuracy of the predictions • the time scales of the predictions • the generality of the predictions • the capability of incorporating context information • the focusing and attention capabilities of prediction • the capability of predicting inner states MindRACES, First Review Meeting, Lund, 11/01/2006

  11. Background. • Anticipatory capabilities distinguish the influence of predictions on • Learning • Perception and attention • Action initiation and control • Decision making • Retrieval from memory • Reasoning • … MindRACES, First Review Meeting, Lund, 11/01/2006

  12. Integration of anticipatory mechanisms: Analysis… • Example III (integration) • General cognitive process: Perception • Prediction: Both predictive mechanisms (from Example I and Example II) are used and a special mechanisms (competition, learning etc.) determines how the results of both will be accounted for • Anticipation: The system processes first and in more detail the part of the information predicted to be important MindRACES, First Review Meeting, Lund, 11/01/2006

  13. Integration of anticipatory mechanisms : Analysis… Integrationin time Interaction bwn the integratedmechanisms Integration within single or different general cognitive processes MindRACES, First Review Meeting, Lund, 11/01/2006

  14. Integration in time • Sequential • Mechanisms occur one after the other • Can be separated by other mechanisms • Parallel • Mechanisms run in parallel • Overlapping • One of the processes must have started in order for the other to begin or/and one of the processes must have stopped in order for the second to stop MindRACES, First Review Meeting, Lund, 11/01/2006

  15. Integration within general cognitive processes • A single process: e.g. top-down and bottom-up prediction mechanisms in attention • Different processes: e.g. an experienced emotion prepares the system to function more intensively and this facilitates another prediction mechanism like analogical transfer MindRACES, First Review Meeting, Lund, 11/01/2006

  16. Interaction between the integrated mechanisms… • Direct interaction • One mechanism essentially uses the results from another • The results from two or more prediction mechanisms are needed for a subsequent general or predictive mechanism • The mechanisms work together and cannot be separated MindRACES, First Review Meeting, Lund, 11/01/2006

  17. Interaction between the integrated mechanisms… • Indirect interaction • The influence among predictive mechanisms are mediated by other general mechanisms and processes MindRACES, First Review Meeting, Lund, 11/01/2006

  18. Interaction between the integrated mechanisms… • E.g.: Interaction in sequential mechanisms • Occur one after the other and the results of the first are used by the next • The mechanisms occur one after the other but the next is not directly related to the first but is mediated by another mechanism (memory retrieval, arousal etc.) • The first triggers/controls the second • … MindRACES, First Review Meeting, Lund, 11/01/2006

  19. Interaction between the integrated mechanisms. • E.g.: Interaction in parallel mechanisms • Are independent but the results from all of them are needed by a third mechanism • Compete and only the result of the winner is used • Cannot be separated and every mechanism uses the results from the others • Are related to different processes: e.g. arousal of the system and decision making, emotion felt and retrieval from memory etc. MindRACES, First Review Meeting, Lund, 11/01/2006

  20. Results:Main integration focuses • Selective attention • LSTM • Emotions • Context effects • Integration of symbolic and sub-symbolic approaches • Object recognition and encoding • Environment model learning • … MindRACES, First Review Meeting, Lund, 11/01/2006

  21. Results:Preliminary Integration Plan MindRACES, First Review Meeting, Lund, 11/01/2006

  22. IDSIA • LUCS • Context-sensitive reinforcement learning methods • UW-COGSCI • Combined hierarchical bottom-up/top-down approach MindRACES, First Review Meeting, Lund, 11/01/2006

  23. IDSIA Vision, selective attention selection and object recognition Environment model ICTC-CNR Planning Knowledge representation Deliberative model with emotions IST… MindRACES, First Review Meeting, Lund, 11/01/2006

  24. IST. • LUCS • Vision, selective attention and object recognition • NOZE • Planning • Environment model MindRACES, First Review Meeting, Lund, 11/01/2006

  25. ISTC-CNR… • IDSIA • Perception and concept formation • Learning a model of the environment • Selective attention and saliency maps • Optimal mechanisms for statistical learning • Visual identification of objects or relevant aspects of objects MindRACES, First Review Meeting, Lund, 11/01/2006

  26. ISTC-CNR… • LUCS • Perception and concept formation • Selective attention and saliency maps • Visual identification of objects • NOZE • A Schema mechanism • Anticipatory behavioural control • Action selection by predictive RL MindRACES, First Review Meeting, Lund, 11/01/2006

  27. ISTC-CNR… • OFAI • Perception and concept formation • Optimal mechanisms for statistical learning • A Schema mechanism • Anticipatory behavioural control MindRACES, First Review Meeting, Lund, 11/01/2006

  28. ISTC-CNR. • UW-COGSCI • Learning a model of the environment • A Schema mechanism • Anticipatory behavioural control • Action selection by predictive RL MindRACES, First Review Meeting, Lund, 11/01/2006

  29. LUCS… • IDSIA • Hierarchical prediction • LSTM • ISTC-CNR • Knowledge based prediction • Surprise based shift between deliberative and automatic control of action MindRACES, First Review Meeting, Lund, 11/01/2006

  30. LUCS. • NBU • Anticipation by analogy • NOZE • Knowledge based prediction • OFAI • Artificial immune systems • UW-COGSCI • Hierarchical prediction MindRACES, First Review Meeting, Lund, 11/01/2006

  31. NBU… • IDSIA • Schemas with condition-action- prediction part • Planning and control • IST • Emotions MindRACES, First Review Meeting, Lund, 11/01/2006

  32. NBU. • ISTC-CNR • Learning and Knowledge base(s) management • Emotions • LUCS • Selective attention at the perception level • UW-COGSCI • Schema mechanisms • Planning and control MindRACES, First Review Meeting, Lund, 11/01/2006

  33. NOZE • ISTC-CNR • An extensible cross language protocol • A concurrency mechanism • A computational resources controller • Prediction based on different models MindRACES, First Review Meeting, Lund, 11/01/2006

  34. OFAI • ICTC-CNR • Integration of sensory flow at multiple levels of time abstraction • Qualitative decision making (Logics) • Emotion Module • LUCS • Selective attention & vision MindRACES, First Review Meeting, Lund, 11/01/2006

  35. UW-COGSCI... • IDSIA • Hierarchical predictions • Sequential prediction • Change prediction • Anticipatory object recognition • Integration of motivations MindRACES, First Review Meeting, Lund, 11/01/2006

  36. UW-COGSCI... • IST • Integration of emotions • ISTC-CNR • Sequential prediction • Change prediction • Anticipatory object recognition • Integration of emotions MindRACES, First Review Meeting, Lund, 11/01/2006

  37. UW-COGSCI. • LUCS • Use of context information • Selective attention • OFAI • Sequential prediction; • Anticipatory object recognition; • Integration of motivations. MindRACES, First Review Meeting, Lund, 11/01/2006

More Related