150 likes | 261 Views
6 th Framework Programme - Priority 2 “Information Society Technologies” FP6/2003/IST/2. Joint-Action. Science and Technology. Joint Action Science and Technology JAST - FP6-003747. Ruud Meulenbroek Nijmegen Institute for Cognition and Information Radboud University Nijmegen, NL
E N D
6th Framework Programme - Priority 2 “Information Society Technologies” FP6/2003/IST/2 Joint-Action Science and Technology Joint Action Science and TechnologyJAST - FP6-003747 Ruud Meulenbroek Nijmegen Institute for Cognition and Information Radboud University Nijmegen, NL JAST - IPM
Joint-Action Science and Technology Overview • Goals • Means • Co-ordinator • Organization • Activities • Website • Delegation
1. Goals • Cognitive Systems • JAST will extend cognitive science beyond the domain of studying individual cognitive systems • Ultimate goal of JAST • To build jointly-acting autonomous systems that communicate and work intelligently on non-trivial mutual tasks • Primary goal • Understanding the cognitive architecture of collaborating cognitive systems
2a. Means: Consortium Partners • Radboud Universiteit Nijmegen- Nijmegen Institute for Cognition and Information - FC Donders Centre for Cognitive NeuroimagingThe Netherlands – NICI + FCDC (Bekkering, Meulenbroek, Hagoort, Toni) • Max Planck Institute for Biological Cybernetics, TübingenGermany – MPIT (Buelthoff, Thornton, Chatziastros) • Institute of Communication and Computer Systems, AthensGreece– ICCS (Uzunoglu et al.) • The University of EdinburghUnited Kingdom – UEDIN (Gurman-Bard, Carletta, Oberlander) • Max Planck Institute for Psycholinguistics NijmegenThe Netherlands – MPIN (Levinson, de Ruiter) • Technische Universität MünchenGermany – TUM (Knoll et al.) • Universidade do MinhoPortugal – UMP (Bicho, Erlhagen)
2b. Means: Multidisciplinary team PartnersDisciplines • NICI Neurocognitive scientists • FCDC id. • MPIT Cognitive scientists • ICCS Neuroscientists • UEDIN Psycholinguists • MPIN id. • TUM Robotocists • UMP id.
Joint-Action Science and Technology 2c. Means: Common Scenario Arbitrary initial object layout Resulting objects after completion of multimodal dialogue sequence
Joint-Action Science and Technology 2d. JAST Construction Task (video)
2e: State-of-the-art starting conditions:Demonstrator-Hardware • Two directly cooperating arms.A third arm may be used for holding aggregates • Assembly without any fixtures orspecialised tools • A rich set of action primitives(motor, sensor, sensorimotor) hasbeen implemented for positioning,grasping, assembling, disassembling,goal-directed motion under collisionavoidance, etc. • Robust recognition and manipulationof parts in all positions • 3 Robots, 10 colour cameras (partlyarticulated)
2f. Beyond state-of-the-art goalsSystem to be developed: • multiple degrees-of-freedom • in perception-action • model of action-dynamics • rule- and self-organization based learning • monitoring and repairing errors by self/other • real-time, adaptive planning • dialogue-supported perception, reasoning, action • cross-modal associations
3a. Co-ordinatorhttp://www.nici.kun.nl/People/BekkeringH/index.html
3b. Managerhttp://www.nici.kun.nl/People/MeulenbroekRGJ/index.html
5. Activities • RTD activities in WP 2-3-4-5 • See excerpt JAST (http://bscw.socsci.kun.nl/pub/bscw.cgi/0/1706107) • Two-day Opening Conference • Athens, Greece • February, 2005 • Dates: to be announced • Summer School in 2006
7. Delegation Members of JAST attending the CogSys Kick-Off Meeting