1 / 15

Fraunhofer IITB IBM INRIA

CHIL Reference Model Architecture for Multi-modal Perceptual Systems Gerhard Sutschet Nikos Dimakis. Fraunhofer IITB IBM INRIA. KTH RESIT/AIT UKA/IPD. CHIL Reference Model Architecture for Multi-modal Perceptual Systems. Need / Motivation for the CHIL Architecture The ICE-Cube Layers

linh
Download Presentation

Fraunhofer IITB IBM INRIA

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. CHIL Reference Model Architecture for Multi-modal Perceptual SystemsGerhard SutschetNikos Dimakis Fraunhofer IITBIBM INRIA KTH RESIT/AITUKA/IPD

  2. CHIL Reference Model Architecture for Multi-modal Perceptual Systems • Need / Motivation for the CHIL Architecture • The ICE-Cube • Layers • Features • Perceptual Component APIs • Demonstrations • SitCom • Memory Jog

  3. CHIL – Project Areas • CHIL Services • Implicit human to human proactive computing services • Study success of such services and their ability to improve productivity • Functionalities and Technologies • The“Who? Where? What? Why? How?” of humans • Speech, Gestures, Emotions, Gaze, Focus of Attention, Facial Expressions, Action / Activity Recognition, Emotions • Infrastructure: • To enable composition, aggregation, processing and interoperation of the distributed components (sensors, technologies, fusion, services,…)

  4. CHIL – 15 Partners The CHIL Team: Universität Karlsruhe (TH) ISL & IPD Logo Logo Logo

  5. Need / Motivation for the CHIL Architecture Events Large Data Streams reliable maintainableportable reusable efficient easy to use Sensors Situations Semantics Reasoning

  6. Need / Motivation for the CHIL Architecture • Provide: • a programming framework • programming tools • programming environments to build and evaluate CHIL services • Ambition: Create a “standard” reference architecture for Multi-Modal systems.  Layered Architecture

  7. SmartFlow or ChilFlow for Data Streams

  8. SitCom for Situation Modeling and TrackingChilix for Information Transfer

  9. Perceptual Components

  10. Perceptual Components API • Requirements: • Operating System Independent • Similar Perceptual Components  same API • Flexibility • Extensibility • Subscribe/Notify - Mechanism • Solution: • »lean« Interface with only few functions • (get_param(), set_param(), notify, …) • Interface-»family« • One API – definition for each type of perceptual Components • Specification of parameters in XML • Transport-Protocol  TCP-IP

  11. Society of Software Agents forDecentralized Information Processing

  12. Agents on the upper layers • CHIL Agent - abstract basic class for all CHIL – agents • CHIL Agent Manager - hides and enriches DF and AMS • Personal Agent - each person in the CHIL environment owns his own personal agent • Profile Handler Agent - each person in the CHIL environment has his own profile • Smart Room Agent - a “Personal Agent of the Smart Room” • Service Agents - wrapper for services • Connector Agent, Memory Jog Agent, Attention Cockpit Agent … • Situation Watcher Agent - Wrapper for Simulation Modeling Layer

  13. Society of Software Agents forDecentralized Information Processing

  14. Domain Ontology andCommunication – Ontology  OWL

  15. Thank You! • Questions? • Further Information at http://chil.server.de • CHIL – Software – Architecture – Reports: • Functional Requirements • Cooperative Information System Software Design • Many public reports • Contact: gerhard.sutschet@iitb.fraunhofer.de

More Related