1 / 31

COMRIS -- Cohabited Mixed-Reality Information Space

COMRIS -- Cohabited Mixed-Reality Information Space. An ‘en route’ snapshot The COMRIS Consortium. A one-liner – or two. COMRIS develops wearable technology to focus the attention of participants in large scale events.

bowen
Download Presentation

COMRIS -- Cohabited Mixed-Reality Information Space

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. COMRIS -- Cohabited Mixed-Reality Information Space An ‘en route’ snapshot The COMRIS Consortium COMRIS Soft Poster Presentation

  2. A one-liner – or two COMRIS develops wearable technology to focus the attention of participants in large scale events. COMRIS is about understanding and enabling the social engine of complex societies. COMRIS Soft Poster Presentation

  3. The COMRIS Vision • Co-Habited Mixed Reality • The social engine and scaling • From parrot to component-wear • Context sensitive text and speech • Self-Evaluation of a wearable assistant • CAVE interaction • COMRIS and social science COMRIS Soft Poster Presentation

  4. The Conference Center COMRIS Soft Poster Presentation

  5. Welcome to RAVE 2000 COMRIS Soft Poster Presentation

  6. RAVE 2000: a test bed • RAVE 2000 is an artificially designed conference • RAVE 2000 creates situations in which scenes of various encounters can be played by agents competing for attention • RAVE 2000 is the test bed for our ideas and for the technology COMRIS Soft Poster Presentation

  7. COMRIS Scenarios Attend to more interests See the interesting things Meet the right people Get more done Grab a taxi in time Share dinner with an interesting person COMRIS Soft Poster Presentation

  8. The COMRIS Vision • Co-Habited Mixed Reality • The social engine and scaling • From parrot to component-wear • Context sensitive text and speech • Self-Evaluation of a wearable assistant • CAVE interaction • COMRIS and social science COMRIS Soft Poster Presentation

  9. Appearance based exploration Selective presentations of role and skills Community of Agents that know each other and who share an interest Evaluating the competitors Competence Competing for attention Relevance Attention Attention important message from the winner Scalability - Conceptual Large groups of individuals COMRIS Soft Poster Presentation

  10. Competence Relevance Agent Context interest Appearance Presentation COMRIS Agent Model COMRIS Soft Poster Presentation

  11. You have an Idea and want to promote it ——o—— You must find and talk to the right person ——o—— An idea can be discussed in a group ——o—— Sometimes it is best to just shout COMRIS Soft Poster Presentation

  12. The COMRIS Vision • Co-Habited Mixed Reality • The social engine and scaling • From parrot to component-wear • Context sensitive text and speech • Self-Evaluation of a wearable assistant • CAVE interaction • COMRIS and social science COMRIS Soft Poster Presentation

  13. COMRIS Parrot Design COMRIS Soft Poster Presentation

  14. COMRIS Soft Poster Presentation

  15. COMRIS Soft Poster Presentation

  16. Parrot Usability Studies • User Control: do users want to be in control of message delivery or do they want automatic delivery? • The parrot has five buttons but the user needs several functions to interact with it. What is the preferred design? And now with the real thing! COMRIS Soft Poster Presentation

  17. The COMRIS Vision • Co-Habited Mixed Reality • The social engine and scaling • From parrot to component-wear • Context sensitive text and speech • Self-Evaluation of a wearable assistant • CAVE interaction • COMRIS and social science COMRIS Soft Poster Presentation

  18. Parrot speaking... “A presentation on numerical learning methods, a topic you are definitely interested in, is starting in 5 minutes in room B. You may want to catch the speaker afterwards since he is a reviewer for your I3 project. Maybe you want to say hi to your friend Sandy who is near you. Don’t forget to mention the present that she gave to you last timeyou met” COMRIS Soft Poster Presentation

  19. The parrot is a wearable device providing assistance to the user in an information rich environment. Its software counterpart, the PA (Personal Assistant) realizes the loose coupling between the virtual world inhabited by a community of software agents (PRA Personal Representative Agent) and the physical world, inhabited by human agents - users. virtual space physical space PRA PA information push competition for attention interest based navigation Parrot TalkRequires Multiple Context Dimensions co-habited mixed reality COMRIS Soft Poster Presentation

  20. LINGUISTIC CONTEXT Numeric focus on concept/instance: occurred 5: in previous message 3: 1 message ago 1: 2 or more messages ago e.g. look-up (P_ID 25, concept person, instance 26) => lcv(5,5) John will give a presentation on ubiquitous computing. He is currently in your neighborhood. ContextModel PROFILE CONTEXT user’s interest in: topic/ person: 1: might be interested in/might want to meet 3: are interested in/want to meet 5: your favourite topic/absolutely wanted to meet When generating natural language, especially for output on a wearable device, more than one dimension of context needs to be taken into account. Our context model allows for annotating the propositional contents of a message with different types of context information in a uniform way. e.g. -person..-p_pv:-pnumval 5 :-pqval “for socializing” Joe Scott, whom you absolutely wanted to meet for socializing, will be giving a talk. EXTRA-LINGUISTIC CONTEXT time 0: today +1: tomorrow +.10: in 10 minutes space: close-by, at the other side of the building, on the same floor social implicature: user is 1: standing, wandering around 3: moving towards a goal 5: talking to someone e.g.-pract:-date (:-day 31:-month 1:-d_elcv 0) :-timing (:-hour 10 :-minute 0) :-place (:-l_name “the coffee room” :-l_ID 9910 :- l_elcv “around the corner”) Joe Scott proposes to meet you today at 10 o’clock in the coffee room around the corner COMRIS Soft Poster Presentation

  21. natural language generation module [#Bob F. #FERNANDEZ GOMEZ / ] , whom you [very much ] wanted to V-meet / , V-p roposes to V-meet you / to V-discuss about *[ACL / ] and *[ontologies // ] *[tomorrow / ] at [*10 o'clock / ] in *[the coffee room / ], [around the corner ] ./// discourse module Speech annotated output context sensitive NLG process model the information layer PRAs play a scene & compete for the attention of the user profile context propositional content (defparameter *mprop1* "[(COOP meeting-proposal) (PERSON [ (FIRSTNAME \"Bob F.\") (LASTNAME \"FERNANDEZ GOMEZ\") (SEX m) (ID \"delegate-023\") ]) (EVENT [ (EVTYPE \"appointment\") (KEYWORD_LIST [(FIRST [(T_NAME \"ACL\") (T_ID \"topic-acl\")]) (REST [(FIRST [(T_NAME \"ontologies\") (T_ID \"topic-ontologies\")]) (REST [])])]) ]) ]) (TAKESPLACE [(ID \"L10\") (NAME \"the coffee room\")]) (START [(DAY 28) (MONTH 12) (TIME [(HOUR 10) (MINUTE 00)])]) (CONTEXT [(PERSON_PV [(PNUMVAL 4) (P_QVAL \"for socializing\")]) (PERSON_LCV [(CONCEPT 3) (ENTITY 1)]) (TOPIC_PV [(FIRST 3) (REST [(FIRST 3) (REST [])])]) (TOPIC_LCV [(FIRST [(CONCEPT 5) (ENTITY 5)]) (REST [(FIRST [(CONCEPT 5) (ENTITY 5)]) (REST [])])]) (DATE_ELCV 1) (LOC_ELCV \"around the corner\")]) ]") • <Akel_content> • <Activity> • <status idref=“status-confirmation”/> • <involves> • <Person id=“delegate-023”> • <Person> • </involves> • <attending> • <Appointment> • <keyword idref=“topic-acl”> • <keyword idref=“topic-ontologies”> • <takesplace idref=“loc-010”> • </Appointment> • </attending> • <starts>2000-12-28 10:00:00</starts> • </Activity> • </Akel_content> HTML annotated output <A HREF=\\\"http://kiew.cs.uni-dortmund.de:8888/?expr=@'delegate-023'\\\" target=\\\"main\\\">Bob F. FERNANDEZ GOMEZ</A>, whom you very much wanted to meet, proposes to meet you to discuss about <A HREF=\\\"http://kiew.cs.uni-dortmund.de :8888/?expr=@'topic-acl'\\\” target=\\\"main\\\">ACL</A> and <A HREF=\\\"http:// kiew.cs.uni-dortmund.de:8888/?expr=@'topic-ontologies'\\\" target=\\\"main\\\">ontologies</A> tomorrow at 10 o'clock in <A HREF=\\\"http://kiew.cs.uni-dortmund. de:8888/?expr=@'L10'\\\" target=\\\"main\\\">the coffee room</A>, around the corner. Each component contributes to the NLG (natural language generation) process model: the PRA provides the propositional content and some profile context, the PA provides the extra-linguistic context, the NLG wrapper provides the linguistic context information. The NLG module produces 2 annotated versions of the same base text, for speech output (on the parrot) and for screen based interaction, allowing the user to browse the information layer. linguistic context extra-linguistic context COMRIS Soft Poster Presentation

  22. The COMRIS Vision • Co-Habited Mixed Reality • The social engine and scaling • From parrot to component-wear • Context awareness at large • Self-Evaluation of a wearable assistant • CAVE interaction • COMRIS and social science COMRIS Soft Poster Presentation

  23. Parrot Self-Evaluation The parrot's advice creates an expectation for future behavior. Expectation monitoring can be a basis for self-evaluation. When is a user ready to shift attention? COMRIS Soft Poster Presentation

  24. COMRIS Soft Poster Presentation

  25. The COMRIS Vision • Co-Habited Mixed Reality • The social engine and scaling • From parrot to component-wear • Context awareness at large • Self-Evaluation of a wearable assistant • CAVE interaction • COMRIS and social science COMRIS Soft Poster Presentation

  26. parrot Stereo camera virtually present present ComrisCave Immersive Virtuality COMRIS Soft Poster Presentation

  27. A virtual meeting in the cave 1) Represent participants by stereo videos 2) Interest distances are converted in a virtual scenario 3) Enter the cave 4) Select a face by pointing COMRIS Soft Poster Presentation 5) Increase/decrease interest

  28. The COMRIS Vision • Co-Habited Mixed Reality • The social engine and scaling • From parrot to component-wear • Context awareness at large • Self-Evaluation of a wearable assistant • CAVE interaction • COMRIS and social science COMRIS Soft Poster Presentation

  29. Can COMRIS provide insights for social science? • COMRIS has a strong hypothesis about what makes a complex society function. • COMRIS introduces technology as ‘grease’ in crucial aspects of that functioning What can be legitimatly concluded from such an experiment COMRIS Soft Poster Presentation

  30. Competence Relevance Context Appearance Presentation COMRIS Society Model Society Community Agent interest Resources Environment COMRIS Soft Poster Presentation

  31. COMRIS: to come • Toward the COMRIS co-habited mixed reality demonstration • Usability testing • Parrot component design goes on • Dissemination • Exploitation COMRIS Soft Poster Presentation

More Related