1 / 48

VUB AI-II Situated Computing Module 4: Situated Computing

VUB AI-II Situated Computing Module 4: Situated Computing. Walter Van de Velde Starlab NV www.starlab.net wvdv@starlab.net. What is Situated Computing?. Shallow. Deep. Computation in context Example : TEA. Computation of context Example : COMRIS. What is Situated Computing? (shallow).

erna
Download Presentation

VUB AI-II Situated Computing Module 4: Situated Computing

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. VUB AI-IISituated ComputingModule 4: Situated Computing Walter Van de VeldeStarlab NVwww.starlab.net wvdv@starlab.net

  2. What is Situated Computing? Shallow Deep Computation in context Example: TEA Computation of context Example: COMRIS

  3. What is Situated Computing?(shallow) • Situated computing exploits a degree of context awareness. • Context awareness is “The ability of a device or program to sense, react or adapt to its environment of use.” (Pascoe et al., HUC 99)

  4. Shallow Situated Computing: the TEA project Airplane Cockpit High COMRIS Nomadic Radio HMD Wearables Automobiles Audio-Aura TEA Situational Awareness Newton Mobile Audio Speech Wear Smart-Phones Palm-Pilot Virtual Reality Pagers Walkman Watch Desktop PCs Source: Nitin Sawhney, MIT Media Lab Pen-paper Eye-glasses Low Passive Demand on User’s Attention Resources Active

  5. TEA algorithmic setup .3 Supervision .3 .1 .6 Raw Sensor Data Clustering Sensor Cues

  6. TEA hardware setup

  7. Context recognition in TEA standing running outside Location stairs walking sitting kitchen talking Hardw Lab NN Lab Activity

  8. GPS/GIS: shallow • Location based context has immediate applications such as the tourist guide systems • -: GPS doesn’t work indoors • Example prototype system from Columbia University: Prototype tour guide Here’s what the user sees

  9. Situated Computing (shallow) • Basically:complement user-input with context information so that the input-process can be lean and the output can be tuned to higher relevance for the context. Input Output Context

  10. Why Context Awareness? =Why Shallow Situated Computing? • Improving interaction with a device • better defaults, automated choices,... • Improving quality of existing services • communication, information,... • Extended sensing and monitoring • security, health and safety,… • Enabling of new services • tourist services • health services ...

  11. What is Situated Computing? Shallow Deep Computation in context Example: TEA Computation of context Example: COMRIS

  12. What is Situated Computing?(deep) • Thought exercise: • The world can be viewed as a kind of computer that constantly computes its future. • Situated computing is about influencing the future that the world computes.

  13. What is Situated Computing?(deep) • Refers to a class of computing applications that influence in a directed way the progression of another process, which constitutes its context. • Context is time-series of situations. • Situated computing is biasing futures in a directed way.

  14. What is Situated Computing? Situation time Present

  15. What is Situated Computing? Situation time Future Past Present

  16. What is Situated Computing? Situation time Future Past Present Context Support

  17. Aside: degree of intelligence • The context support is that part of the context that is needed to support the application of the principle of rationality. • A system is intelligent to the extent that its context support extends over situations as well as in time. • Intelligence can be more or less situated.

  18. Context Awareness at Large Context Situation Temporal Self Past Future Environment Descriptive(memory) Predictive(expectation) Users Activities

  19. What is Situated Computing?(deep) • The world can be viewed as a kind of computer that constantly computes its future • Situated computing is about influencing the future that it computes. • What can be influenced? Situations. • Towards what? Properties of context. • How to influence? Through artefacts.

  20. Example artefacts • Signals • Active and smart badges • e-notes (and other GPS-based services) • Media Cups • Aware GSM • Memory aid camera • COMRIS parrot • Intelligent Jogging Suite • ….

  21. What is an artefact? • An artefact is a physical object that influences behaviours. • By design, an artefact emits ‘signals’. • The meaning of an artefact can be understood as people’s reactions to the signals in a particular context.

  22. Example: arrow as artefact Arrow as physical object

  23. Example: arrow as artefact Arrow as a signal

  24. Example: arrow as artefact Barcelona Arrow and its meaning: expected effect when signal is acted upon

  25. Example: arrow as artefact Barcelona Barcelona Arrow and its meaning: properties of expected effect when signal is acted upon

  26. Aside: The resistance to change • The reaction of people to artefacts is dependent on culture, habits and expectations. • Therefore artefacts can be said to be ‘resistant to change’. That’s why design is so hard I guess...

  27. What is Situated Computing? Situation (emergent)Property time Future Past Present Context Support

  28. Building a Situated Computer: a first shot • Design a system of signs • Embed them in a system of artefacts • Confront them with people • Build meaning related to desired properties • Design dynamics of signs based on awareness

  29. Example: the COMRIS parrot • The COMRIS Parrot is a wearable advisor, attempting to create moments of interest for its wearer, in the context of a large scale event (conference, fair). • It delivers a series of spoken messages (signals) by which it influences its wearer’s behaviour. • It aims to maximize the interest of the event for its participants

  30. COMRIS Parrot Design

  31. Parrot speaking... “A presentation on numerical learning methods, a topic you are definitely interested in, is starting in 5 minutes in room B. You may want to catch the speaker afterwards since he is a reviewer for your I3 project. Maybe you want to say hi to your friend Sandy who is near you. Don’t forget to mention the present that she gave to you last timeyou met”

  32. Parrot Self-Evaluation Context-sensitive text and speech makes sure that the user is receptive to a message. Context monitoring to detect when a user is ready for attention shift The parrot's advice creates an expectation forfuture behavior. Expectation monitoring can be a basis for self-evaluation.

  33. Levels of Self-Evaluation • Is the user following the advice? • Is the resulting situation interesting for the user? • Is the user satisfied in the long run? • When is the user ready for attention shift?

  34. ContextModel Buttons User 1 2 PRA PA 5 3 4 EventMonitor Feedback

  35. Levels of Self-Evaluation • Is the user following the advice? • Is the resulting situation interesting for the user? • Is the user satisfied in the long run? • When is the user ready for attention shift? How to use the results of self-evaluation? Reinforcement for contextual advice, or...

  36. What is a Situated Computer?(deep) • A situated computer is a collection of people and artefacts in a shared context. • What it ‘computes’ is a behaviour landscape, i.e., a probabilistic model of people behaviours. • The behaviour landscape is ‘enacted’ when people are present in it.

  37. Characteristics of Situated Computing • Users and system are part of a shared context (ecology?) • The service is often implicit or emergent • The service is ‘autonomous’ • The service is multi-faceted • The IO process is implicit: coupling rather than calling

  38. Coupling versus Calling • Calling: • input/output process • no input then no process and no output • Coupling: • process going on in parallel • input/output is mutual perturbation

  39. Different ways of coupling • Different types of artefacts • body centric • environment centric • relation centric • Artefact-People relation • 1-to-1 • many-to-1 • 1-to-many

  40. Different types of artefacts • Dependent on how they influence behaviour • influence behaviour of person wrt itself • wrt to the space • wrt to the artefact itself • Type of influence • cognitive • sub-cognitive

  41. Implications: behavior bias interfaces • New types of interfaces are being enabled that no longer communicate information but directly influence behavior. • Design issues need to be discussed to turn this potentially dangerous idea into a good one. • Consumers ‘just’ behave to consume!

  42. Implications: behavior bias interfaces The end of information

  43. Today we will re-invent computing(work in progress…)

  44. Recap: three converging trends In retrospect, this was only a good start...

  45. The future of awareness (shallow) • More ubiquity • Smaller, better and cheaper sensors • Better context description • Better context analysis • Coverage of the whole awareness space • Temporal dimension (descriptive, predictive) • Context services and modularisation • Context standardisation (TEA Foundation)

  46. The future of awareness (deep) Reflective artefacts:artefacts that acquire a sense of their meaning Situated computing: reflective artefacts with controlled signaling behaviour toward a desired (emergent) property.

More Related