Interaction Through Spells

1. Interaction Through Spells Embodied, collaborative composition of ubiquitous services Johan Mattsson johanm@dsv.su.se

2. Co-located collaborative & ubiquitous computing • Transparent sharing of computation • Adaptable environment, providing a shared opportunities of control • Wireless devices, provides easily connections between any services • Generic networked services, possibly residing and accessed anywhere Interaction Trough Spells Johan Mattsson

3. Lost in a collaborative interactive work session? • Awareness of shared activities, what are we trying to achieve with all ongoing possible activities • Transparency between social interaction and computer interaction • Democracy, why did this happened? -I couldn't share my opinion on it Interaction Trough Spells Johan Mattsson

4. Research questions • Can we make it easier and more intuitive, from a group perspective to configure interactive work environment • The initial setup for a project session • Temporal adaptations within a session • Transparency, how to support: • Collective view on how the environment is used • Fair interpretations on co-workers intentions with their actions • How can we empower real-world actions to refine collaborative work and experiences? Interaction Trough Spells Johan Mattsson

5. Approach • Exploring ways of adjusting and augment ‘social protocol’ to offer intuitive interaction alternatives for interactive spaces • Designing and experiment with interaction techniques aiming to provide expressions and meaning to: • Co-located users • Trigger computer interactions Interaction Trough Spells Johan Mattsson

6. Spells • Embodied traces expressing the configurations of seamless ubiquitous devices and services • Publicly shared expressive interaction • Tangible interaction as intuitive symbolic expressions • “Embodied Interaction is the creation, manipulation, and sharing of meaning through engaged interaction with artifacts.” [Dourish] Interaction Trough Spells Johan Mattsson

7. Interacting trough spells • Empowers embodied user behaviour such as: • Pointing • Touching • Waving • Spatially place an item in place • … • Map of the activities and related services and devices provided as a trace of socially and tangible experiences • Implicit real-world actions overloaded to executive and predictive explicit interaction Interaction Trough Spells Johan Mattsson

8. Where spells support collaborative post desktop computation • Service selection, makes the environment announce and present public services and application related to any physical property • Shared Guidance and information, items in the real world are able to share knowledge or usage instructions • Transformation and connection, … Interaction Trough Spells Johan Mattsson

9. Transformation and connection • Transparent moving and adapting of computation • Transparent transferring computation and data: moving or copying information between devices • Transferring control, how we act to redirect I/O streams, e.g. how we: • Express a change target for input • Announce a change of responsibility or source user • Transfer and transforming behaviours over distances and modalities Interaction Trough Spells Johan Mattsson

10. Hypotheses • Predictable/accountable acting will affect the involvement and engagement positively • The supported acting are intuitive to handle and co-workers made fair predictions on the acting Interaction Trough Spells Johan Mattsson

11. Prototypes • iwand’s • Magic Bowl • (The old knob) Interaction Trough Spells Johan Mattsson

12. iwand concept: transferring computation example • 1’st selects and fetch the sound stream from the phone • 2’nd moving the incoming sound to the common speaker system Interaction Trough Spells Johan Mattsson

13. iwand, 2’nd iteration • Creates connections between real-world entities by pointing • Enchantment targets applied on relevant entities • A laser enabled PDA triggers the targets to reply wirelessly with parameters that forms the spell content Interaction Trough Spells Johan Mattsson

14. Magic Bowl • Magic objects are with attached RFID • The bowls are capable of identifying several tagged object simultaneously • Magic items “opens a secret door to” certain functionality, project data, room settings, etc. Interaction Trough Spells Johan Mattsson

15. Where is the magic? • Expressive actions enchants/executes changes in the environment • The magic spells are supported by enchanted tangible tools • Empowered user behaviour appeals to fictional magic: • Pointing with a magic wand to remotely cast a spell • Waving or touching a wand over something to bless or enchant it • Put an magic item in the right place to open a secret door Interaction Trough Spells Johan Mattsson

16. Related Work • Interactive workspaces project, http://iwork.stanford.edu • USE’s, Martin Jonsson, FUSE • Embodied interaction, Paul Dourish Interaction Trough Spells Johan Mattsson