UbiCom Book Slides

1. UbiCom Book Slides Chapter 9: Intelligent Interaction (All Parts, Short Version) Stefan Poslad http://www.eecs.qmul.ac.uk/people/stefan/ubicom Ubiquitous computing: smart devices, environments and interaction

2. Chapter 9: Overview Chapter 9 focuses on: • Internal system properties: intelligence • External interaction with any of three types of environment • Focussing more on ICT and physical environment • These environments may be active, i.e., they are themselves one or more intelligence systems Ubiquitous computing: smart devices, environments and interaction

3. Five main properties for UbiCom Handling Non-determinism Knowledge & task sharing Goal-based, etc. Ubiquitous computing: smart devices, environments and interaction

4. Ubiquitous computing: smart devices, environments and interaction

5. Related Chapter Links • There are two AI chapters that are interlinked • Chapter 8, describes the design of single Intelligent System or IS • These may be simple: use a single models of intelligence • These may be hybrid: use multiple heterogeneous intelligence models • This Chapter 9, describes intelligent interaction between multiple systems • The systems interacting may be intelligent (Chapter 8) • The systems interacting may not necessarily be intelligent but their interaction may still be: emergent intelligence (Chapter 10) • Or Both Ubiquitous computing: smart devices, environments and interaction

6. Related Chapter Links • Other Models of Interaction Multiplicity: • Service Interaction (Chapter 3) • Network Interaction (Chapter 11) • Each type of smart device to smart environment (device) interaction can be enhanced by making them intelligent • CCI (Chapters 3 & 4) • CPI (Chapters 6 & 7) • HCI (chapter 5) Ubiquitous computing: smart devices, environments and interaction

7. Chapter 9: Overview The slides for this chapter are also expanded and split into several parts • Part A: Interaction Multiplicity: Between peers  • Part B: Interaction Multiplicity: Using Mediators • Part C: Cooperative Interaction • Part D: Competitive Interaction • Part E: Intelligent Interaction Protocols 1 • Part F: Intelligent Interaction Protocols 2 • Part G: Multi-Agent Systems • Part H: Social Interaction Ubiquitous computing: smart devices, environments and interaction

9. Part A Overview • Basic Smart versus Intelligent Interaction?  • Interaction Multiplicity • P2P Interaction between Multiple Senders and Receivers • Unknown Sender and Malicious Senders • Unknown Receivers • Too Many Messages Ubiquitous computing: smart devices, environments and interaction

10. Introduction • Deployment of UbiCom is  ? • UbiCom device interaction ? Ubiquitous computing: smart devices, environments and interaction

11. Basic (Smart) Interaction • P2P Interaction • Interaction that involves passive intermediaries Ubiquitous computing: smart devices, environments and interaction

12. Intelligent (Smart) interaction What is Intelligent (Smart) interaction? • Beyond using universal network communication protocols, • Involves Coordination • Use of Semantics • Communicate using a rich language • Organisational interaction • etc Intelligent interaction is built upon basic interaction Ubiquitous computing: smart devices, environments and interaction

13. Intelligent Interaction 2 dimensions of intelligent interaction • Interaction between multiple intelligent systems & their environments • Intelligent Interaction between relatively non-intelligent multiple systems & environments Ubiquitous computing: smart devices, environments and interaction

14. Smart Device versus Intelligent Device Interaction Interaction between smart devices (Chapter 1): • Digital, • Connected, • Degree of local autonomous control, etc Interaction between intelligent devices (Chapter 8): • Specific notions of intelligence, • e.g., reflexive, goal-based etc • Different degrees of intelligence (Chapter 13) Ubiquitous computing: smart devices, environments and interaction

15. Intelligent Environment versus Intelligent Interaction Intelligent Environment: • Environment for a system, is intelligent • Environment may include other intelligent systems Intelligent Interaction: • Interaction, between a system and its environment (including other systems), is intelligent Ubiquitous computing: smart devices, environments and interaction

16. Interaction Multiplicity • Interaction multiplicity can occur in many different components of UbiCom systems & their environments, e.g., • ICT Environment (C) • Services (S) • Networks (N). • Human Environment (H) • Physical Environment (P) Ubiquitous computing: smart devices, environments and interaction

17. Basic Interaction Multiplicity Example: Service Invocation

18. Types of Interaction Multiplicity

19. Interaction Multiplicity • Interaction multiplicity  complexity of interaction. Why? • How to manage  complexity of Interaction multiplicity? • . Ubiquitous computing: smart devices, environments and interaction

20. Interaction Multiplicity Examples: Communication

21. Chapter 9: Overview The slides for this chapter are also expanded and split into several parts • Part A: Interaction Multiplicity: Between peers • Part B: Interaction Multiplicity: Using Mediators  • Part C: Cooperative Interaction • Part D: Competitive Interaction • Part E: Intelligent Interaction Protocols 1 • Part F: Intelligent Interaction Protocols 2 • Part G: Multi-Agent Systems • Part H: Social Interaction Ubiquitous computing: smart devices, environments and interaction

22. Part B Overview • Interaction using Mediators • Shared Communication Resource Access • Shared Computation Resource Access • Mediating Between Requesters and Providers Ubiquitous computing: smart devices, environments and interaction

23. Mediated Interaction • Mediator: a go between interacting participants / peers • also referred to as 3rd parties, intermediaries, middle- ware -agents • Benefits: • Enhances peer discovery and service discovery • Etc • Disadvantages: • Performance drops as extra intermediate nodes / hops are used • etc Ubiquitous computing: smart devices, environments and interaction

24. Mediated Interaction • The following types of mediated interaction: • Shared Communication Channel Access • Shared Computation Resource Access • Service Discovery • etc • Can be considered in terms of: • Motivation? • Challenges? • Handled by? Ubiquitous computing: smart devices, environments and interaction

25. Mediating Between Requesters and Providers • Mediators enhance peer discovery & service discovery • Instead of having to request information from each peer, info. accessed in 1 place, a 3rd party at a well known, static, address uses well standardised directory interface • 2 types of information used in discovery process • service capability • Service preferences • Different designs for mediators exist depending on how service capabilities or preferences are kept private versus shared Ubiquitous computing: smart devices, environments and interaction

26. Who Knows Capabilities Mediators Who Knows Requests & Preferences

27. Mediator Design Issues • When are Mediators used during an interaction? • Support for anonymity • Mediators can be designed to support a range of different representations for capabilities and preferences • Mediators can be designed to support different types of interaction • Mediator fairness to providers • Trust & Neutrality Ubiquitous computing: smart devices, environments and interaction

28. Mediators: Interaction Protocols • What interaction protocols should these different types of mediator use? • Request-reply? • Asynchronous notifications? • Other protocols? But how can we support richer & more flexible interaction? See later Ubiquitous computing: smart devices, environments and interaction

29. Chapter 9: Overview The slides for this chapter are also expanded and split into several parts • Part A: Interaction Multiplicity: Between peers • Part B: Interaction Multiplicity: Using Mediators • Part C: Cooperative Interaction  • Part D: Competitive Interaction • Part E: Intelligent Interaction Protocols 1 • Part F: Intelligent Interaction Protocols 2 • Part G: Multi-Agent Systems • Part H: Social Interaction Ubiquitous computing: smart devices, environments and interaction

30. Part C Overview • Interaction using Cooperative Participants  • Coordination Basics • Perfectly Coordinated Systems • Coordination design issues • Coordination through join intentions and plans • Coordination using Norms and Electronic Institutions • Hierarchical and Role-based Organisational Interaction Ubiquitous computing: smart devices, environments and interaction

31. Interaction Multiplicity: Cooperative Interaction • Cooperative interaction enables multiple systems to work together. Characterised by 2 main properties: • Coordination: synchronising activities • Cohesion: acting together (organisational interaction). Ubiquitous computing: smart devices, environments and interaction

32. Interaction Multiplicity: Cooperative Interaction • Cooperation is easier to manage when: • homogeneous designed systems interact; • there is centralised control; • systems are designed as pure servers • systems are designed statically to cooperate; • systems act benevolently and reliably. • Cooperation is harder to manage when: • different systems are designed by independent developers; • systems are designed to act autonomously; • systems support heterogeneous goals; • systems need to cooperate dynamically; • parties may act in a self-interested manner; • systems act malevolently and may non-deterministically malfunction. Ubiquitous computing: smart devices, environments and interaction

33. Cooperative Interaction: Pros and Cons Ubiquitous computing: smart devices, environments and interaction

34. Cooperative Interaction: coordination • Explicit Coordinated Cooperation • Coordination using Norms and Electronic Institutions • Hierarchical and Role-based Organisational Interaction Ubiquitous computing: smart devices, environments and interaction

35. Coordination: Classification Message-based vs. process-based Explicit vs. Implicit Perfect vs. imperfect etc Ubiquitous computing: smart devices, environments and interaction

36. Coordination Design Issues • Whether or not ISs are spatially and or temporally coincident, or not • Handling inconsistencies and uncertainty. How? • Who Coordinates? Ubiquitous computing: smart devices, environments and interaction

37. Coordination Classification Explicit coordination • Service composition(Section 3.3.4). • Interaction protocols with inbuilt coordination mechanisms • See later • Joint planning • Joint intentions Implicit coordination • Norms and Electronic Institutions • Hierarchical & Role-based Organisational Interaction Ubiquitous computing: smart devices, environments and interaction

38. UbiCom System Applications of Social Organisations Provide a flexible way to design a large range of organisations • to dynamically configure building facilities to support building energy efficiency; • for personalised work environments • for information integration and interoperability • information services for mobile users in which IS dynamically adapt information to multiple contexts such as location, person and ICT system. Ubiquitous computing: smart devices, environments and interaction

39. Chapter 9: Overview The slides for this chapter are also expanded and split into several parts • Part A: Interaction Multiplicity: Between peers • Part B: Interaction Multiplicity: Using Mediators • Part C: Cooperative Interaction • Part D: Competitive Interaction  • Part E: Intelligent Interaction Protocols 1 • Part F: Intelligent Interaction Protocols 2 • Part G: Multi-Agent Systems • Part H: Social Interaction Ubiquitous computing: smart devices, environments and interaction

40. Part D Overview • Interaction with Self-interested Participants  • Market-based Interaction and Auctions • Negotiation and Agreements • Consensus-based Agreements Ubiquitous computing: smart devices, environments and interaction

41. Competitive Interaction • Cooperation vs. Competition • cooperators share their goals with collaborating parties & act together • competitors keep their goals private & act self-interestedly.to further their own goals, rather on collaborating to help further others’ goals • As diverse smart autonomous, configurable, networked devices  in physical spaces, competitive interaction  • Design models to solve the associated resource conflicts and resource allocation problems will become essential. • E.g., in Smart utility regulation scenario. • Multiple autonomous lighting devices in smart environment, all seek to switch themselves on but some are redundant & wastes energy. • Multiple users may seek to configure a shared or multiple devices that overlap in function in multiple ways, e.g., multiple users wish to regulate heating and lighting levels differently. Ubiquitous computing: smart devices, environments and interaction

42. Competitive Interaction • Different types of competitive interaction problems and designs depending on: • No. of players • interaction protocols; • Strategies; • Nature of the completion • Self-interested interaction is complicated further when participants act maliciously, i.e., lie and collude. Ubiquitous computing: smart devices, environments and interaction

43. Interaction Multiplicity: Competitive Interaction Types • Market-based Interaction and Auctions: used to allocate resources to individual requesters • Negotiation and Agreements: more general than auctions, used in market places to agree terms but can also be more generally used to resolve conflicts. • Convergence: a multi-step processes where two or more entities iteratively reach an agreement. Convergence algorithms and protocols tend to be domain specific • Consensus based protocols can be used to reach agreement between multiple participants, but normally for one object at one time, e.g., voting protocols Ubiquitous computing: smart devices, environments and interaction

44. Competitive Interaction: Designs • A generic problem for UbiCom is allocation of limited resources & services to multiple self-interested requestors. Designs to manage this? • Control can be more generally acceded to a third party • Concurrency control (Section 9.2.2.2). • Policy based management (Section 12.2.8.4) • Market-based Interaction and Auctions • Negotiation and Agreements • Consensus-based Agreements • Can we classify these designs into types of mediator (passive versus active) & mediated versus non-mediated? Ubiquitous computing: smart devices, environments and interaction

45. Auctions • Is 1 of oldest but still widely-used market based protocols • Designed to allocate resources such as goods and services to one of the bidders. • Several types of auction protocol depending on • ???? • Auction Benefits • ??? Ubiquitous computing: smart devices, environments and interaction

46. Auctions • Different types of auction? • English auction, can be classified in terms of the following properties for bids: • a single type of goods • single attribute • single sided • ascending Ubiquitous computing: smart devices, environments and interaction

47. Negotiation & Agreements • Auctions are designed to reach agreements between sellers and consumers in a market-place • are considered to be a type of more general technique called negotiation. • General aims of Negotiation is modification of local agent policies to constrain interaction and plans of interaction, • e.g., in the case of negative (harmful) interactions, and identification of situations where new potential interactions are possible and beneficial. • Uses of negotiation in UbiCom? • task and resource allocation; • recognition of conflicts; • resolution of goal disparities; • determination of the organisational structure and hence for organisational coherence. Ubiquitous computing: smart devices, environments and interaction

48. Negotiation Design In general a negotiation method has 4 principle components: • Public shared interaction protocol • Deal rule • Negotiation set • Strategies that are kept private Design properties for negotiation protocols ? • pareto optimal, • stable • individually rational • support computation and communication efficiency Ubiquitous computing: smart devices, environments and interaction

49. Negotiation Designs • Negotiation can be considered to be a distributed search • Search is through a space of potential agreements (chapter 8) • Game-theory is used to develop strategies between competing players who strive to win a game • Argumentation-based negotiation allows additional information to be exchanged, over and above proposals • Different problem domain models for negotiation applications: • Task-based • State-based • Worth-based. Ubiquitous computing: smart devices, environments and interaction

50. Consensus-based Agreements • Consensus based interaction can be used to reach an agreement when multiple self-interested participants share a common goal • Consensus is important when different participants or processes interact such that their self-interested goals may conflict • Consensus refers both to a state of agreement that is reached by independent participants and to the process to reach an agreement. • Consensus may also be useful in situations where there are several alternatives but it is not clear which one alternative should be chosen, • In contrast to negotiation, consensus based agreements are simpler. How? Ubiquitous computing: smart devices, environments and interaction