Semantic Web Technologies’ role in Smart Environments

1. Politecnicodi Torino Dip. Automaticae Informatica Torino, Italy OTM Workshops 2012 September 10-11, 2012, Rome, Italy Semantic Web Technologies’ role in Smart Environments Faisal Razzak

2. Outline • Context and Motivation • Semantic Web Technologies • Smart Environments • User goal modeling in Smart Environments • Domotic Effects • Linked Data aspects in Smart Environments • Web of Domotics • SEIPF • Publishing LO(D)D • Conclusions Semantic Web Technologies' role in Smart Environments

3. The promise of Intelligent Web • Semantic Web? • Web 2.0 or Web 3.0 or beyond … • “Logic + reasoning” approach by AI community Semantic Web Technologies' role in Smart Environments

4. Semantic Web Architectures Horrocks, I., Parsia, B., Patel-Schneider, P., Hendler, J.: Semantic web architec- ture: Stack or two towers? Principles and Practice of Semantic Web Reasoning pp.37–41 (2005) Semantic Web Technologies' role in Smart Environments

5. Architectures by Berners-Lee (W3C) Antoniou, G., Van Harmelen, F.: A semantic web primer. the MIT Press (2004) Semantic Web Technologies' role in Smart Environments

6. Two towered architecture Horrocks, I., Parsia, B., Patel-Schneider, P., Hendler, J.: Semantic web architec- ture: Stack or two towers? Principles and Practice of Semantic Web Reasoning pp.37–41 (2005) Semantic Web Technologies' role in Smart Environments

7. CFL Architecture Aurona Gerber, Alta van derMerwe, and Andries Barnard A functional semantic web architecture, In: The Semantic Web: Research and Applications pp. 273-287 (2005) Comprehensive, Functional, Layered Architecture (CFL Architecture) Semantic Web Technologies' role in Smart Environments

8. Some Mapping examples Semantic Web Technologies' role in Smart Environments

9. Post 2006 … • What is static (perceived necessary and foundational) in all the architectures? • Representation and Structure. • RDF (Basic Data model) • RDFS • OWL (Ontology) • SPARQL • What is expanding? • Linked Data. Semantic Web Technologies' role in Smart Environments

10. Smart Environments Smart Sensing and Measuring Environments • Smart Homes • Sensor and Actuator Networks • Smart Factories • Smart Grid • Environment monitoring • Social mobile applications Smart Appliances Affordable and efficient sensors Semantic Web Technologies' role in Smart Environments

11. Smart Environments Smart Sensing and Measuring Environments Smart Appliances acceleration compass GPS proximity microphone camera BT Scan acceleration compass air pressure temperature light energy (active, reactive, reverse, kVAr, ...) Affordable and efficient sensors Semantic Web Technologies' role in Smart Environments

12. Smart Environments Smart Sensing and Measuring Environments Smart Appliances Affordable and efficient sensors Motion RFID Smoke Pressure Gyroscope 2D codes Proximity Semantic Web Technologies' role in Smart Environments

13. Research Focus (Goals) • Address common problems in the domains of smart environment and energy management systems, under the umbrella of Ambient intelligence. • The potential role of semantic web technologies’ is explored., i.e., technologies that lie at the foundation of semantic interoperability and that provide global scale integration. • RDF • RDFS • OWL • SPARQL • Linked Data Semantic Web Technologies' role in Smart Environments

14. Categorization (For my work) • Higher Level Modeling. • Lower Level Modeling. • Or • Environment interaction modeling. • Environment set-up modeling. Semantic Web Technologies' role in Smart Environments

15. Research methodology • Identify artifacts/concepts and their inter relationships and model them using the ontologies. • The ontologies should be modular in nature. • Design and develop ontology powered frameworks. • Ontologies act as a knowledge base. • While, the processing, reasoning and decisions, depends upon specific application requirements. • Use Linked Data principles to share information Semantic Web Technologies' role in Smart Environments

16. Semantic Web Technologies' role in Smart Environments

17. Relationship between frameworks and their ontologies Semantic Web Technologies' role in Smart Environments

18. User Goal Modeling in Smart Environments:Domotic Effects Semantic Web Technologies' role in Smart Environments

19. Problem Definition • Modeling of environment interaction (Device centric). • Modeling of environment set-up. • Human intelligible state and goal modeling (Often Missing or Neglected). • Intelligible states and goals may relate to environmental variables (illumination or temperature, …) or to more abstract conditions such as Security and Energy Saving. Semantic Web Technologies' role in Smart Environments

20. What is Domotic Effects Modeling Framework? • It provide AMI designerswith an abstraction layer that enables defining generic goals inside the environment, • in a declarative way. • The high-level nature allows the residents • to program their personal, office or work spaces as they see fit. • Define different achievement criteria for a particular generic goal, by using domain-specific operators. • Two types: Simple and Complex Semantic Web Technologies' role in Smart Environments

21. Semantic Web Technologies' role in Smart Environments

22. Requirements • Formal definition • Domain dependency • Modularity • Evaluation Support • Enforcement Support • Advanced intelligence (Energy optimization) • Human Intelligibility Semantic Web Technologies' role in Smart Environments

23. Formal Modeling: DogEffects Ontology (1/2) Semantic Web Technologies' role in Smart Environments

24. Formal Modeling: DogEffects Ontology (2/2) Semantic Web Technologies' role in Smart Environments

25. Domotic Effects (DE)s: Evaluation • It is the ability to determine the value • of each DE defined in an environment when any device changes its state, in near-real time. • It helps monitor the overall state of the environment, also considering historical traces. • An Effect Node Network (ENN) is created from DE and Zero Delay Simulation algorithm is used to solve the network. Semantic Web Technologies' role in Smart Environments

26. ENN Example Semantic Web Technologies' role in Smart Environments

27. Results Semantic Web Technologies' role in Smart Environments

28. Results Semantic Web Technologies' role in Smart Environments

29. Domotic Effects: Enforcement • The problem of finding at least one configuration g that satisfies the user request and use the automation system to bring the home devices into a satisfying state. • In the case of Boolean valued domotic effects, the user request R is the subset of DEi that the user wants to be active (true) at a given instant. • Satisfying user request amounts to: Semantic Web Technologies' role in Smart Environments

30. Results: Usecase • Secure Home (CEA) • Bathroom Illumination (CEB) • Home Illumination (CEC) • Afternoon Lunch Cooking (CED) • Air Passage (CEE) • Morning Wakeup (CEF) Semantic Web Technologies' role in Smart Environments

31. Results Semantic Web Technologies' role in Smart Environments

32. Energy Optimization • Each device, in each operating state, consumes some amount of electrical power, that is represented as a real-valued Simple Effect The instantaneous power consumed by the whole environment is therefore represented as a Complex Effect aggregating all individual power measurements: • To compute the minimum value of P(g), while satisfying the user request R. This correspond to a constrained optimization of P(g) subject to the Boolean constraint FR(g). Semantic Web Technologies' role in Smart Environments

33. DogPower Ontology (Energy Profile Ontology) Semantic Web Technologies' role in Smart Environments

34. Proposed Heuristic Semantic Web Technologies' role in Smart Environments

35. Results Semantic Web Technologies' role in Smart Environments

36. Smart Environments and Linked Data:Web of Domotics Semantic Web Technologies' role in Smart Environments

37. What is Web of Domotics (WoD) • WoD combines the concepts of Internet of Things and Domotics. • Enables mobile users to access and to control devices in a ubiquitous manner, without any a priori knowledge of device controllers from any network or location. Semantic Web Technologies' role in Smart Environments

38. Abstract • It exploits several Internet and Web standard technologies to provide following features: • Proximity-based device identification. • Network-based detection of service access points (through DNS based device • dereferencing). • User identification through Open ID. • Open data exchange, service/device description through Linked Open Data formats . • Device operation through REST-based interaction. Semantic Web Technologies' role in Smart Environments

39. Issues • Domotic Device Identification • Domotic Device Control • Access to Controller • Universal Authentication Semantic Web Technologies' role in Smart Environments

40. Conceptual Modeling Semantic Web Technologies' role in Smart Environments

41. Features • UAID is encoded through QR Code because the decoding process is quick and many modern mobile phones are by default equipped with software to decode QR Code • During setup phase, MAP (Mobile Access Provider) registers the UAID associated with the device with the domain address of the Controller that controls the device Semantic Web Technologies' role in Smart Environments

42. Features • The mobile application provides a user with an interface to interact with the devices present in the environment. It communicates with the controller responsible for the devices on behalf of the user. • User authentication is provided through Open ID. Open ID is a decentralized standard based on Single Sign-On (SSO) paradigm to authenticate the users. Semantic Web Technologies' role in Smart Environments

43. Features • The Controller offer information about devices by exploiting the increasingly popular Linked Open Data format. • Dog is an ontology-powered DomoticOSGi Gateway that is able to expose different domotic networks as a single, technology neutral, home automation system. • The three new units are: HTTP-Access, Authentication and Authorization Unit and UAID Mapping Unit.. Semantic Web Technologies' role in Smart Environments

44. Features • The Controller adhere to the Linked Data vision by exposing device information through RDF or RDFa. • The user can request pure RDF description of a device or RDFa (XHTML) as a response user interface. Semantic Web Technologies' role in Smart Environments

45. Smart Environments and Linked Data:SEIPF(Semantic Energy Information Publishing Framework) Semantic Web Technologies' role in Smart Environments

46. What is SEIPF? • Provide ability to expose energy consumption information from the residential gateways in a machine understandable format, to achieve intelligent negotiation and consumption coordination. • Issues: • Energy Consumption Information • DogPower Ontology ( previously Energy Profile Ontology) • Machine understandable format. • Linked Data principles. Semantic Web Technologies' role in Smart Environments

47. Architecture Semantic Web Technologies' role in Smart Environments

48. Experiments Semantic Web Technologies' role in Smart Environments

49. Experiments Semantic Web Technologies' role in Smart Environments

50. Smart Environments and Linked Data:Publishing LO(D)D Semantic Web Technologies' role in Smart Environments