SIXTH Middleware : Toward Autonomic Sensor Networks

1. SIXTH Middleware : Toward Autonomic Sensor Networks Professor Gregory O’Hare, Dr Rem Collier & Dr Micheal O’Grady Research Proposal to Vodafone 10th July 2011

2. Research Overview: Middleware for Sensor Web

3. The Sensor Web 100Bn 10B- 100B Sensor Devices 10B+ Units 10Bn Digital World 1B+ Physical World Cellphone 1B+ Units 1Bn Devices/Users (Log Scale) 100M PC 100M Units 100M 10M Minicomputer 10M Units Mainframe 1M Units 1M 1960 1970 1980 1990 2000 2010 2020

4. Middleware for the Sensor Web • Sensor Web: • The aggregation of physical and cyber sensing technologies within a single unified framework. • Sensor Web Middleware: • The enabling software layer that delivers the core functionality necessary to realise the Sensor Web. • Core Functionality: • Uniform Data Access Model • Sensor Discovery Mechanisms • Data and Sensor Security • Sensor Management and Configuration

5. Existing Solutions

6. Our Approach: Middleware for Sensor Web

7. SIXTH Overview SIXTH’s goal is:“an extensible, scalable, intelligent middleware for the Sensor Web based on OGSi” SIXTH Philosophy:SIXTH is targeted at dynamic and adaptive Sensor Web deployments and is focused on runtime re tasking of sensors and in-situ intelligence SIXTH Components:Sensor Model: Properties-based model for control of and access to sensing devices.Adaptors: Links sensor specific implementations to a standardised interface that can be accessed via higher-level APIs.APIs: Core functionality of the SIXTH architecture, covering: data access, re-tasking, notification, security and discovery.Services: Data processing layers that build on the APIs.Intelligence: Integrated multi-agent system to support in-situ reasoning and management.

8. SIXTH Architecture Adaptors:Virtual Sensor creationSensor-SIXTH integration Discovery Service:Secure Sensor Access Receivers:Streaming of sensor data Notifiers:Filtered sensor data streams Services:Data processing / Dissemination

9. Deployments Application(s) In-Network Deployment Cyber Deployment Gateway Deployment

10. SIXTH Toolkit Data Visualisation Sensor Deployment http://sourceforge.net/projects/sixth/

11. SIXTH Uniqueness • Informed by Emerging Standards OSGi, OGC Sensor Web Enablement Standards, IEEE 1451 (PnP standard for device configuration) • Sensing the Sensor WebCyber Sensors for online data streams (RSS, Twitter, Gowalla, Facebook, …)Physical Sensors for heterogeneous sensing devices • Dynamic re-tasking of SensorsSupport diverse applications across multiple sensors and WSN subnets • Realizing Intelligent Sensor Networks (iSNs)Enables collaborative and distributed decision-making throughout the WSN. • Interoperable with existing abstractions/programming models Database Models (TinyDB, GSN), REST, HOOD, Abstract Regions, AToM, …

12. Illustrative Demonstrators

13. Technology Vision CLARITY-SIXTH Sensor GatewayPre-packaged, off-the-shelf, sensor gateway; Integrated NGN modem;Configurable out-of-the-box;OSGi-based Dynamic Web-Based Software Configuration; CLARITY-SIXTH Sensor DeploymentSupports extensibility, heterogeneity and scalability of deployment;Delivers autonomic sensor network management capabilities; Seamless integration of cyber and physical sensor sources; Abstraction of data streams, agnostic of source (physical or cyber); CLARITY-SIXTH Data Fusion & Warehousing Support for integration, analysis, fusion and archiving of data; Dissemination of (personalised) data to key stakeholders;

14. Personalised Insurance ? I wish I could reduce my insurance premium by agreeing to certain driving conditions Insurance Provider ? I wish I could incentivise safer driving… by monitoring driving behaviour

15. Personalised Insurance

16. Home Services How can we ensure the security, safety, and well-being of our aged community? How will I cope living alone? Medical Centre How can I feel secure in my home… How can we facilitateindependent livingfor our aging population? How can I reduce my ever increasingelectricity bills?

17. Home Services

18. Core Focus: Sensor Discovery

19. The Problem to Be Solved • Sensor Discovery • Approaches: Web-based versus Ad-hoc • Web-based well established, but ad-hoc less so • No integrated solution • Security • Harness existing solutions (existing encryption algorithms, utilize IPv6 Security model, …) • Our Approach: • Offer integrated solution through SIXTH • Utilization of mobile phone as the integration platform • Validation through range of demonstrator applications.

20. OGC SWE Standards • Sensor Web Enablement (SWE) 1.0 Standard (2007) • Consists of Conceptual Models, XML Schemas & Web Services • Observations & Measurement: Supports transmission of sensor data • Sensor Model Language: Describes sensors systems and processes • Transducer Markup Language: Standard for describing transducers and supporting real-time streaming • Sensor Observation Service: Web Service for requesting, filtering, and retrieving observations and sensor system information • Sensor Planning Service: Web Service for requesting user-driven acquisitions and observations. • Sensor Alert Service:Web Service for publishing and subscribing to alerts from sensors. • Sensor Web Enablement (SWE) 2.0 Standard • Currently Under Development as of 2011

21. Web-Based Sensor Discovery 1: Uses an automated system to convert SWE Observations and Measurements to a custom format. 2: Required an agreed level of metadata within SensorML to enable discovery 3: Requires users to subscribe, possibly with a fee 4: Must know type of sensor in advance of deployment

22. Ad-hoc Sensor Discovery Less studied area, most focus on SWE-style deployments

23. Why Integrate? • Web-based approaches are more established: • Emerging standards exist • Are external to the underlying sensor network • Focus on data aggregation and smoothing • Time lags in receipt of data. • Ad-hoc discovery is more challenging: • No emerging standards or even accepted approaches • Heterogeneity must be handled in-network • Greater access to individual sensors • Provide access to real time raw data feeds • Integration allows us to harness the benefits of both approaches in a single unified framework…

24. The Solution: SIXTH & Sensor Discovery • Modularity sits at the core of SIXTH: • Facilitates adoption of diverse discovery models ranging from web-based approaches to ad-hoc in-network approaches. • Aims to bridge divide between web-based and ad-hoc approaches. • Seamless transition between approaches: • Use web-based interaction when ad-hoc access is not possible / available. • Support switching to ad-hoc interaction when possible.

25. Example Demonstrator

26. Use Case: Surfing Advisor 1 • Consumer wishes to know the weather/surf conditions at surfing sites in his/her vicinity • User searches for this information on his/her phone • The phone application automatically connects to the sensors deployed at the various locations.

27. Use Case: Surfing Advisor 2 • Remotely gathered information is displayed in a contextually sensitive manner • Various options are given an intuitive rating • Information from multiple WSNs are fused to give complete description of area

28. Use Case: Surfing • Upon arrival at the selected location, the phone discovers the WSNs via Zigbee/Bluetooth • receives updated telemetry from the sensors • WSN information can be viewed individually to make a choice as to where in the area to go to

29. Basic Funding & IP Model Targeted Joint Project :A specific dedicated project undertaken in collaboration with Vodafone; Possibility with participation of another partner ( Alactel Lucent); Ring Fenced IP; Project Duration :3 Year Duration; 6 Month Milestones; Early and rapid prototype development and user trials; Indicative Project Costing :Dependant upon duration, scope. Typically this would involve: Vodafone FTE 0.1 pa fully weighted 2 X UCD Post Doc (approx cost €50K per Post Doc Year) 300k 2 Ph.D Student 25k per annum 150k Equipment 30k Travel 3k per annum per person year 36k Anticipated Overheads 40% 206k TOTAL 722k

30. Vodafone Engagement Exchange & Embedding of Staff for short durations :Short term embedding and exchange of research staff betweenCLARITY and Vodafone; Market informed research; Access to Vodafone Core Network :Access and exposure to Vodafone mobile network test beds; Access to Vodafone Network Engineers; Support for Potential Spin out Company : Potential investment in spin out company;

31. Appendices

32. The Clarity Centre

33. University College Dublin University College Dublin (UCD) has been ranked as the top university for Computer Science in Ireland, and the only Irish university to be ranked within the top 100 in the world by the first ever international subject ranking by the QS World University Rankings.

34. CLARITY Overview UCD / DCU / TNI 100+ (PhD/PD) Researchersplus Principal Investigators Diverse Expertise Health / Environment / Media Strong Industry Focus Award-Winning Research & Commercialization

35. Research TeamAlmost a decade of working together UNIVERSITY COLLEGE DUBLIN  DUBLIN CITY UNIVERSITY  TYNDALL NATIONAL INSTITUTE Prof. Barry Smyth CLARITY Director RP 6 Leader Prof. Alan Smeaton Deputy DirectorRP 5 Leader Dr. Donnacha O’Driscoll Centre Manager Personalization, Recommender Systems, User Modeling Information retrieval, multimedia Information, video retrieval,… Prof. Dermot DiamondRP1 Leader Prof. Greg O’HareRP3 Leader Prof. Noel O’ConnorRP4 Leader Signal processing, audio/video processing, data analysis. Materials science, novel sensor Technologies, wearables. Middleware, agent oriented computing, mobile computing. Dr. Cian O’Mathuna RP2 Leader Dr. Brian Caulfield RP3, RP6 Prof. Niall Moyna RP1 Sensor platforms and hardware, Power management, … Physiotherapy, Human motion, Body sensing technologies,… Sports science, human Performance, …. 2 35

36. Summary Technical Programme Content & People Demonstrators Sensor Web Middleware Devices & Platforms Devices & Platforms

37. Total Centre Funding EI SFI EPA SFI IRCSET Excq CSET Grant EU FP7 Non-Excq Marie Curie Core Industry Additional Industry Note: New core partners in Q1 Centre funding to date >€26m. 55% CSET Grant / 45% Additional (March2011)

38. Cumulative Publications 139 additional non-CSET funded papers (93 conference, 46 journal). Across the centre this represents a PI publication rate of approximately 20 papers p.a.

39. CLARITY Centre & Ecosystem INDUSTRY COLLABORATORS SOCIAL/AGENCY COLLABORATORS INDUSTRY COLLABORATORS SOCIAL/AGENCY COLLABORATORS CSET CORE INDUSTRY COLLABORATORS SOCIAL/AGENCY COLLABORATORS June 2011 39

40. CLARITY Demonstrators Personal Health & Sports Energy & the Environment Ambient Assisted Living Sensing the Real-Time Web

41. CLARITY Demonstrators 1. Sensing the Realtime Web The host of online services now available to us are regarded as sensors - FaceBook, Twitter, FourSquare, etc. Many examples of how these help in emergency and other situations, but especially in non-emergency situations, regular ‘transactions’ correspond to sensor values; For text we can analyse sentiment, in real time; For location-based services, we can combine these with sensors from the physical world - environment, weather, traffic, events, etc. Companies involved in this work include IBM SmartCities centre (Dublin), other SMEs.

42. 2. Personal Health and Sport Applications in tennis, hockey, boxing, cycling, golf, stroke rehabilitation, cystic fibrosis; New sensing technologies for motion capture using our own CLARITY WIMUs; New sensing technologies for sensing the person through respiration, perspiration; Both of these are novel, unique, and benchmarked against others, shown to be world-class; Combine these with off-the-shelf sensors; Company involvement from Disney, QinetiQ CLARITY Demonstrators

43. CLARITY Demonstrators 3. Energy and the Environment We develop novel sensors for real time environmental monitoring of water (phosphates and other nurtients) and air (CO2, CH4, etc.); We prototype these and build end-to-end systems which we deploy in the field, working with Environmental Protection Agency and Marine Institute; Combine these with off-the-shelf sensors to create web-based visualisations of health of an environment; With industry partners we deployed smart energy meters in domestic/industry trials to monitor, incentivise and reward customers through various interventions This included appliance recognition Company involvement from Episensor, IBM

44. CLARITY Demonstrators 4. Ambient Assisted Living and Lifelogging Lifelogging one of the most active research areas in CLARITY Most-used device is SenseCam but also Looksie, VeeCam, Android, wearable classes and others; CLARITY AAL work on deployments of fall detectors, activity profiling, disturbances in public places, energy monitoring; Companies sponsoring this work include Microsoft Research, IBM Research, FAST Search and Transfer (Norway), Research Council of Norway, and previously Samsung Electronics (Korea), Mitsubishi Electric Research Labs (US), HP Ireland.

45. CLARITY Relationships The industry partner slide shown earlier shows current industry engagement; In addition we have 16 ongoing FP7 projects - large multi-partner projects to smaller STREPs. Wide range of areas - energy management and smart buildings, material science, healthcare, media Very many industry partners, very industry-facing

46. Clarity Projects in the Building Energy Management Space

47. CLARITY EU- EnPROVE EnPROVE: Maximising return of investment (ROI) when investing on energy saving solution

48. CLARITY -FIEMSER • CLARITY-UCD • CSTB • THALES • TECNALIA Labein • Fraunhofer • Philips • Acciona • TENESOL FIEMSER (Friendly Intelligent Energy Management System for Existing Residential Buildings)

49. CLARITY - HOBNET • RACTI • Ericsson • Mandat International • Sensimode • CLARITY-UCD • University of Geneva • University of Edinburgh