Darren Carlson Felicitous Computing Institute, Dept. of Computer Science

1. Darren Carlson Felicitous Computing Institute, Dept. of Computer Science National University of Singapore http://fci.comp.nus.edu.sg This presentation includes graphics from the Crystal Project, which is released under the LGPL license.

2. The Ambient Computing Initiative Technologies Collaborators Ambient Computing Group Developing next-generation frameworks and algorithms for the emerging Internet of Things and Web of Things.

3. Internet of Things Challenges (1/2) Locked Web Proxy Locked Web Proxy INTERNET WLAN, PAN Local Link Communications Networked Media Devices Wearable Sensors Environmental Sensing, Control Dual-mode Devices Web-proxied Devices Non-interoperable Prop. I/O, Web locked Prop. I/O Web locked Prop. I/O

4. Internet of Things Challenges (2/2) Indoor Positioning Unproxied Sensor Networks Biotelemetry Data User Activity IoT Others… Mobile Context Sensing and Control Web Apps Still Can’t see the Internet of Things Ad-hoc Interactions External Sensors Sensor Fusion Social Proximity and Networks

5. Ambient Dynamix 1/2 Dynamixis a plug-and-play software framework that transforms a commodity mobile device into an adaptive smart-gateway to the Internet of Things. Sphero Controllable/Controller Phillips Hue Controllable Drone Controllable/Controller Apple TV Controllable Example Smart Space

6. Ambient Dynamix 2/2 Plug-ins are dynamically provisioned at runtime Context domain expertise is packaged into plug-ins A Dynamix app requests context support

7. Open Collaboration 1 2 3 Open Plug-in SDK Open App SDK App Context-domain experts use the Open Plug-in SDK to create Dynamix plug-ins App developers use the Open App SDK to create Dynamix apps End-user installs the Dynamix Framework once Plug-ins can be published using public or private repositories Users can then run Dynamix apps and Websites Apps can be deployed from any Android market or elsewhere

8. Example Dynamix Plug-ins Many more plug-ins in development!

9. Demo Setup: Ambient Control Sphero Controllable/Controller Media Server Drone Controllable/Controller Apple TV Controllable ArtNet Light Controllable

10. Demo Overview: Ambient Control Bluetooth Channel Sphero Plug-in Sphero Controllable/Controller Ambient Control Plug-in Dynamix Device Ethernet Channel WIFI Channel WIFI Channel Runtime Plug-in Installation Drone Controllable/Controller Ambient Media Plug-in ARDrone Plug-in ArtNet Plug-in Apple TV Controllable ArtNet LightControllable

11. Demo Overview: Ambient Control Sphero Controllable/Controller Media Control Drone Controllable/Controller Apple TV Controllable ArtNet LightControllable

12. Demo Setup: Dynamix/Web Integration Internet Local link Router Plug-in Repository Facebook Servers App Server Browser Only Demo! Nexus 7 Standard Web Browser Dynamix Framework DLNA Projector Media Center Laptop ArtNet Light System UPnP Photo Frame

13. Demo Overview: Dynamix/Web Integration Tapping Dims the Lights & Displays Media on the Selected Media Renderer Web Content and Image Content Web Content and Dynamix JavaScript UPnP Media Renderer Facebook Servers App Server Plug-in Repository Dynamix Framework Background Service Dynamix Plug-ins: UPnP and ArtNet ArtNet Light System

14. Recent Publications (1/2) Carlson, D. and Schrader, A. Ambient Ocean: A Web Search Engine for Context-aware Smart Resource Discovery. Proceedings of the 2014 IEEE International Conference on Internet of Things (iThings 2014), Teipei, Taiwan, September 1-3, 2014. Carlson, D. and Ruge, L. Ambient Amp: An Open Framework For Dynamically Augmenting Legacy Websites with Context-awareness. Proceedings of the Ninth IEEE International Conference on Intelligent Sensors, Sensor Networks and Information Processing (ISSNIP 2014), Singapore, April 21-24, 2014. Novak, G., Carlson, D. and Jarzabek, S. An Adaptable and Extensible Mobile Sensing Framework for Patient Monitoring. Proceedings of the Ninth IEEE International Conference on Intelligent Sensors, Sensor Networks and Information Processing (ISSNIP 2014), Singapore, April 21-24, 2014. Carlson, D. and Ruge, L. Towards Augmenting Legacy Websites with Context-awareness. Proceedings of the Tenth Annual International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services (MobiQuitous 2013), Tokyo, Japan, December 2-4, 2013. Novak, G., Carlson, D. and Jarzabek, S. An Extensible Mobile Sensing Platform for mHealth and Telemedicine Applications. Proceedings of the Conference on Mobile and Information Technologies in Medicine (MobileMed 2013), Prague, Czech Republic, November 20, 2013. Carlson, D., Altakrouri, B. and Schrader, A. An Ad-hoc Smart Gateway Platform for the Web of Things. Proceedings of the 2013 IEEE International Conference on Internet of Things (iThings 2013), Beijing, China, August 20-23, 2013. (Best Paper Award)

15. Recent Publications (2/2) Burmeister, D., Schrader, A. and Carlson, D. A Modular Framework for Ambient Health Monitoring. Proceedings of the 1st International Workshop on Lifelogging for Pervasive Health at the 7th International Conference on Pervasive Computing Technologies for Healthcare, Venice, Italy, May 5-8, 2013. Rothenpieler, P., Schrader, A. and Carlson. D. An Open Infrastructure and Platform for AAL Services. Proceedings of the 15th International Conference on Human-Computer Interaction, Las Vegas, Nevada, USA, July 21-26, 2013. Altakrouri, B., Carlson, D. and Schrader, A. Sharing Kinetic Interactions for Mobile Devices. Proceedings of the 15th International Conference on Human-Computer Interaction, Las Vegas, Nevada, USA, July 21-26, 2013. Carlson, D., Altakrouri, B. and Schrader, A. Reinventing the Share Button for Physical Spaces. Proceedings of the IEEE International Conference on Pervasive Computing and Communication (PerCom 2013), San Diego, California, USA, March 18-22, 2013. (Best Demo Award) Carlson, D., Altakrouri, B. and Schrader, A. AmbientWeb: Bridging the Web's Cyber-physical Gap. Proceedings of the 3rd International Conference on the Internet of Things (IoT2012), Wuxi, China, October 24-26, 2012. (IoT Challenge Winner) Carlson, D. and Schrader, A. Dynamix: A Plug-and-Play Context Framework for Android. Proceedings of the 3rd International Conference on the Internet of Things (IoT2012), Wuxi, China, October 24-26, 2012.

16. Thank You!Q&A

17. Dynamix Framework Features • Runs as a lightweight background service on a user’s unmodified Android-based device. • Apps use simple Facade and Event APIs to request context support and receive context events. • Plug-ins are dynamically provisioned to the device during runtime (from the network or local file-system). • Supports parallel plug-in installations, automatic updating, event caching, and power management. • Supports native apps and browser-based Web apps. • Sends context information to apps using plain old Java objects (POJOs) or string-encoded formats. • Utilizes an embedded OSGi Framework to manage Dynamix plug-ins internally. • Features a Plug-in Security Sandbox, whichprovides managed access to sensitive services and resources.