Wearable Computing : Present and Future

1. Wearable Computing : Present and Future SwadhinPradhan Reading Group Presentation

2. Business • In 2013, investors poured $458 million into 49 wearable company deal ( CB Insights ) • $50 Billion Industry by 2017 !! ( Credit Susse ) • Major tech companies like Apple, Google, Samsung and Intel investing heavily in wearables, with non-tech giants like Nike, Under Armour, Adidas, lululemon etc.

3. Popularity Example • Pebble • Kickstarter Campaign • Seeks : $100K • Raises : $10+ Million

4. Factors in Wearable Tech Today • Faster and Cheaper Hardware • Cloud Storage • Location Data • Quantified Self Activity • Gaming Industry • Visual & Voice Technology • User Experience

5. State-of-the-art • Devices • Inputs • Applications • Algorithms

6. Devices

7. Audio-Video Capturing Devices Logging Life Events

8. Google Glass (Smart Glasses)

9. Narrative Clip (First Person Camera)

10. Autographer (First Person Camera with Sensors and GPS)

11. Kapture (Autonomic Audio Capture)

12. Body Data Gathering Devices Monitoring Health Status

13. Jawbone (Activity Monitor)

14. Fitbit (Fitness Tracker)

15. Pebble (Smart Wrist Watch)

16. Emotiv (Brain Activity Tracker –EEG)

17. Muse (Brain Monitor)

18. OmSignal (Smart Shirt)

19. Sensoria (Smart Socks)

20. FootLogger (Shoe Sole for Fitness Tracking)

21. Mimo (Baby Status Monitoring)

22. MC10 (Flexible wearable sensors for health monitoring)

23. Gesture Recognizing Devices

24. Myo (Muscle Activity Tracker)

25. SmartyRing (Smart Ring)

26. Fin (Another Smart Ring) Ring GINA (MobiCase 2013) for 3D gestures

27. Scanadu (Health – heart rate – ECG – Blood Pressure etc. Checker)

28. SkinPut (MSR)

29. Wearables discussed in Research Papers

30. New Wearables – New Applications • BodyScope: A Wearable Acoustic Sensor for Activity Recognition (UbiComp 2012)

31. New Wearables – New Applications Detecting Cocaine Usage through Wearable ECG Sensor ( UbiComp 2013)

32. New Wearables – New Applications • An Amulet for Trustworthy Wearable mHealth (HotMobile 2012)

33. New Wearables – New Applications • Wearable Smartphone: Wearable Hybrid Framework for Hand and Foot Gesture Interaction on Smartphone (CVF, ICCV 2013)

34. New Wearables – New Applications • An Interactive Belt Worn Badge (CHI 2012)

35. New Wearables – New Applications • Wearable Device for Visualizing Knee Rehabilitation Exercises (CHI 2013)

36. And Many More ……

37. Classification of Wearable Devices (Function Wise) • Life Logger • Gesture Recognizers • Entertainer • Video • Gaming • Assistant • For Chore Jobs • For Creative Jobs • For Emergency Jobs

38. Classification of Wearable Devices (Creation Wise) • Replacing Daily Wearables with Smarter Alternatives • Watches, Shirts, Shoes, Socks etc. • Creating New Wearables • Armband, Headband, Shirt Clippers etc.

39. Inputs

40. Ambient Sensors • Accelerometer, Gyroscope, Magnetometer, Barometer, Thermometer, Relative Humidity Sensor, Light Sensor etc. Accelerometer Gyroscope

41. Physical Activity Sensor • MC10 Sensor, EEG sensor etc. MC10 Sensor Interaxon Muse EEG reader

42. Traditional Inputs/Capture • Audio(microphone), Video, Photos (camera –head mounted/ body-attached/ smartphone) ... • Wi-Fi, Cellular, GPS …

43. Applications

44. Life Logging (Augmented Memory) • Google Glass • Narrative Clip Syncing with cloud • Getting summary from the video or audio or images – an important problem !! • Automatic diary creation for the users or taking notes for the forgetful users is important.

45. Activity Tracking/Monitoring • Calorie Used (Wireless Health ‘13 paper used to guess correctly with accelerometer) • Sleep Pattern • Steps walked • Detecting Eye Contact using Wearable Eye-Tracking Glasses (UbiComp 2012) • Wearable Activity Recognition for Dogs !! (UbiComp 2013)

46. Healthcare • Monitors different vitals of users and help them to take informed decisions. • Calory Count using multi-modal Wearable Sensors (Wireless Health ’12, Hail Kalnatarian et. al.) • SpiroSmart: Using a Microphone to Measure Lung Function on a Mobile Phone (UbiComp 2012) • Emergency Patient observation and immediate healthcare notification. • Cognitive Assistance through Wearables (Offloading through Cloudlets) [Kiryong Ha et. al.]

47. Gesture Recognizing • Free from Gesture used for authentication (MobiSys 2014 – MPI,Rutgers) • Identifying Emotions Expressed by Mobile Users through 2D Surface and 3D Motion Gestures (UbiComp 2012) • Unobtrusively Wearable Sensor Suite for Inferring the Onset, Causality, and Consequences of Stress in the Field (Sensys 2013)

48. Assistant • Anywhere, Anytime Information and Communication • Sensor-Assisted Facial Recognition: An Enhanced Bio-metric Authentication System for Smartphones (MobiSys 2014) [Trick : Relative Position estimation using sensors] • Navigation using multimodal sensors (NaviComf, PerCom 2012) • A Smartphone-Based Obstacle Detection and Classification System for Assisting Visually Impaired People (CVF, ICCV 2013)

49. Assistant to the special people • Geometric Layout Analysis in a Wearable Reading Device for the Blind and Visually Impaired (MobiCase 13) • Parent-Driven Wearable Cameras for Autism Support, CMU, UbiComp poster

50. Augmented Reality • Google Glass like view which adds layer of virtual view to normal view. • After integrating gesture recognition and voice commands, augmented reality can impact retail industry, social networks, and gaming industry.