a i . Jane Hsu yjhsu@csie.ntu.tw CSIE 318 design. Hao Chu hchu@csie.ntu.tw CSIE 317

1. TOPICS IN INTERNET OF THINGSCOURSE OVERVIEWHAO CHU – JANE HSU – BING YOUNATIONAL TAIWAN UNIVERSITYFEB 20, 2018

2. Internet of Thingsfocus on making smart everyday objectsenhance [ your cool object idea ] with sensing + ai(context awareness) + ui(user interaction)add smartnesson almost anything[not always sensible]teaching staff introthree examples

3. ai. Jane Hsu yjhsu@csie.ntu.edu.tw CSIE 318 design. Hao Chu hchu@csie.ntu.edu.tw CSIE 317 maker. Bing You cwyou2004@gmail.com room C, BL 7th floor ta. Jacky Yeh jackyyeh511@gmail.com course website: http://mll.csie.ntu.edu.tw/course/iot_s19/ FB group: Topics in Internet of Things

4. first IoT example. smart zipper

5. smart zipperfocus on making smart everyday objectshow to enhance [ zipper ] with computation?sensing + ai(context awareness) + ui(user interaction)

6. Smart Zipperfocus on making smart everyday objectsenhance [ zipper ] with computationsensing [what sensor can be used to detect open zipper?]+ ai(context awareness)+ ui(user interaction)

7. Smart Zipperfocus on making smart everyday objectsenhance [ zipper ] with computationsensing+ ai(context awareness)+ ui(user interaction?)

8. Smart Zipperfocus on making smart everyday objectsenhance [ zipper ] with computationsensing+ ai(context awareness)+ ui(user interaction)

9. Teach 3 Skills in this Coursedesign + maker + ai

10. second IoT example – smart fork

11. smart fork (2015 Kadomura, Li, Tsukada, Chu, Siio)design + maker + aitarget picky eating behavior of young children (play video)

12. Smart Fork (2015 Kadomura, Li, Tsukada, Chu, Siio)design + maker (sensing) + aifood type sensingelectrode (food impedance)RGB color sensor (food color)eating motion sensingaccelerometerbluetoothfor communicationto smartphone

13. smart fork (2015 Kadomura, Li, Tsukada, Chu, Siio)design + maker + aifood type sensingelectrode (food impedance)rgb color sensor (food color)eating motion sensingaccelerometerbluetoothfor communicationto smartphonefood type classifiereating action classifier(at-rest, holding, poking, biting)classifiers trained with SVM

14. smart fork (2015 Azusa Kadomura, Cheng-Yuan Li, Koji Tsukada, Hao-Hua Chu, ItiroSiio)design + maker + aifood type sensingelectrode (food impedance)rgb color sensor (food color)eating motion sensingaccelerometerbluetoothfor communicationto smartphonefood type classifiereating action classifier(at-rest, holding, poking, biting)

15. smart fork (2015 Azusa Kadomura, Cheng-Yuan Li, Koji Tsukada, Hao-Hua Chu, ItiroSiio)design [user interaction] + maker + aihungry panda game - phone programmingsince i teach design part, will go into a bit more depth

16. Smart Fork (2015 Azusa Kadomura, Cheng-Yuan Li, Koji Tsukada, Hao-Hua Chu, ItiroSiio)design + maker + aihungry panda game - phone programmingdesign is a lot more than just visual game graphicsdesign thinking: a method to create meaningful innovation that solves problems [not just cool tech ideas]

17. Smart Fork (2015 Kadomura, Li, Tsukada, Chu, Siio)design + maker + aihungry panda game - phone programmingdesign is a lot more than just visual game graphicsdesign thinking: a method to create meaningful innovation that solves problemsdo you think that the smart fork solves picky eating problems in young children? [why not?]

18. Smart Fork (2015 Kadomura, Li, Tsukada, Chu, Siio)design + maker + aihungry panda game - phone programmingdesign is a lot more than just visual game graphics !!!design thinking: a method to create meaningful innovation that solves problemsdo you think that the smart fork solves picky eating problems in young children? why not? why it failed? main insight after 2Y prototyping/testing – novelty effect

19. not just smart fork failedmany cool IoT gadgets that fall short of solving problemsthough we love cool techs at schools

20. real world working with real $$$people may not appreciate just cool gadgets that don’t solve problems[a vc story with an academic maker] what do maker/tech people often miss that prevent them from creating meaningful innovation that solves problems? main insight after 2Y prototyping/testing – novelty effect

21. real world working with real $$$people may not appreciate just cool gadgets that don’t solve problems[a vc story with an academic maker] what do maker/tech people often miss that prevent them from creating meaningful innovation that solves problems?know your users. really know your users before prototyping! [what level of understanding?] main insight after 2Y prototyping/testing – novelty effect

22. deep understand users before prototyping[private banker’s story on importance of understanding users’ needs]adjust expectation

23. third IoT example - smart kitchen

24. Meet Maker Peggy in 2005 BS senior in a class just like this one IoT (UbiComp) was emerging passionate about cooking how about creating the smart kitchen of the future?

25. how would you go about designing a smart kitchen of the future? what method?

26. maker method: sensing & feedback systemsensing: what [sensors + ai] can be used to detect [interesting context] in the kitchen? Camera, weight, temperature, [your input?] feedback: how to provide the sensed context to better support users in some kitchen activities? meal preparation [your input?]

27. Calorie-Aware Kitchenmeal calorie budgetweight + camera sensors to detect & track presence of food ingredients & cooking actions voice input for the food typemirror design

28. maker method: build & test2.5 Years: course project + 2Y master2 cycles of design-build-evaluate

29. Calorie-Aware Kitchenwhat users find most useful?learning ingredient portion -> caloriethis insight (obvious after testing) how to know this insight before prototyping

30. how well this maker-centric method works increating meaningful innovation that solves problems? What are strengths? [your input] What are weaknesses? [your input] Design-for-me. Little user understanding and need-finding. Retrofit solution to other problem. Insights discovered late after prototype. Lengthy prototyping limits ideas exploration. Lengthy prototyping limits iterations. start

31. It is all about Balanceavoid over-using technology. Understanding users/problems are important.avoid over-analyzing users. Prototyping is important. Design Technology dt+UX: Design Thinking for User Experience Design, Prototyping & Evaluation

32. course format interactive lectures ->you speak! lecture on techniques & background studio hands-on activity or team presentation semester-long project readings course material will be online slides, exercises, readings, schedule no lecture video have fun & participate! dt+UX: Design Thinking for User Experience Design, Prototyping & Evaluation

33. course learning skills maker skills adruino hardware & software android phone programming 3D printing design skills interview, needfinding, design exploration, evaluation, … ai skills keras(svm, regression, …) dt+UX: Design Thinking for User Experience Design, Prototyping & Evaluation

34. course project

35. course project each team will work on a smart IoTidea theme: simple everyday objects, novelty & rough prototype within one-semester time idea origination from you or assigned by faculty groups 4-5 students to a group work with students w/ different skills/interests groups meet in class & studio weekly cumulative

36. team forming skillset hardware & software (adruino) smartphone programming (android) machine learning design team forming next class assignment #1 fill a form on course webpage to stay or not with course

37. Tidbits Late Policy no lates on group assignments individual assignments lose one letter grade/day dt+UX: Design Thinking for User Experience Design, Prototyping & Evaluation

38. Project Process (18 weeks) Medium-fi prototype (using tools) In studio presentations & critiques Heuristic Evaluation of medium-fi prototype In studio group merge exercise High-fi prototype (code on target platform) Half-way in studio presentations & critiques Poster presentations & project fair with industry guests dt+UX: Design Thinking for User Experience Design, Prototyping & Evaluation

39. Project Process Timeline Needfinding ConceptVideo Medium-fiPrototype High-fiPrototype Define & Ideate Low-fiPrototype HeuristicEvaluation Project Fair Week 18 Week 2 Week 6 Week 8 Week 10 Week 12 Week 14 Week 4 … dt+UX: Design Thinking for User Experience Design, Prototyping & Evaluation

40. Reading materials We will also hand out other papers, give you web links, & refer to lecture slides dt+UX: Design Thinking for User Experience Design, Prototyping & Evaluation

41. Assignments Individual 1-2 presentations each class participation Group 7 “written” assignments 6 presentationswith 2-3 write-ups + video + poster all group work handed in online team web site & online submission site dt+UX: Design Thinking for User Experience Design, Prototyping & Evaluation

42. Tentative Grading A combination of individual assignments & presentation (10%) class/studio participation (10%) must attend! group project (80%) presentations/poster (group component) project write-ups No final must present at project fair dt+UX: Design Thinking for User Experience Design, Prototyping & Evaluation