1 / 82

Untold Stories of Touch, Gesture, & NUI

Untold Stories of Touch, Gesture, & NUI. Joe Fletcher Design Manager, Microsoft Surface. Touch is great for specific aspects New technology has enabled touch systems, which can enhance certain activities. Touch is not good for everything It is not an end all solution.

elton-sheppard
Download Presentation

Untold Stories of Touch, Gesture, & NUI

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Untold Stories of Touch, Gesture, & NUI Joe Fletcher Design Manager, Microsoft Surface

  2. Touch is great for specific aspects New technology has enabled touch systems, which can enhance certain activities Touch is not good for everything It is not an end all solution Touch is a computing evolution It is an addition element for users to interact with their content in new and unique ways

  3. Microsoft Surface Microsoft Surface is a revolutionary computer that responds to natural hand gestures and real-world objects, creating unique new ways for people to collaboratively interact with digital content.

  4. Microsoft Surface

  5. Vision Strategy Design

  6. Surface Massive Multi-touch, Multi-user Unique Spot Windows 7 PC’s, Form Factors, Technology

  7. Larger Surface Team

  8. Touch is great for specific aspects Touch is not good for everything Touch is an evolution

  9. Touch The act of directly touching your digital content Manipulation Alteration or freeform movement of digital content using touch Gesture Hand motions to take an action Natural User Interface The combination of these and other elements the create a unique way to interact with your digital content

  10. History and Ecology Surface Design Principles Touch Challenges

  11. History and Ecology Surface Design Principles Touch Challenges

  12. Why Evolve?

  13. Command Line Interface (CLI)

  14. Graphic User Interface (GUI)

  15. Natural User Interface (NUI)

  16. Natural User Interface (NUI)

  17. Natural User Interface (NUI)

  18. Microsoft Surface and NUI Microsoft Surface computing uses sensing and display technology to infuse everyday surfaces with digital content and is comprised of the following unique attributes: Object recognition Direct interaction Multi-touch Multi-user

  19. NUI vs. Web 2.0

  20. NUI & Touch should not be a novelty

  21. Input Ecology Multi point Good for Manipulating objects Social Con Not for input Low accuracy Need large controls Support of hands and screen Keyboard Good for Accuracy Con Limited Mouse Good for Moving across the screen efficiently Con Indirect Stylus Good for Freeform input Con Low accuracy Need large controls Single point Good for Direct object selection Con Not for quick input Low accuracy Need of large controls Mis-hits from fingernails of perceived hit area

  22. [Partial] Touch Ecology Multi Touch (screen) Reacts to multiple inputs Orients UI to the direction of the touch Spatial recognition of system NUI (Gesture & Physical/Digital) Reacts to multiple inputs Spatial Recognition - Orients UI to the direction of the touch Object recognition - Blurring physical and digital Multi point (screen) Reacts to direct input

  23. Tap is not the new click ≠

  24. Context, task, and use define the solution

  25. Context, task, and use define the solution Touch is not a solution in search of a problem

  26. Touch is great for specific aspects Touch is not good for everything Touch is an evolution

  27. History and Ecology Surface Design Principles Touch Challenges

  28. Create an inflection point

  29. The start of almost every successful technological innovation is marked by an inflection point, which defines a moment of dramatic change.

  30. Companies spend 90% of their energy trying to imitate

  31. Microsoft Surface and principle driven design Principle Driven Design

  32. Microsoft Surface and principle driven design Principle Driven Design Using history to develop the future

  33. CLI GUI NUI Text Graphics Objects

  34. Recall Recognition Intuition CLI GUI NUI Text Graphics Objects

  35. Directed Exploratory Contextual Recall Recognition Intuition CLI GUI NUI Text Graphics Objects

  36. High-Low Double Medium Fast Few Directed Exploratory Contextual Recall Recognition Intuition CLI GUI NUI Text Graphics Objects

  37. Disconnected Indirect Unmediated High-Low Double Medium Fast Few Directed Exploratory Contextual Recall Recognition Intuition CLI GUI NUI Text Graphics Objects

  38. Static Responsive Evocative Disconnected Indirect Unmediated High-Low Double Medium Fast Few Directed Exploratory Contextual Recall Recognition Intuition CLI GUI NUI Text Graphics Objects

  39. Evocative Principle of Performance Aesthetics Unmediated Principle of Direct Manipulation Principle of Scaffolding Fast Few Principle of Contextual Environments Contextual Principle of the Super Real Intuition NUI

  40. Microsoft Surface and principle driven design Principle Driven Design

  41. Microsoft Surface and principle driven design Three Super Principles

  42. Social Multiple simultaneous users

  43. Social Multiple simultaneous users Seamless Digital and Physical combined

  44. Seamless

  45. Social Multiple simultaneous users Seamless Digital and Physical combined Spatial Kinesiology

More Related