1 / 23

Interactive Story Telling

Explore the interactive storytelling experience with Gary the Gull in this demo. Dive into the pros and cons of multiple playthroughs, various edge cases, and narrative manipulation strategies for replayability and control over the story. Engage with gaze-based interaction by triggering actions through eye movements. Learn about head gestures, distance-based interactions, and speech recognition using different tools like CMU Sphinx and Google Cloud Speech.

rcannon
Download Presentation

Interactive Story Telling

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Interactive Story Telling

  2. Gary The Gull

  3. Attempt demo

  4. Pros Cons Multiple playthroughs Lots of edge cases Had to force the narrative at times • Replayability • Control the overall story • Increased immersion • Engagement

  5. Gaze Based Interaction • Staring at or away from something triggers an action

  6. https://unity3d.com/learn/tutorials/topics/virtual-reality/interaction-vrhttps://unity3d.com/learn/tutorials/topics/virtual-reality/interaction-vr

  7. Head Gestures • Use velocity and direction of player’s head to determine intent

  8. https://www.youtube.com/watch?v=3icqAJnZF8Y

  9. Distance • How close is the player? • How close is something else? • Reaction based on distance between virtual object and headset

  10. https://www.youtube.com/watch?v=J2FwN7NaEu0

  11. Speech Recognition • Limit to most common words • Extremely complicated • Use Magic Tricks

  12. Speech Recognition Tools • CMU Sphinx https://cmusphinx.github.io • Google Cloud Speech https://cloud.google.com/speech/ • Facebook Wav2Letter https://github.com/facebookresearch/wav2letter

More Related