320 likes | 327 Views
Experience augmented reality entertainment with the Butterfly Effect puzzle game. Catch virtual butterflies in the physical world by rotating the virtual world. Use the Tornado Stick controller to maneuver your way through challenges and obstacles.
E N D
Augmented Reality Entertainment Marleigh Norton, Blair MacIntyre College of Computing Maribeth Gandy Interactive Media Technology Center and College of Computing in collaboration with Jay Bolter School of Literature Communication and Culture Steven Dow College of Computing
Entertainment Applications of 3D Visual AR • Questions • When you think of AR entertainment, what comes to mind? • Could it really work? • Most of the answers to 1 have resulted in 2 being “no” • Why? • technology • reality AR Entertainment
What is out there? • Why does it work? • engineering • controlled environments AR Entertainment
Our own projects … • Why did they “work”? • design • controlled environments AR Entertainment
What else have people tried to build? • Reality: build it, ignore it! AR Entertainment
Can we conceive of Entertainment apps for AR that could work in real environments? • Games that could be deployed widely • in the home? backyard? the beach? • on nextgen consoles, nextgen pnp? • subtalk #1: Butterfly Effect AR Entertainment
Can we conceive of Entertainment apps for AR that could work in real environments? • Entertainment that doesn’t rely on AI, complexity, sets • in a bar? at a party? social? • subtalk #2: ARKaraoke AR Entertainment
Can we conceive of Entertainment apps for AR that could work in real environments? • Common themes • could work with near-future technology • no modeling of the environment • interactive, but no interactive characters • Keep your eye on the goal! • What makes a for good game or fun entertainment? AR Entertainment
Butterfly Effect:An Augmented Reality Puzzle Game Marleigh Norton Blair MacIntyre Steven DowMaribeth Gandy
Game Overview • Spatial puzzle where physical world is not modeled • Virtual butterflies in physical environment • Catch them! • Butterflies are stationary • Challenge comes from reaching the butterflies • Bring butterflies into reach by rotating the virtual world • Virtual world rotates in 90 degree chunks about a player defined axis. AR Entertainment
Equipment AR Entertainment
Head-Mounted Display AR Entertainment
Tornado Stick AR Entertainment
Rotations • Tornado Stick controls Virtual Axis • First Button – Place / Remove Axis • Second Button – Pause / Unpause Axis • Third Button – Rotate Butterflies AR Entertainment
Tornado Stick • People had trouble understanding rotations • Not everyone is used to 3D geometry • Though 3D puzzles have worked before • Change the metaphor, not the interaction • “Tornado Stick” AR Entertainment
Butterfly Effect AR Entertainment
Butterfly Effect Video AR Entertainment
Design Context • Start with medium, then design game • Mapping physical and virtual worlds is hard • AR works best when user is moving slowly • Tracking more accurate • Safer for player – Cognitive Tunneling AR Entertainment
Design Context • Home environment • Run on next generation game consoles • Must be easy to set up • Minimize use of special equipment AR Entertainment
1st Prototype: 2D Paper AR Entertainment
2nd Prototype: 2D Interactive AR Entertainment
3rd Prototype: Video AR Entertainment
Tuning • Two Major Challenges • 90 degree rotation constraint • Understanding virtual space and physical space • Possible Changes • Loosening rotation constraint • Adding more manipulations (translations) • Adding better depth perception cues AR Entertainment
Open Issues: Depth Perception • Static Depth Cues AR Entertainment
Open Issues: Depth Perception • Remove Automatic Depth Cues AR Entertainment
Open Issues: Depth Perception • Remove Unavailable Depth Cues AR Entertainment
Open Issues: Depth Perception • Texture probably the best AR Entertainment
Without Grid AR Entertainment
With Grid AR Entertainment
Is Occlusion Really Impossible? • Ad hoc modeling • Automatic modeling during calibration • Fiducials • Real time depth • Depth from stereo • Something to be explored AR Entertainment
Virtual Obstacles - Bees • No consequences for using poor strategy • Bees behave like butterflies • “Sting” if caught • Penalty • Lose life • Butterflies escape AR Entertainment