1 / 8

SIMULATION DECSIONs engagement ANALYSIS

BUILDING 360 INTERACTIVES. Virtual reality based SCREEN BASED. SIMULATION DECSIONs engagement ANALYSIS. P WEYAND. Technologies. BUILDING 360 INTERACTIVES. 360 Cameras (GoPro, 360Fly) Unity3D HTC Vive , MS Hololens Flat screen environments Live 3D Motion Capture (VICON)

mwinn
Download Presentation

SIMULATION DECSIONs engagement ANALYSIS

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. BUILDING 360 INTERACTIVES Virtual reality based SCREEN BASED SIMULATION DECSIONs engagement ANALYSIS P WEYAND

  2. Technologies BUILDING 360 INTERACTIVES 360 Cameras (GoPro, 360Fly) Unity3D HTC Vive, MS Hololens Flat screen environments Live 3D Motion Capture (VICON) Biomechanics Lab, PARCLE Lab

  3. 360 Video Authentic Learning Experiences BUILDING 360 INTERACTIVES • Authentic assessments – simulation, specialized environments, EMRISE. • Work experience – Student practical • Research & Rehabilitation - Integrate with VR/MR • Interactivity – user can interact with objects within video or video objects interact with real world elements • Record, measure, evaluate, feedback https://www.acu.edu.au/locations/brisbane/brisbane-virtual-tour

  4. Simple Implementation BUILDING 360 INTERACTIVES • Using a 360 video as the stimulus, create and link a variety of learning activities • Academic or student focused – shareable experiences • Monitor and record responses, decisions – analytics • Feedback

  5. Complex Implementation BUILDING 360 INTERACTIVES • 360 video forms the shell – Unity3d Player • Integrate body motion tracking via Vicon/Unity3d plugin. • Integrate objects tracking via HTC Vive/Unity3D Plugin • Collect detailed user performance data • Post process 360 video objects for interactivity (Integrate computer vision for tracking)

  6. Elements of 360 Interactive Video BUILDING 360 INTERACTIVES How it works • Video capture via 360 camera • Develop interactive engine in Unity3D. Create sphere mesh around camera – record zone 3D space and time. • Track dynamic and static objects with (invisible) clickable zones • Link zone to learning activity or resource –activate by selecting • Store zone & resource coordinates file/db

  7. Elements of 360 Interactive Video BUILDING 360 INTERACTIVES Interactive Engine with Zones • Static zones for fixed objects. • Dynamic zone track moving object

  8. Things to be done…. BUILDING 360 INTERACTIVES Lots….. !! • Dynamic sizing of zones • Editors for resources • Complete editor for zone placement • Computer Vision usage • Maybe AI usage? • Maybe WebGL version?

More Related