1 / 51

Mobile Augmented Reality Game Development

Mobile Augmented Reality Game Development. Jeff Chastine Southern Polytechnic State University Georgia State University, Mar. 27, 2013. Hi!. Overview. What got us here? Paradigm Shift! Case Study: Qualcomm Challenges of AR Game Dev If time: code review. A Little AR History. 1968

drago
Download Presentation

Mobile Augmented Reality Game Development

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Mobile Augmented RealityGame Development Jeff Chastine Southern Polytechnic State University Georgia State University, Mar. 27, 2013

  2. Hi!

  3. Overview • What got us here? • Paradigm Shift! • Case Study: Qualcomm • Challenges of AR Game Dev • If time: code review

  4. A Little AR History • 1968 • Ivan Sutherland • Optical Combiner

  5. A Little AR History • 1992 • Tom Caudell and David Mizell coin theterm “Augmented Reality”

  6. A Little AR History • 1994 • Virtual Reality (VR) attempts to completely synthesize • Augmented Reality (AR) integrates virtual objects into the physical world Mixed Reality RealEnvironment AugmentedReality (AR) AugmentedVirtuality (AV) VirtualEnvironment(VR)

  7. A Little AR History • 1996 – Rekimoto tracks in6 DoF! • x, y, z • yaw, pitch, roll

  8. A Little AR History • 1997 • Azuma states three requirements: • Combines the real and virtual worlds • Interactive in real time • Registered in 3D

  9. A Little AR History • 1997 • Feiner et. al create the “Touring Machine” • First mobile augmented reality system

  10. A Little History • 1999 • ARToolkit • Free/Open Source • Kato/Billinghurst • Good for intro to AR

  11. Visual Tracking(ARToolkit)

  12. A Little History • 2000 • Landmark breakthrough! • AR with Duran Duran

  13. Hardware Requirements • HMDs/Displays • Rendering • Tracking

  14. Display • Tabletops • Tablets & Phones • HMDs • Optical (see-through) • Stereo? • Video (closed-view)

  15. Tracking • GPS, HA-GPS, GPS/RTK • Acoustic (IS-900) • Electro-magnetic (Polhemus) • Visual (ARToolkit)

  16. AR Examples

  17. Scenarios • Medical • Scientific Visualization • Expert/Technician

  18. Scenarios • Medical • Scientific Visualization • Expert/Technician

  19. Scenarios • Medical • Scientific Visualization • Expert/Technician

  20. AR in Education

  21. Navigation

  22. Commercial Nightvision

  23. Military

  24. General Problems • Tracking Accuracy • Optical vs. Video • Optical – High Resolution/FoV. Synching/Delay issues, brightness issues • Video – safety: camera vs. eye offset • Registration Problems • location • lag in rendering • Weight/Battery Life • Interaction • Techniques • Physical objects

  25. Other Issues: Interaction

  26. Paradigm Shift! • Note: • Media is cool • Mobile is cool • Media+Mobile must be really cool • Unity supports scripting • Basic programming concepts • Reinforces OO • Javascript or C# (or Boo) • Provides scaffolding to remove barriers (or at least lower them)

  27. Moving into Mobile Layar Nearest Tube

  28. Moving into Mobile (2007)Magic Books

  29. Moving into Mobile • ARToolkit on an iPhone (2008)

  30. Moving into Mobile (2009)I MAED A GAM3 W17H AR 1N 1T – (not really, it’s called AAAARRRRRGH!)

  31. Moving into Mobile

  32. Let’s make a Magic Book • Mark Billinghurst et al. • The hard part is finding a tracker…

  33. Mobile AR Gaming • Need a good tracker • GPS + Gyros is NOT good enough! • Qualcomm has released their free tracker! • Need a good/cheap display • Phone is a window into the virtual world • Need a way to make games/render + = Easy AR!

  34. Not anymore…

  35. AR Preprocessed Images (pictures + tracking information) Into the ImageTargetTextures folder Into the Streaming Assets / QCAR folder “Page” Textures Tracking XML file and data file

  36. Very Cool Unity Mobile API • Input.acceleration • Returns orientation as a Vector3 • Input.GetKeyDown(KeyCode.Mouse0) • Screen tap event • iPhoneUtils.Vibrate() • Makes the phone vibrate • GPS/Location • Unity 3.2 or Java LocationManager interface and native wrapper

  37. AR Demo

  38. Using accelerometers

  39. A safe place to get started • ARToolkit • Free • Written in C • Uses fiducials • http://www.hitl.washington.edu/artoolkit/ • What you’ll need: • A webcam • A printer • A compiler • Graphics card?

  40. The Qualcomm AR SDK • Free • Works with Android • Java • JNI • C++ • Runs on Qualcomm chipsets • HTC Incredible • Nexus One • Others • https://ar.qualcomm.com/qdevnet/

  41. Others • Dekko SDK • No training! • 13th Lab’s PointCloud • Dynamic building of the scene

  42. The Burden of AR Gaming • Printing out fiducials • Is this really “mobile”? • User training • Do your parents know what AR is? • How do you interact in AR environments? • Don’t block the tracker! • Don’t shake the camera!

  43. The Burden of AR Gaming • How do you interact? • Point and click? • Tactile feedback? • Will people get physically tired?

  44. User Acceptance is Key • Tracking is a challenge • Lazy players • AR must “go beyond” ( and why AR?) • Where’s the killer app?

  45. 5 Common AR Mistakes(if you don’t believe me) • Poor education • Not investing in content • Different AR app for every campaign • AR and 3D for the sake of AR • Make content engaging http://www.mobilemarketer.com/cms/news/software-technology/14435.html?goback=%2Egde_67494_member_226398138

  46. The Future of AR? • Lots of hype right now • Project Glass?

More Related