Augmented Reality

1. Augmented Reality COMP 1701 Nicholas Alberts

2. What is Augmented Reality? • Augmented reality is a combination of a real life scene from a person, and a virtual scene from a computer that augments the scene with additional information • Specifically, augmented reality superimposes audio, graphics and other virtual affects upon the surrounding environment.

3. The Goal • Augmented reality enhances one's perception. The real world is simply the foundation. The goal is to make a system that will be so efficient that the user will not be able to tell the difference between the real world and the virtual augmentation.

4. Virtual vs. Augmented • Virtual Reality is defined as, "a computer generated, interactive, three-dimensional environment in which a person is immersed.” • In other words, virtual reality completely immerses the use in the virtual environment • Augmented reality virtually changes the real world while allowing the user to keep a sense of presence about his surroundings

5. Performance Criteria • The mechanism that augments reality can be judged based on two things • Update rate for generating the augmented image • Accuracy of the registration of the real and virtual image So in order for AR to be perceived as “real,” the rate at which the system renders the image must be no fewer than 10 images a second. It also means that the system must be able to register its environment accurately enough so that a virtual change can be super imposed

6. The Hardware • In order for the AR system to work, certain hardware is needed, including: display, tracking, input devices, sensors and a processor. • Currently, components such as a CPU, camera, display, accelerometer, GPS and solid state compass.

7. Display • One can perceive augmented reality in generally three different ways: • Head mounted: the most immersive experience, HMD puts the virtual scene over the user’s view of the world. The device is either optical see-through or video see-through • Handheld: the most commercially successful AR system, handheld display is generally video see-through with a gyroscope in order to orient the image • Spatial: any AR device separated from the user. Can be used by multiple people. In some cases, users are able to touch virtual physical objects giving a sensation of realness.

8. Software • AR vision methods are based on visual odometry, or determining position using camera images • This generally includes feature detection and other image processing methods • It also requires a real world coordinate system to be made once the image is processed, created by perhaps fiduciary marks on the image, simultaneous localization and mapping of the image, or other mapping methods

9. Applications: Medical • Augmented Reality has the ability to enhance the efficiency of surgeries and diagnostics • Virtual x-rays • Real time ultra-sound images • Nuclear magnetic resonance images • MRI images images

10. Applications: Military • Numerous applications: • Detect objects not discernable to the naked eye, such as toxins • Examine sound of gunfire to determine location of shooter and type of weapon • Enhanced visual feedback of surroundings • Represent physical objects that aren’t yet visible, such as an airplane that has yet to land • Displays in cockpits of military vehicles • War game simulation technology • Etc.

11. Applications: Navigation • Building navigation; in order to analyze and explore buildings effectively • Military operations • Disaster management • Heads up displays that cover the displays of automobiles, planes, etc. • Individual navigation through now urban areas (street to street, place to place (GPS))

12. Applications: Entertainment, Performance and Education • Augmented Reality systems can create virtual objects and environments that enhance the experience of entertainment, and the quality of education • Musical performances can be augmented to add to the experience or create certain sound effects • Interaction with educational tools • Virtual guides that can even activate based on location on GPS or proximity to marker

13. Applications: Digital Applications • Since smart phones come with most of the basic components for an AR system, applications soon began to flood the smart phone market, making AR commercially successful • Examples of smart phone apps exemplify the many uses • Wikitude : Gives the user data about their surroundings by overlaying information on the real-time scene taken by the phone’s camera • Augmented ID : gives the user the ability to identify someone by looking at them through the camera of the phone • Image Space : lets the user record messages, photos and video and tag them with both place and time. Then, when someone else goes to that same location they can see the images that were left in the area • Layer :Positioning the camera over your environment, the phone can overlay images from web pages and information about businesses in the area • Video Games: A game is generally overlayed on to the user’s surroundings, then the user may interact with the scene through the phone

14. Everyday Augmented Reality • Powers immersive video games • Very common to use it to navigate one’s surroundings • Interact and understand digital content more interestingly • Clear benefits recognized in using AR technology • Now found on most smart phones, opening up a whole new way to interact with the digital and physical environment • There is now an entire market for AR apps, including one’s that possibly give schematics for a building, the constellations in the sky or the information about nearby restaurants • AR now available in Adobe Flash, making AR accessible through web browsing • Recently there has been a new form of crude 2D bar code technology, which can be used to quickly transfer information

15. Limitations and Cons • Does not work as well indoors • GPS only accurate within 9 meters • Danger of ‘too much information,” where a disconnect forms between the user and the real world • Privacy will be harder to keep due to virtual interaction • Over reliance on AR technology • Image recognition technology not developed to potential yet • Inaccurate depth perception • Calibration and latency still poor

16. The Future of Augmented Reality • Next generation of smart phones will be able to handle augmented reality to a much greater extent due to improved batteries, compasses, graphics chips and processors. • The mobility of the smart phone and the location based services make AR a very popular investment. • The line between virtual and physical begins to blur as augmented technology grows • Greater access to information based on AR will mean greater awareness of surrounding • Virtual graffiti and art could be developed • Desire for increased AR technology in the field of medicine, as well as other fields.

17. References • "Augmented reality - Wikipedia, the free encyclopedia." Wikipedia, the free encyclopedia. N.p., n.d. Web. 1 Feb. 2011. <http://en.wikipedia.org/wiki/Augmented_reality>. • Bonsor, Kevin. "HowStuffWorks "Augmented Reality in Video Games and the Military"." Howstuffworks "Computer". N.p., n.d. Web. 30 Jan. 2011. <http://computer.howstuffworks.com/augmented-reality3.htm>. • Brandon, John. "Augmented Reality Past, Present and Future: How It Impacts Our Lives." Technology News, Product Reviews, Software Downloads | Digital Trends. N.p., n.d. Web. 1 Feb. 2011. <http://www.digitaltrends.com/features/ge-augmented-reality-iphone-app-past-present-and-future-how-it-impacts-our-lives/>. • Krevelen, D.W.F. van , and R. Poelman Poelman. "A Survey of Augmented Reality Technologies, Applications and Limitations." The International Journal of Virtual Reality. Delft University of Technology, n.d. Web. 1 Jan. 2011. <www.ijvr.org/issues/issue2-2010/paper1%20.pdf>. • Tumba. "Augmented Reality." HubPages. N.p., n.d. Web. 1 Feb. 2011. <http://hubpages.com/hub/Augmented_Reality>. • Vallino, Jim. "Augmented Reality Home Pages - Introduction." Software Engineering @ RIT | RIT | Department of Software Engineering. N.p., n.d. Web. 1 Feb. 2011. <http://www.se.rit.edu/~jrv/research/ar/introduction.html>.