1 / 31

Augmented Reality:

Augmented Reality: Intuitive User Interfaces in Maritime Navigation. Prof. Dr.-Ing. Reinhard Koch 1 Kristine Haase 1,2 In cooperation with Prof. Dr.-Ing. Uwe von Lukas 2 1 Christian-Albrechts-Universität zu Kiel 2 Fraunhofer IGD, Rostock

stuart
Download Presentation

Augmented Reality:

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Augmented Reality: Intuitive User Interfaces in Maritime Navigation Prof. Dr.-Ing. Reinhard Koch1 Kristine Haase1,2 In cooperationwith Prof. Dr.-Ing. Uwe von Lukas2 1Christian-Albrechts-Universität zu Kiel 2Fraunhofer IGD, Rostock • supportedbySevenCs GmbH, Hamburg, andby I-SH Innovationsstiftung Schleswig-Holstein, Germany CESA MAN Diesel Fraunhofer IGD

  2. Definition ofAugmented Reality (AR) CESA MAN Diesel (AR: Metaio) Fraunhofer IGD Reality Augmented Reality Virtual Reality (VR) Source: Milgram, 1994 AR: Mixing ofvirtualcontentintothe real environment

  3. Augmentedand Mixed Reality Source: CAU-MIP AR mixingofvirtualand real objectsfor film post production: includelighting, shadows, occlusionandphysicalinteraction

  4. AR Devices • AR glasses: see-throughprojectors, projectedoverlay • Tracking ofhead-positionandviewdirection • Optical mixingof real sceneandvirtualcontent • Virtual contentenhances (augments) reality AR Design glasses, Project Artesas. Images: Zeiss

  5. Example: Maintenance support Image:Project Arvika

  6. Example: Maintenance support Film: Metaio.com

  7. Overview • Useandexamplesof AR Applications • Use-AR: AR in maritime environment (IGD Rostock) • Case study: AR-Binocular in maritime Navigation • Potential of AR in maritime Navigation

  8. Time tomarketof AR-Technologie (2008)

  9. Potential of AR forbusinessareas • Automotive • Aerospace • Construction • Maintenance • Medicine • Marketing • Tourism/Entertainment • Defence/Security • Maritime Industry

  10. Ergonomic design andsafetyissues Automotive • Head-up Displays • Driver safetywarnings • „Lookingthroughcarbody“ Aerospace • Ergonomic Cockpit design • Radar targetoverlay

  11. Tourism/Marketing/Entertainment • Mobile AR forguidanceand intuitive navigation • AR Games on mobile phonesand I-Pad • Superposition of AR content (historicalsites, TV and Film production)

  12. Constructionand Maintenance • Information overlay • electronic online manual • „x-Ray Vision“ • Tutoringandsupport

  13. Example: Functionaloverlay Fraunhofer IGD AR Maintenance on I-Pad Visual overlayoffunctionalityandmeasuredflowdata

  14. Example: X-rayvisionofpipes in shipcabin Source: Lürssen UseARstudy: Position ofpipesbehindwalls, extractedwith AR

  15. Planning, adaptingofindustrialprocesses Industrial plantsandproductionssites • Testingproductionprocesseswithvirtualprototypes • Retrofitofnewpartstoexistingsites

  16. Example: Fitting newparts on-site Use-AR Study: Visual superpositioningofnovel diesel engineintoexistingstructures. Visual markersregisterthevirtualprototypestothe real world Source: MAN Diesel SE, Metaio

  17. Fraunhofer AR-Study forthe maritime Industry Use-AR (2009): • Study toapply AR in maritime Industry, Fraunhofer IGD in Rostock • Content (in German) - Technology - Case studies - Evaluation & Recommendations • Literature • Download: www.use-ar.de

  18. Case Study: AR-Binocular AugmentedReality System for maritime navigation

  19. Navigation problem: Mapadjustment 2D North-Up 2D Head-Up 3D Egocentric Source: [Porathe, Shepard]: 2D/3D Repräsentation ofnavigationmaps

  20. Navigation problem: Mapadjustment Study (Porathe, Shepard) reveals: ComparisonofmapadjustmentbetweennavigationofficerandLayman: Transformation (Rotation) needs time proportional torotation angle, can not betrained, navigationofficersandLaymanindistinguishable Navigation officersvaluethe intuitive useof 3D egocentricmaps Concept AR-Binocular: Direct 3D overlayofmap in viewwith AR (3D Egocentricview)

  21. Setup of AR Binocular: transformto 3D Perspective Traditional: 2D Top-View New: 3D Egocentricview 3dSzene bild + Seekarte 3D Nauticchart top view View from Bridge Augment 3D viewwithnauticalchartdata

  22. Data flowof AR-Binocular Prepare Chart data Augment video Readout Sensor data Kamera GPS Adjustegocentricview, superimposechartdatatovideo AIS INS Point AR-Binocular MarkerTracking ObjectTracking

  23. Chart database: ECDIS maps • Electronic Navigation: ENC • International HydrographicOrganization (IHO), Special Publication, • Transfer Standard S-57 • ENC/PS ProductSpecificationfor ECDIS (Electronic Chart Display and • Information System • directEnc/SENC (System ElectronicalNavigational Chart) ECDIS software • SevenCs GmbH

  24. Preparechartdata: extractlayersandobjects ENC charts Knowledgebase/Objectextraction 3D Scene/Visualization

  25. Sensor datafor 3D viewestimation 5. Heading-Camera Mobile system: 6 DoF ~ Ø 6m, pitch±~45 °, roll ±~ 45 °, heading 360 ° 1. View camera 2. Display 4. Gravitometer, Gyroscope View camera: 7-fold magnification, 640x480 Pixel Angle ofview: 7x10° (1/60 ° Resolution per Pixel) Binoculardisplayforviewing, 2 x 640x480 Pixel Position (3 DoF) GPS shipnavigationsystem ArtificialHorizon (Gravitometer, Gyroscope) Visual headingsensor relative toshipCompass

  26. Visual Heading-Sensor Heading-Sensor: Headingcamera (Fish-eyecamera) InfraRed-Marker on ceiling (rotationestimation) Objecttracking in viewcamera (imageprocessing) Heading angle Image processingforheading angle estimation Fisheye headingcamera showing IR markers

  27. Example-Scene using AR-Binocular

  28. Example-Scene using AR-Binocular

  29. AR on Tablet PCs

  30. Potential of AR for maritime Navigation + AR holds potential foruse in maritime navigation + Mapsuperposition in cameraviewfeasible, head-upprojectiondisplays on bridgeis an option - Systematiccontentproduction (authoring) still missing - Sensors for mobile AR expensive and still in progress + Integration of AR on Smartphones/I-Pads in thefuture

  31. Thankyouverymuch In cooperationwith Prof. Dr.-Ing. Uwe Freiherr von LukasMaritime Graphics Fraunhofer IGD, Rostock www.3dmaritim.de Kontact: www.mip.informatik.uni-kiel.de

More Related