Next Generation Spatially Immersive Visualization Systems

1. Next Generation Spatially Immersive Visualization Systems Prof. Frederic I. Parke Visualization Sciences Program Visualization Laboratory, Texas A&M University

2. Fully Immersive Characteristics • Wrap around visual ‘immersion’ • Possibly multi-sensory • sight, sound, touch,... • Two main types • spatially immersive and • head mounted displays Visualization Laboratory, Texas A&M University

3. Spatially Immersive Systems • Multiple images projected on surrounding surfaces • Often use stereo images • (active) Sequential images • Single projector / Shutter glasses • (passive) Dual stereo images • Two projectors / Polarized filters • May use position tracking Visualization Laboratory, Texas A&M University

4. Examples - CAVE systems developed at U. of Illinois now commercial versions Visualization Laboratory, Texas A&M University

5. Cave Display Surfaces • up to 6 surfaces of a small room or cubical environment • typically systems use only 3 or 4 walls Visualization Laboratory, Texas A&M University

6. Immersive Environments Major Components • the computational “fabric” • the display “surfaces” • user interaction and tracking Visualization Laboratory, Texas A&M University

7. What is the Next Generation? • New look at the computational fabric and • New look at the display surfaces Visualization Laboratory, Texas A&M University

8. Use a ‘Commodity’ Computing Fabric Benefit from • cost/performance advantages • rapid development • lower cost Visualization Laboratory, Texas A&M University

9. Commodity Computing Concept • Cluster of commodity computers • Fast network interconnection • Open source operating system (Linux) Visualization Laboratory, Texas A&M University

10. Visual Computing Clusters • Extended Cluster Concept • Use ‘visual’ computing nodes • Each computational node has a graphics processor • Each node drives a small facet of the total display surface Visualization Laboratory, Texas A&M University

11. Current Technology Visual Computing Node • Dual 3.0 GHz Xeon processors • 4 Gbytes memory • High-performance graphics processor • such as nVidia 4400 • 1 Gbit networking • ~$4,500 each Visualization Laboratory, Texas A&M University

12. ‘Next Generation’ Computing Fabric • A 12 to 60 node visual computing cluster • Each node corresponds to one display facet • Plus one control / interface computer Visualization Laboratory, Texas A&M University

13. Related Work • Tiled Displays/PowerWalls • Princeton • Argonne National Lab • UNC-CH • Multi-Graphics Project • Stanford Visualization Laboratory, Texas A&M University

14. The ‘Ideal’ Display Surface? • Is probably task specific • One concept is a seamless surrounding sphere with high resolution wrap around images, high update rate, and high complexity modeled environments Visualization Laboratory, Texas A&M University

15. Display Geometries • We want better geometric approximations to the ‘ideal’ sphere • The CAVE is a poor approximation • A number of polyhedral configurations are better Visualization Laboratory, Texas A&M University

16. Polyhedral Display Systems • Multiple display facets • Each facet driven from one visual computing node • Low cost per facet • High aggregate performance • High aggregate resolution Visualization Laboratory, Texas A&M University

17. One possible configurationa 24 facet polyhedron Trapezoidal Icositetrahedra Visualization Laboratory, Texas A&M University

18. 24 Facet polyhedral as approximation to a sphere Visualization Laboratory, Texas A&M University

19. 24 Facet projector placement Visualization Laboratory, Texas A&M University

20. Visual simulation of a 24 facet display structure Visualization Laboratory, Texas A&M University

21. Simulated cross-sectional view of a 5 meter 24 facet display environment Visualization Laboratory, Texas A&M University

22. Another possible configurationa 60 faceted polyhedra Pentagonal Hexcontahedra Visualization Laboratory, Texas A&M University

23. Objectives • Lower cost • Commodity components • Reasonable performance • Useful and effective • Open software Visualization Laboratory, Texas A&M University

24. Challenges • Software Development • Distributed Data Management • Display Synchronization / Stereo Display • Physical Structure/Environment • Suitable Projection Systems • Display Calibration Visualization Laboratory, Texas A&M University

25. Software Development • Adapting existing software packages such as OpenSG, VR Juggler, (CaveLib), … • Developing new local software • Support for different display geometries • Application development support Visualization Laboratory, Texas A&M University

26. Stereo Display • Active • time sequential – shutter glasses • requires very tight synchronization • Passive • anaglyphic – red /cyan (one proj) • polarized (two projectors) Visualization Laboratory, Texas A&M University

27. Physical Structures • Screen frame design • Minimal ‘seams’ • Projector placement • Optical folding • Projector mounts • Heat ‘ripples’ • Screen material • Optical properties Visualization Laboratory, Texas A&M University

28. Image Compensation • Geometric correction • off axis & projector distortion • ‘Image stability’ • explored several approaches • Intensity / color correction Visualization Laboratory, Texas A&M University

29. Budget for a 7 Facet System NSF System • 7 x $17.75k = ~$124k • plus ~ $36k for a control/interface computer, interaction devices, networking, sound, installation, etc… • Total ~ $160k Visualization Laboratory, Texas A&M University

30. 24 Facet polyhedral as approximation to a sphere Visualization Laboratory, Texas A&M University

31. Revised NSF Budget (2005) For each facet ~ $17.75k • 2 Visual computing nodes ~ $9k • 2 Display projectors ~ $3.5k • Screen and structure ~$3.8k • Misc. components ~$1.45k Visualization Laboratory, Texas A&M University

32. Project History • ~1990 Air Force project @ NYIT • ~1998 current concept (w/Ergun) • 2000 CRIC funding (~$5k) • 2002 TITF funding ($165k) • 2005 NSF funding ($500k) Visualization Laboratory, Texas A&M University

33. 3/10 scale physical model using 24 identical facets Visualization Laboratory, Texas A&M University

34. Finished Prototype Architecture Building Atrium ~ 5’ diameter (Mid – 2001) Visualization Laboratory, Texas A&M University

35. ¾ Scale Presentation Prototype Completed May 2002 Visualization Laboratory, Texas A&M University

36. Half of structure frame Visualization Laboratory, Texas A&M University

37. Structure with projected images Visualization Laboratory, Texas A&M University

38. Rear view of 4 screen structure section Visualization Laboratory, Texas A&M University

39. Operational prototype in use Visualization Laboratory, Texas A&M University

40. Closer view Visualization Laboratory, Texas A&M University

41. Project Status • 3 screen prototype (3/4 scale) • 5 screen prototype (full scale) • 7 screen prototype (1/2 scale) • Software (2 generations) • ‘3Dengine’ • ‘Guppy3D’ Visualization Laboratory, Texas A&M University

42. Future Modular Versions • Replace projectors and screens with large flat panel display facets • Create bolt together modules Visualization Laboratory, Texas A&M University