120 likes | 220 Views
Rapidly Incorporating Real Objects for Evaluation of Engineering Designs in a Mixed Reality Environment. Xiyong Wang, Aaron Kotranza, John Quarles, Benjamin Lok Computer and Information Sciences and Engineering Department University of Florida [xw3, akotranz, jpq, lok@cise.ufl.edu ].
E N D
Rapidly Incorporating Real Objects for Evaluation of Engineering Designs in a Mixed Reality Environment Xiyong Wang, Aaron Kotranza, John Quarles, Benjamin Lok Computer and Information Sciences and Engineering DepartmentUniversity of Florida [xw3, akotranz, jpq, lok@cise.ufl.edu] B. Danette Allen NASA Langley Research Center Danette.Allen@nasa.gov
At assembly design stage: Several constructed parts Many CAD models for parts yet to be constructed Unverified assembly plans How can we verify the assembly plan? Driving Application: Engineering Design Evaluation Motivation: • Finding design flaws earlier will save time and money • Virtual environments have difficulty simulating hands-on assembly • Support team based interaction To be built in 2008 We only have this in 2005
Previous Work • Engineering Design • Zachmann--Virtual Assembly Simulation: Pure VE technique used in Assembly [GMD IMK, Oct 2000] • Jack – commercial software to do ergonomics (www.ugs.com) EDS • Interfaces in VR • LaViola, Bowman (Siggraph 2001 course notes) – comprehensive list of VR interaction • Collaboration • Mortensen 2002, Collaboration in tele-immersive environments. [Eurographics] • Pinho 2002 Cooperative Object Manipulation [VRST2002] Image from Zachmann’s website, only the gloves (or hands) were tracked [http://web.informatik.uni-bonn.de/II/ag-klein/people/zach/projects/fhg/ems.html]
Mixed Environment Solution • Mixed Environments (ME): • Components • Physical objects • CAD models • Physical correlates • Effective Interaction • Haptic feedback • Visualization of Articulated models • Challenges • Capturing physical models • Tracking real objects • Supporting teamwork
Capturing the Physical Model Reconstruction from multiple scans Scanning Define color markers Interaction in ME
Tracking Solution • Object tracking • STRAPS - color tracking • Web cams • Attributes • Low cost • Moderate latency • Moderate accuracy • Many sensors • Limited marker space • Solution: Multi-blob tracking • Head tracking • Worldviz PPT • Intersense Interiacube2 • Attributes • Expensive • Low latency, • High accuracy • Few sensors
Experiment • Assembly task • Abstracted task • CAD models and parts from NASA • Components: • Real circuit board • Fuel tank physical correlate • Virtual fuselage CAD model
Team Based Visualization • HMD • For primary technician • Desktop • For remote observers • Tracked Tablet PC • For local team members • Engineers • Supervisors
Conclusion • Future work: • Improve tracking • Robustness • Additional cameras • Formal study with NASA engineers • Avatars • Automate pipeline --Reduce incorporating time to 15 minutes!! • Results • The user: • Found the design flaw • Reordered the assembly plan dynamically • Completed the assembly task successfully • Takes two hours to incorporate a real object into the ME • Problems • Tracking • Occlusion • Latency More tracking camera from different location make more complicate tasks possible. But complicated mechanism is needed to combine the information from multi channel
Acknowledgements • Funding • University of Florida • People • NASA Langley Research Center • UNCC • Dr. Shin • Jonathan Jackson • Dr. Hodges • CISE, UF • Robert Dickerson • Art Homs