90 likes | 180 Views
Computer Vision Assisted Virtual Reality Calibration. Won S. Kim Summarized by Geb Thomas. Models and Supervisory Control. An accurate model would allow supervisory control Video feedback used to make model accurate Eliminate difficulties from the time delays
E N D
Computer Vision Assisted Virtual Reality Calibration Won S. Kim Summarized by Geb Thomas
Models and Supervisory Control • An accurate model would allow supervisory control • Video feedback used to make model accurate • Eliminate difficulties from the time delays • A natural application area is for orbital replacement units in the international space station
The ORU Problem • End effector close-up camera is obstructed • Manual teleoperation is difficult • Alignment requirements on the order of +-1/4 inch and 3 degrees for rotation • 2-8 second round trip delay for near orbit
A Solution • Use lines in the image to calibrate the cameras and model to the observations • Use the model on the ground to program the remote robots • Or upload the model and let the crew telemanipulate from the model
The Challenges • 3D model-based recognition with global searches takes too long • Need operator interaction to limit searches • point-click for coarse positioning • graphic model control for fine tuning • Past methods have separated model and camera calibration. This approach combines them
The Line Detector • Lines are easier and more reliable than points. • Uses Gennery’s weighted average local line detector
The Sobel Detector K=1, for Prewitt K=2 for Sobel
Find the line Segment Y’ (1-x’/L)h1 + (x’/L)h2 = y’ h2 h1 X’