1 / 25

Research in the DV Lab: Tracking, Segmentation, and Model-building

This webpage provides an overview of the research projects in the DV Lab, including road following and architectural modeling. It discusses various methods such as edge-based and region-based approaches for road tracking and segmentation. Additionally, it highlights other areas of research such as cue combination, auto-calibration of sensors, and mapping. The page also showcases current projects and their results in curve tracking, correspondence-based mosaicing, road shape estimation, and obstacle avoidance. The research is motivated by the DARPA Grand Challenge and involves integrating camera views from vehicles with aerial photos, tracing roads in aerial photos, merging structure into local maps, building 3D models from images, and planning paths and obstacle avoidance strategies.

mwalden
Download Presentation

Research in the DV Lab: Tracking, Segmentation, and Model-building

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Prof. Christopher Rasmussen cer@cis.udel.edu Lab web page: vision.cis.udel.edu November 10, 2004

  2. Research in the DV lab • Tracking, segmentation • Model-building, mapping, and learning • Cue combination and selection • Auto-calibration of sensors • Current projects: • Road following, architectural modeling

  3. Road Following: Background • Edge-based methods: Fit curves to lane lines or road borders • [Taylor et al., 1996; Southall & Taylor, 2001; Apostoloff & Zelinsky, 2003] • Region-based methods: Segment image based on discriminating charac- teristic such as color or texture • [Crisman & Thorpe, 1991; Zhang & Nagel, 1994; Rasmussen, 2002; Apostoloff & Zelinsky, 2003] from Apostoloff & Zelinsky, 2003

  4. Problematic Scenes for Standard Approaches Grand Challenge sample terrain Antarctic “ice highway” No good contrast or edges, but organizing feature is vanishing point, which indicates road direction

  5. Results: Curve Tracking Integrate vanishing point directions to get points along curves parallel to (but not necessarily on) road

  6. ~1.5 inches Panoramic camera v2.0a

  7. Correspondence-based Mosaicing • Minimum of 4 corresponding points in two images sufficient to define transformation warping one into other • Can be done manually or automatically

  8. Correspondence-based Mosaicing Translation only

  9. Road Shape Estimation (3 cameras) • Road edge tracking • Estimate quadratic curvature via Kalman filter with Sobel edge measurements

  10. Motion-based Mosaicing • It’s possible to make mosaics of cameras with non-overlapping fields of view provided we have sequences from them (Irani et al., 2001) • Overlapping pixels are wasted pixels • We’re working on approaches for ncameras > 2

  11. Motivation: DARPA Grand Challenge • Organized by DARPA (the U. S. Defense Advanced Research Projects Agency) • A robot road race through the desert from Barstow, CA to Las Vegas, NV on March 13, 2004 • Prize for the winning team: $1 million (nobody won) • Running again next October with $2 million prize

  12. Caltech’s 2004 DGC entry “Bob”

  13. Problem: How to Use Roads as Cues? Bob’s track relative to course corridors (No road following) We’re working on integrating camera views from vehicle with aerial photos

  14. Tracing Roads in Aerial Photos

  15. Structure-based Obstacle Avoidance with a LADAR

  16. Merging Structure into Local Map • Integrate raw depth measurements from several successive frames using vehicle inertial estimates • Combine with camera information • We’re working on calibration techniques courtesy of A. Zelinsky

  17. Laser-Camera Registration Range image (180 x 32) 90° horiz. x 15° vert. Video frame (360 x 240) Registered laser, camera

  18. 3-D Building Models from Images courtesy of F. van den Heuvel Show VRML model

  19. Robot Platform for Mapping Project Wireless ethernet GPS antenna Analog video capture card PTZ camera Onboard computer Not shown: electronic compass, tilt sensor

  20. View Planning • Where to take the photos from? • Hard constraints: Need overlapping fields of view for stereo correspondences • Soft constraints: Balance accuracy of estimated 3-D model, quality of appearance (texture maps) with acquisition, computation time • Based on camera field of view, height of building, placement of occluding objects like trees and other buildings

  21. Path Planning • How to get a robot from point A to point B? • Criteria: Distance, difficulty, uncertainty

  22. Path Planning GPS-referenced CAD map of campus buildings is available Aerial photos contain information about paths, vegetation as well as buildings

  23. Obstacle Avoidance How to detect trash cans, people, walls, bushes, trees, etc. and smoothly combine detours around them with global path planned from map and executed with GPS?

  24. Segmentation-Based Path Following

  25. Segmentation of Road Images Using Different Cues Texture Color +T+L Laser C+T+L

More Related