1 / 32

Senior Thesis Conference

Senior Thesis Conference. March 27, 2009. Team Vision: Steve Caperna , Christopher Cheng, Junghee Cho, Victoria Fan, Avishkar Luthra , Brendan O’Leary, Jansen Sheng , Lee Stearns, Andrew Sun, Roni Tessler , Paul Wong, and Jimmy Yeh. Mentors: Prof. Rama Chellappa

lexi
Download Presentation

Senior Thesis Conference

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Senior Thesis Conference March 27, 2009 Team Vision: Steve Caperna, Christopher Cheng, JungheeCho, Victoria Fan, AvishkarLuthra, Brendan O’Leary, Jansen Sheng, Lee Stearns, Andrew Sun, RoniTessler, Paul Wong, and Jimmy Yeh Mentors: Prof. Rama Chellappa Prof. Cha-Min Tang Discussants: Prof. David Jacobs Dr. Ashok Veeraraghavan Prof. Larry Davis Prof. AnkurSrivastava Mr. Bobby Bobo Consultants: AswinSankaranarayanan PavanTuraga Librarians: Bob Kackley Dan Newsome

  2. Research Question How can technology address the needs of the visually impaired?

  3. Other Commercial Navigation Solutions The White Cane

  4. Subject Data Adaptive Technology Lab at the University of Maryland and the Columbia Lighthouse for the Blind in Riverdale, Maryland 24-61 years old High level of interest in our project Stressed the importance of having options to navigate more independently To be a helpful navigational aid it must be unobtrusive and highly functional Focus on Indoor Object Detection and Outdoor Navigation Subjects

  5. Push-to-Talk Voice Input Speech Output User Interface Audio Feedback Computer Vision Algorithm Image Database Object Identification and Location System Camera

  6. Objects and Landmarks to Identify

  7. An Early Test of Our Vision Algorithm

  8. Camera Feed SIFT BBF RANSAC Object Location 3D Transform 1 2 3 4 5 6 The SIFT Computer Vision Algorithm

  9. The Discrete Speech Interface

  10. The Continuous Beacon Interface

  11. Sign Experiment Setup 3D Object Experiment Setup

  12. Locating a Restroom Sign

  13. Locating a Cane

  14. Initial Results: Discrete Mode: Average Location Time: 16 sec Continuous Mode: Average Location Time: 12 sec With Consistent Tracking: 5 sec

  15. Door Experiment

  16. Camera Feed SIFT BBF RANSAC Object Location 3D Transform 1 2 3 4 5 6

  17. System Diagram Push-to-Talk Voice Input Speech Output User Interface Audio Feedback Computer Vision Algorithm Image Database Camera

  18. Inertial Navigation Unit GPS Receiver System Diagram Push-to-Talk Voice Input GPS Algorithm Graph Speech Output User Interface Audio Feedback Computer Vision Algorithm Image Database Camera

  19. Inertial Navigation Unit GPS Receiver System Diagram Push-to-Talk Voice Input GPS Algorithm Graph Speech Output User Interface Audio Feedback Computer Vision Algorithm Image Database Haptic Feedback Camera

  20. Haptic Feedback Belt

  21. Inertial Navigation Unit GPS Receiver System Diagram Push-to-Talk Voice Input GPS Algorithm Graph Speech Output User Interface Audio Feedback Computer Vision Algorithm Image Database Haptic Feedback A Complete Navigation System for the Blind Camera

  22. Objects and Landmarks to Identify

  23. GPS Navigation

  24. SIFT Terminal Navigation

  25. Outdoor Testing

  26. Outdoor Testing

  27. Inertial Navigation Unit GPS Receiver Push-to-Talk Voice Input GPS Algorithm Graph Speech Output User Interface Audio Feedback Computer Vision Algorithm Image Database Haptic Feedback A Complete Navigation System for the Blind Camera

  28. A Demonstration of Our Object Detection Algorithm

  29. A Demonstration of Our Speech Menu

More Related