740 likes | 964 Views
Introduction to Computer Vision. Lecture 1 Dr. Roger S. Gaborski. Course Goals. Obtain a working knowledge of computer vision Become familiar with programming in the MATLAB environment Gain an understanding of current research in computer vision. Teaching Assistant. Jeffrey Zullo
E N D
Introduction to Computer Vision Lecture 1 Dr. Roger S. Gaborski
Course Goals • Obtain a working knowledge of computer vision • Become familiar with programming in the MATLAB environment • Gain an understanding of current research in computer vision RS Gaborski
Teaching Assistant • Jeffrey Zullo • E-Mail: jlz9811@rit.edu • Responsible for homework grading and tutoring • Tutoring hours in lab (70-3400): • Mondays and Wednesdays: noon – 2pm RS Gaborski
Where to Find Me • Office: 70 – 3647 • My lab 70-3400 • Office Hours: • By appointment on Tuesdays, 10am-noon in my lab or office • Homework email: rsg.introcv@gmail.com RS Gaborski
Course Outline • Textbook – Digital Image Processing using MATLAB • SECOND EDITION 2009 Gatesmark Publishing • Online MATLAB tutorial-Register at Mathworks: • http://www.mathworks.com/academia/student_center/tutorials/launchpad.html • Homework • Quizzes, Exams and Final • Projects (4005-757 only) • Grading • Webpage: www.cs.rit.edu/~rsg (includes course calendar on CV page) • Lecture slides will not always be posted on webpage RS Gaborski
Homework • Questions concerning Homework • Do not wait until the night before its due to start working on the HW • Ask questions in class concerning HW • First, ask the TA during his office hours • If the TA cannot answer your questions, see me during my office hours • Do not send me email concerning the HW after noon the night before it is due. I will not be able to respond to your email. RS Gaborski
Grading • Homework 35%(457) 20%(757) • Quizzes/Exams/Final65% 65% • Project* --- 15% • No Project for 4003-457 • *Project: 757 Individual only, weekly presentation updates RS Gaborski
Typical Course Grade • 90%-100% A* • 80%-89% B • 70%-79% C • 60%-69% D • <60% F * Note: For example, 89.4 is a ‘B’, 89.5 is rounded to 90 which is an ‘A’ RS Gaborski
Project • Choose from a list of projects provided on course Project Page • Ten minute verbal proposal presentation (see course calendar) • Project grade includes verbal proposal, verbal update reports (if scheduled) and final presentation, code and report • Must receive a passing grade in the project to pass the course RS Gaborski
What has changed in the computer vision field in the last 5 to 10 years? RS Gaborski
Images are Everywhere • On the web – flickr, Google Images, YouTube • On your computer – iPhoto, Picasa • Video Surveillance: • Streets • Hotels • Businesses • Parking lots RS Gaborski
Computer Vision – Interpretation of Images • Digital photographs • Medical radiographic images • Functional magnetic resonance imaging (fMRI) • Medical ultrasound • Industrial radiographic images • Digital video images • Satellite images • Astronomy RS Gaborski
Digital Image RS Gaborski
Digital Image RS Gaborski
Digital Image RS Gaborski
Medical Related Images Information obtained from images: Bone structure Soft Tissue Brain Activity
Medical Radiographic Image www.4umi.com/image/x-ray.jpg RS Gaborski
Medical Ultrasound http://keystone.stanford.edu/~huster/photos/i/ultrasound.640.jpg RS Gaborski
Functional MRI A 20-year old female drinker A 20-year old female nondrinker Response to the spatial working memory task. Brain activation is shown in bright colors. RS Gaborski www.alcoholism2.com/
Industrial Applications Non Destructive Testing Inspection / Security
Industrial Radiographic Image www.vidisco.com/ CabinetXrayMic80A_01.htm RS Gaborski
Industrial Radiographic Image Pseudo- color www.vidisco.com/ CabinetXrayMic80A_01.htm RS Gaborski
Satellite Images RS Gaborski www.noaa.gov
Astronomy Images www.sdsc.edu/ sciencegroup/astronomy/ RS Gaborski
Astronomy Images astro.martianbachelor.com/ RS Gaborski
Video Enhancement • Invisible motion in video • Prof. William T. Freeman • http://www.youtube.com/watch?v=1KfYrrihCqk • http://www.youtube.com/watch?v=sVlC_-e-4yg RS Gaborski
How Hard Is It To Find Objects in an Image?A Few Observations • Object recognition is a very difficult problem • Objects can be rigid, or flexible • Finding a specific object ( is easier than finding all objects that belong to a category RS Gaborski
Find a Yellow 911 Porsche RS Gaborski
Find All Cars in an Image RS Gaborski
What About Background IssuesSeparating the car from the background RS Gaborski
Image Database Problem • Assume you have taken pictures with your digital camera the last three years • You now have 4000 pictures stored on your computer’s hard drive • How do you sort them? RS Gaborski
Potential categories: 1. Road 2. Field 3. Beach 4. Residential 5. Forest 6. Mountain RS Gaborski
Streets RS Gaborski
Open Country RS Gaborski
Student Result RS Gaborski
More Categories RS Gaborski
How Else Could You Identify Locations? Recognize objects in the image?
How do you find a particular face • How do you find a particular object in an image? • Faces • Cars • Buildings • etc RS Gaborski
Images are simply represented by numbers (pixels) Values = 0 Values = 255
[ 0, 64, 128, 192, 255] RS Gaborski
Grayscale version of image RS Gaborski
Small region of image Region: rows 6 to 16, columns 18 to 28) 52 53 53 54 54 64 170 186 180 178 174 54 54 53 49 70 144 186 181 180 177 175 52 53 49 77 166 184 172 170 170 172 172 52 48 87 174 186 175 172 172 171 168 164 46 90 185 189 180 175 171 170 168 164 164 67 177 185 173 173 172 173 171 168 164 167 145 187 173 172 170 168 167 169 170 169 166 189 179 174 170 171 171 169 168 168 170 170 173 173 176 175 171 170 171 169 168 168 169 174 172 171 175 177 172 170 170 170 170 169 175 174 172 172 171 174 172 169 170 171 170 RS Gaborski
Brightness Mapped to Color RS Gaborski
Brightness Mapped to Height RS Gaborski
Absolute Value of Difference of Adjacent Horizontal Values 1 0 1 0 10 106 16 6 2 4 0 1 4 21 74 42 5 1 3 2 1 4 28 89 18 12 2 0 2 0 4 39 87 12 11 3 0 1 3 4 44 95 4 9 5 4 1 2 4 0 110 8 12 0 1 1 2 3 4 3 42 14 1 2 2 1 2 1 1 3 10 5 4 1 0 2 1 0 2 0 0 3 1 4 1 1 2 1 0 1 2 1 4 2 5 2 0 0 0 1 1 2 0 1 3 2 3 1 1 1 RS Gaborski