720 likes | 910 Views
CSCI-631 Foundations of Computer Vision. Lecture 1 Dr. Roger S. Gaborski. Course Goals. Obtain a working knowledge of computer vision Become familiar with programming in the MATLAB environment Gain an understanding of current research in computer vision
E N D
CSCI-631Foundations of Computer Vision Lecture 1 Dr. Roger S. Gaborski
Course Goals • Obtain a working knowledge of computer vision • Become familiar with programming in the MATLAB environment • Gain an understanding of current research in computer vision • Demonstrate computer vision knowledge by computing a computer vision research project RS Gaborski
Teaching Assistant • Zhen Kuang He • E-Mail: zxh3909@rit.edu • Responsible for homework grading and tutoring • Tutoring hours in lab (70-3400): • TBD RS Gaborski
Where to Find Me • Office: 70 – 3647 • My lab 70-3400 • Office Hours: • Tuesday and Thursday, 11am-noon in my lab or office • My appointment • email: rsg@cs.rit.edu • HOMEWORK EMAIL: rsg.CV631@gmail.com RS Gaborski
Course Outline • Textbook – Digital Image Processing using MATLAB • SECOND EDITION 2009 Gatesmark Publishing • Online MATLAB tutorial-Register at Mathworks: • http://www.mathworks.com/academia/student_center/tutorials/launchpad.html • MATLAB tutorial: http://etools.fernuni.ch/matlab/matlab1/en/html/startpage.html • Homework – individual and team • Quizzes, Exams and Final • Team Project • Attendance Required • Grading • Webpage: www.cs.rit.edu/~rsg (includes course calendar on CV page) • Lecture slides will not always be posted on webpage RS Gaborski
Homework • Questions concerning Homework • Do not wait until the night before its due to start working on the HW • Ask questions in class concerning HW • First, ask the TA during his office hours • If the TA cannot answer your questions, see me during my office hours • Do not send me email concerning the HW afternoon the night before it is due. I will not be able to respond to your email. RS Gaborski
Grading • Homework (Individual and Team) 20% • Quizzes/Exams/Final 50% • Team Project 20% • Attendance (Required) 10% RS Gaborski
Typical Course Grade • 90%-100% A* • 80%-89% B • 70%-79% C • 60%-65% D • <65% F * Note: For example, 89.4 is a ‘B’, 89.5 is rounded to 90 which is an ‘A’ RS Gaborski
What has changed in the computer vision field in the last 5 to 10 years? RS Gaborski
Images are Everywhere • On the web – flickr, Google Images, YouTube • On your computer – iPhoto, Picasa • Video Surveillance: • Streets • Hotels • Businesses • Parking lots RS Gaborski
Computer Vision – Interpretation of Images • Digital photographs • Medical radiographic images • Functional magnetic resonance imaging (fMRI) • Medical ultrasound • Industrial radiographic images • Digital video images • Satellite images • Astronomy RS Gaborski
Digital Image RS Gaborski
Digital Image RS Gaborski
Digital Image RS Gaborski
Medical Related Images Information obtained from images: Bone structure Soft Tissue Brain Activity
Medical Radiographic Image www.4umi.com/image/x-ray.jpg RS Gaborski
Medical Ultrasound http://keystone.stanford.edu/~huster/photos/i/ultrasound.640.jpg RS Gaborski
Functional MRI A 20-year old female drinker A 20-year old female nondrinker Response to the spatial working memory task. Brain activation is shown in bright colors. RS Gaborski www.alcoholism2.com/
Industrial Applications Non Destructive Testing Inspection / Security
Industrial Radiographic Image www.vidisco.com/ CabinetXrayMic80A_01.htm RS Gaborski
Industrial Radiographic Image Pseudo- color www.vidisco.com/ CabinetXrayMic80A_01.htm RS Gaborski
Satellite Images RS Gaborski www.noaa.gov
Astronomy Images www.sdsc.edu/ sciencegroup/astronomy/ RS Gaborski
Astronomy Images astro.martianbachelor.com/ RS Gaborski
Video Enhancement • Invisible motion in video • Prof. William T. Freeman • http://www.youtube.com/watch?v=sVlC_-e-4yg RS Gaborski
How Hard Is It To Find Objects in an Image?A Few Observations • Object recognition is a very difficult problem • Objects can be rigid, or flexible • Finding a specific object ( is easier than finding all objects that belong to a category RS Gaborski
Find a Yellow 911 Porsche RS Gaborski
Find All Cars in an Image RS Gaborski
What About Background IssuesSeparating the car from the background RS Gaborski
How many pills in this image? http://i.telegraph.co.uk/multimedia/archive/01384/pills_1384371c.jpg RS Gaborski
Image Database Problem • Assume you have taken pictures with your digital camera the last three years • You now have 4000 pictures stored on your computer’s hard drive • How do you sort them? RS Gaborski
Potential categories: 1. Road 2. Field 3. Beach 4. Residential 5. Forest 6. Mountain RS Gaborski
Streets RS Gaborski
Open Country RS Gaborski
Student Result RS Gaborski
More Categories RS Gaborski
How Else Could You Identify Locations? Recognize objects in the image?
How do you find a particular face • How do you find a particular object in an image? • Faces • Cars • Buildings • etc RS Gaborski
Images are simply represented by numbers (pixels) Values = 0 Values = 255
[ 0, 64, 128, 192, 255] RS Gaborski
Grayscale version of image RS Gaborski
Small region of image Region: rows 6 to 16, columns 18 to 28) 52 53 53 54 54 64 170 186 180 178 174 54 54 53 49 70 144 186 181 180 177 175 52 53 49 77 166 184 172 170 170 172 172 52 48 87 174 186 175 172 172 171 168 164 46 90 185 189 180 175 171 170 168 164 164 67 177 185 173 173 172 173 171 168 164 167 145 187 173 172 170 168 167 169 170 169 166 189 179 174 170 171 171 169 168 168 170 170 173 173 176 175 171 170 171 169 168 168 169 174 172 171 175 177 172 170 170 170 170 169 175 174 172 172 171 174 172 169 170 171 170 RS Gaborski
Brightness Mapped to Color RS Gaborski
Brightness Mapped to Height RS Gaborski
Absolute Value of Difference of Adjacent Horizontal Values 1 0 1 0 10 106 16 6 2 4 0 1 4 21 74 42 5 1 3 2 1 4 28 89 18 12 2 0 2 0 4 39 87 12 11 3 0 1 3 4 44 95 4 9 5 4 1 2 4 0 110 8 12 0 1 1 2 3 4 3 42 14 1 2 2 1 2 1 1 3 10 5 4 1 0 2 1 0 2 0 0 3 1 4 1 1 2 1 0 1 2 1 4 2 5 2 0 0 0 1 1 2 0 1 3 2 3 1 1 1 RS Gaborski