470 likes | 632 Views
Introduction to Computer Vision. Lecture 1 Dr. Roger S. Gaborski. Where to Find Me. Office: 70 – 3647 Office Hours: Tuesday 3:00 - 4:00pm (I will be in either my office or my lab, 70-3400) Thursday 2:00 - 3:00pm (I will be either in my lab 70-3400 or my office)
E N D
Introduction to Computer Vision Lecture 1 Dr. Roger S. Gaborski
Where to Find Me • Office: 70 – 3647 • Office Hours: • Tuesday 3:00 - 4:00pm (I will be in either my office or my lab, 70-3400) • Thursday 2:00 - 3:00pm (I will be either in my lab 70-3400 or my office) • Other times by appointment (No appointments on Mondays and Fridays) • Often in my lab or office Wednesdays after 11:00am RS Gaborski
Goals of Computer Vision • Image Enhancement • Reduce noise in an image thereby revealing features in the image • Image Processing Operations • Segment the image into objects • Label individual objects • Image Understanding • Understand the ‘content’ of an image or sequence of images (video) • Extract meaning of the image RS Gaborski
Course Outline • Optional Textbook • Online MATLAB tutorial • Topics • Homework • Exams • Projects (4005-757 only) • Grading • Webpage: www.cs.rit.edu/~rsg (includes course calendar on CV page) RS Gaborski
Grading (with Final) • Homework 30%(457) 20%(757) • Quizzes 50% 50% • Project* --- 10% • Final 20% 20% • No Project for 4003-457 • *Project: 757 Individual only, also, presentation RS Gaborski
Grading (without Final) • 4003-457 • Homework 40% • Quizzes 60% • 4005-757 • Homework 30% • Quizzes 60% • Project 10% RS Gaborski
Course Grade • 90%-100% A* • 80%-89% B • 70%-79% C • 60%-69% D • <60% F * Note: For example, 89.4 is a ‘B’, 89.5 is rounded to 90 which is an ‘A’ RS Gaborski
Project • Choose from a list of projects provided on course Project Page • Lecture 10 – One page Project Proposal on your webpage* • Weekly updates* starting with Lecture 11 – see course calendar • *Project grading includes proposal and weekly update progress RS Gaborski
Computer Vision – Interpretation of Images • Digital photographs • Medical radiographic images • Functional magnetic resonance imaging (fMRI) • Medical ultrasound • Industrial radiographic images • Digital video images • Satellite images • Astronomy RS Gaborski
Digital Image RS Gaborski
Digital Image RS Gaborski
Digital Image RS Gaborski
Medical Related Images Information obtained from images: Bone structure Soft Tissue Brain Activity
Medical Radiographic Image www.4umi.com/image/x-ray.jpg RS Gaborski
Medical Ultrasound http://keystone.stanford.edu/~huster/photos/i/ultrasound.640.jpg RS Gaborski
Functional MRI A 20-year old female drinker A 20-year old female nondrinker Response to the spatial working memory task. Brain activation is shown in bright colors. RS Gaborski www.alcoholism2.com/
Industrial Applications Non Destructive Testing Inspection / Security
Industrial Radiographic Image www.vidisco.com/ CabinetXrayMic80A_01.htm RS Gaborski
Industrial Radiographic Image Pseudo- color www.vidisco.com/ CabinetXrayMic80A_01.htm RS Gaborski
Satellite Images RS Gaborski www.noaa.gov
Astronomy Images www.sdsc.edu/ sciencegroup/astronomy/ RS Gaborski
Astronomy Images astro.martianbachelor.com/ RS Gaborski
Image Database Problem • Assume you have taken pictures with your digital camera the last three years • You now have 4000 pictures stored on your computer’s hard drive • How do you sort them? RS Gaborski
Sample Images RS Gaborski
How do you find a particular object in an image? • Faces • Cars • Buildings • etc RS Gaborski
Image Models • Task: “Look for an object in an image” • Assume the task is to find rectangle and washer objects RS Gaborski
Image models, continued RS Gaborski
Image Models • Task: “Look for an object in an image” • Assume the task is to find rectangle and washer objects • Find outlines of objects in the image • Create a model of the object • Rectangle: Four straight lines, Opposite lines equal in length, 90 degree angles, lines connected • Washer: Two concentric circles RS Gaborski
Image models, edges RS Gaborski
Image models, continued One object partially overlaps another RS Gaborski
Objects are 3 Dimensional Rotating Disk Frame 1 Frame 2 Frame 3 RS Gaborski
License Plate Model • Rectangular (depending on viewpoint) • Aspect ratio 2:1 • Textures (characters on license plate) RS Gaborski
Face Model http://www.faceresearch.org/ RS Gaborski
Face Model http://www.faceresearch.org/ RS Gaborski
Face Model Features: eyes, nose, mouth, shape of face (oval) Spatial orientation of features Issues to investigate: how do we detect features? Normalize for different faces? Scale? Orientation? Cluttered background? RS Gaborski
Finding Cars in ImagesTraining RS Gaborski
Testing RS Gaborski
Deformable Objects in Video RS Gaborski
Simple Eye Model http://www.ap.stmarys.ca/demos/content/astronomy/eye_model/eye_model.html RS Gaborski
Pin Hole Camera Model y p0( x0, y0, z0 ) y0 SENSOR f z yi=? ( z0-f ) z0 pi( xi, yi, zi ) tan = yi / f tan = y0 / ( z0 – f ) therefore, yi / f = y0 / ( z0 – f ) => yi = ( f * y0 ) / ( z0 – f ) RS Gaborski
Loss of z InformationAll points of line p0-pi project to same point y p0( x0, y0, z0 ) y0 SENSOR f z yi=? ( z0-f ) z0 pi( xi, yi, zi ) tan = yi / f tan = y0 / ( z0 – f ) therefore, yi / f = y0 / ( z0 – f ) => yi = ( f * y0 ) / ( z0 – f ) RS Gaborski
Digital Images • Matrix of numbers • Each number represents a picture element – ‘pixel’ • Pixels are parameterized by • x – y position • intensity (color or monochrome) • time • MATLAB is designed for processing matrices (Matrix Laboratory) RS Gaborski
MATLAB • Any issues concerning using MATLAB on the CS department computers contact Sam Waters or Jim Craig in the CS System Admin office: System Administrators James "Linus" Craig; Username: jmc; 3599; 475-5254 Sam Waters; Username: srw; 3596; 475-4934 RS Gaborski
MATLAB Tutorial • Complete MATLAB tutorial (not SIMULINK): http://www.mathworks.com/academia/student_center/tutorials/ RS Gaborski