610 likes | 804 Views
Introduction to Computer Vision Location 70-3455. Lecture 1 Dr. Roger S. Gaborski. Where to Find Me. Office: 70 – 3647 Office Hours: Tuesday, 2:00-3:00pm (except December 8 th ) Thursday, 11:00-noon My lab 70-3400 Email: rsg@cs.rit.edu. Co-Instructor. Yuheng ‘Helen’ Wang.
E N D
Introduction to Computer Vision Location 70-3455 Lecture 1 Dr. Roger S. Gaborski
Where to Find Me • Office: 70 – 3647 • Office Hours: • Tuesday, 2:00-3:00pm (except December 8th) • Thursday, 11:00-noon • My lab 70-3400 • Email: rsg@cs.rit.edu RS Gaborski
Co-Instructor • Yuheng ‘Helen’ Wang RS Gaborski
Teaching Assistant • Santosh Kandregula • E-Mail: <sxk9011@rit.edu> RS Gaborski
Course Outline • Textbook – Digital Image Processing using MATLAB • SECOND EDITION 2009 Gatesmark Publishing • Online MATLAB tutorial-Register at Mathworks: • http://www.mathworks.com/academia/student_center/tutorials/launchpad.html • Topics • Homework • Quizzes and Exams • Projects (4005-757 only) • Grading • Webpage: www.cs.rit.edu/~rsg (includes course calendar on CV page) • Lecture slides will not always be posted on webpage RS Gaborski
Homework • Questions concerning Homework • Do not wait until the night before its due to start working on the HW • Ask questions in class concerning HW • First, ask the TA during his office hours • If TA cannot answer your questions, see me during my office hours • Do not send me email concerning the HW after noon the night before it is due. I will not be able to respond to your email. RS Gaborski
Grading • Homework 30%(457) 20%(757) • Quizzes/Exams 70% 70% • Project* --- 10% • No Project for 4003-457 • *Project: 757 Individual only, weekly presentation updates RS Gaborski
Course Grade • 90%-100% A* • 80%-89% B • 70%-79% C • 60%-69% D • <60% F * Note: For example, 89.4 is a ‘B’, 89.5 is rounded to 90 which is an ‘A’ RS Gaborski
Project • Choose from a list of projects provided on course Project Page • Ten minute verbal proposal presentation (see course calendar) • Verbal updates (see course calendar) • *Project grade includes verbal proposal, verbal update report and final report RS Gaborski
Computer Vision • Low-level Processes • Primitive operations • Reduce noise • Enhance contrast • Sharpen image • Mid-level Processes • Input are images, output are attributes extracted from image (edges, contours and identity of objects • Segmentation (partition image into objects or regions) • Description of objects/regions RS Gaborski
Computer Vision • High-level Processes • Understanding content of images RS Gaborski
SUMMARY:Goals of Computer Vision • Image Enhancement • Reduce noise in an image thereby revealing features in the image, extract features • Image Processing Operations • Segment the image into objects • Label individual objects • Image Understanding • Understand the ‘content’ of an image or sequence of images (video) • Extract meaning of the image RS Gaborski
Computer Vision – Interpretation of Images • Digital photographs • Medical radiographic images • Functional magnetic resonance imaging (fMRI) • Medical ultrasound • Industrial radiographic images • Digital video images • Satellite images • Astronomy RS Gaborski
Digital Image RS Gaborski
Digital Image RS Gaborski
Digital Image RS Gaborski
Medical Related Images Information obtained from images: Bone structure Soft Tissue Brain Activity
Medical Radiographic Image www.4umi.com/image/x-ray.jpg RS Gaborski
Medical Ultrasound http://keystone.stanford.edu/~huster/photos/i/ultrasound.640.jpg RS Gaborski
Functional MRI A 20-year old female drinker A 20-year old female nondrinker Response to the spatial working memory task. Brain activation is shown in bright colors. RS Gaborski www.alcoholism2.com/
Industrial Applications Non Destructive Testing Inspection / Security
Industrial Radiographic Image www.vidisco.com/ CabinetXrayMic80A_01.htm RS Gaborski
Industrial Radiographic Image Pseudo- color www.vidisco.com/ CabinetXrayMic80A_01.htm RS Gaborski
Satellite Images RS Gaborski www.noaa.gov
Astronomy Images www.sdsc.edu/ sciencegroup/astronomy/ RS Gaborski
Astronomy Images astro.martianbachelor.com/ RS Gaborski
Image Database Problem • Assume you have taken pictures with your digital camera the last three years • You now have 4000 pictures stored on your computer’s hard drive • How do you sort them? RS Gaborski
Sample Images C:\Documents and Settings\rsg\My Documents\My Pictures\Picture RS Gaborski
iPhoto 09 "Places" Geotagging • http://www.youtube.com/watch?v=GVW8700LrvE RS Gaborski
How do you find a particular face • How do you find a particular object in an image? • Faces • Cars • Buildings • etc RS Gaborski
Image Models • Task: “Look for an object in an image” • Assume the task is to find rectangle and washer objects RS Gaborski
Image models, continued RS Gaborski
Image Models • Task: “Look for an object in an image” • Assume the task is to find rectangle and washer objects • Find outlines of objects in the image • Create a model of the object • Rectangle: Four straight lines, Opposite lines equal in length, 90 degree angles, lines connected • Washer: Two concentric circles RS Gaborski
Image models, edges RS Gaborski
Image models, continued One object partially overlaps another RS Gaborski
Objects are 3 Dimensional Rotating Disk Frame 1 Frame 2 Frame 3 RS Gaborski
License Plate Model • Rectangular (depending on viewpoint) • Aspect ratio 2:1 • Textures (characters on license plate) RS Gaborski
Face Model http://www.faceresearch.org/ RS Gaborski
Face Model http://www.faceresearch.org/ RS Gaborski
Face Model Features: eyes, nose, mouth, shape of face (oval) Spatial orientation of features Issues to investigate: how do we detect features? Normalize for different faces? Scale? Orientation? Cluttered background? RS Gaborski
iPhoto 09 "Faces" Face Recognition, http://www.youtube.com/watch?v=NzCV_L87J2I • Digital Face Recognition, http://www.youtube.com/watch?v=obyPvoSTo-o&feature=related RS Gaborski
Deformable Objects in Video RS Gaborski
Finding Cars in ImagesTraining RS Gaborski
Testing RS Gaborski
What’s Missing? • perceptual organization • similarity between semantic concepts “The semantic gap” RS Gaborski
Examples of “semantic” similarity From: http://web.cecs.pdx.edu/~mm/ RS Gaborski
From: http://web.cecs.pdx.edu/~mm/ RS Gaborski