1 / 94

The Odyssey of: Shape Matching with Ordered Boundary Point Shape Contexts Using a Least Cost Diagonal Method

The Odyssey of: Shape Matching with Ordered Boundary Point Shape Contexts Using a Least Cost Diagonal Method. By Dr. Carl E Abrams Jan 26th, 2008. Odyssey: a long wandering and eventful journey Or If we knew what we were doing, it wouldn't be called research, would it? – A Einstein.

dympna
Download Presentation

The Odyssey of: Shape Matching with Ordered Boundary Point Shape Contexts Using a Least Cost Diagonal Method

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. The Odyssey of:Shape Matching with Ordered Boundary Point Shape Contexts Using a Least Cost Diagonal Method By Dr. Carl E Abrams Jan 26th, 2008

  2. Odyssey: a long wandering and eventful journey Or If we knew what we were doing, it wouldn't be called research, would it? – A Einstein

  3. Agenda • Topic Selection • The Eventful Journey • Elation • Mild Desperation • Elation • Beyond Desperation • Relief (Success) • Discussion / Lessons Learned

  4. Topic Selection or… • First Idea: Requirements Engineering and Business Process Modeling • I despised the topic area

  5. Topic Selection or…Roots • Identification of Automotive Vehicles Using Semantic Feature Extraction (Dec 2004) Elation!

  6. Dissertation TimelineCarl E. Abrams Draft Chap 4&5 Now! Defense Draft Chap 3&4 9/03 1/04 1/05 1/06 Draft Idea Paper Complete Draft Proposal Advisor Selection Final Manuscript and Paper Complete Dissertation Proposal First Paper at Pace Day Committee Formation Final Draft Chap 1-3 Draft Chap 1&2

  7. The Eventful Journey

  8. Semantic Geometric Features: A Preliminary Investigation of Automobile Identification Carl E. Abrams Sung-Hyuk Cha, Michael Gargano, and Charles Tappert

  9. Agenda • Overview of the Problem • The Experiments • Results • Going Forward

  10. Overview • Object recognition remains a hard problem • The human mind uses shapes to recognize objects • Can semantic features defined by their shapes be more effective in the recognition and identification of objects?

  11. The Experiments • 10 test images of cars • Directly form the manufactures websites • Images were restricted to side views of the cars taken from 90 degrees • All 2005 models • Feature vectors calculated/measured from the images

  12. The Vehicles

  13. Experiments used Euclidean Distance as the Measure the xi and ti are measurements from two different vehicles

  14. c b a Experiments used Euclidean Distance as the Measure (x2,y2) c = (a2+b2)1/2 (x1,y1) c = ((x1-x2)2+(y1-y2)2)1/2

  15. Manufacturers SpecificationsFirst Experiment

  16. Boundary Description using RaysSecond Experiment

  17. Semantic FeaturesThird Experiment

  18. Challenge: Determine the qualitative ability of the feature vectors to separate the vehicles • Within each experiment compute the distance of each vehicle from all the others • Evenly divide the measures into 5 bins • Observe the distribution of the measures

  19. The Results

  20. Distance Matrix – Semantic Features Honda Civic Honda Accord Mazda 3 Mazda 6 Porsche Carerra Toyota Camry Toyota Celica Toyota Corolla Toyota Echo VW Passat Honda Civic Honda Accord Mazda 3 Mazda 6 Porsche Carerra Toyota Camry Toyota Celica Toyota Corolla Toyota Echo VW Passat

  21. End of First Dead End Mild Desperation

  22. Dissertation TimelineCarl E. Abrams Mild Desperation sets in Draft Chap 4&5 Now! Defense Draft Chap 3&4 9/03 1/04 1/05 1/06 Draft Idea Paper Complete Draft Proposal Advisor Selection Final Manuscript and Paper Complete Dissertation Proposal First Paper at Pace Day Committee Formation Final Draft Chap 1-3 Draft Chap 1&2

  23. Shape Contexts • Shape Contexts are a novel shape descriptor introduced be Belongie[1] • Describes a shape by quantifying each point on the boundary of a shape by its relationship to all the on the boundary points on the shape • Compares shapes by comparing shape contexts [1] S. Belongie, "Image segmentation and shape matching for object recognition," vol. PhD, 2000, pp. 60.

  24. Shape Contexts-Constructing

  25. Shape Contexts-Constructing

  26. Shape Contexts-Comparing Known CHI^2 Test where K= # of bins, g is unknown histogram and h is the known histogram Known Unknown Known

  27. Shape Contexts-Properties: Translation

  28. Shape Contexts-Properties: Scale

  29. Shape Contexts-Properties: Rotation

  30. Progress ReportThe Role of Semantic Featuresin Automobile Identificationas of December 10th , 2005Carl E. Abrams

  31. Agenda • Review of Topic and Approach (Elevator Pitch) • Summary Results to Date • Next Steps

  32. Review of Topic and Approach • Develop an image segmentation and feature extraction / classification scheme for automobiles that employs the shapes of “semantic” parts and their geometric relationships. • Semantic features are the shapes of : windows, doors, front and rear quarter panels.

  33. Review of Topic and Approach • Approach: • Develop a test database of vehicles by collecting side images • Develop/beg borrow or steal/software to interactively extract the shape and geometric information from the images • Work through all the classification test database • In parallel continue building the master database • Develop, test and compare segmentation / extraction method for semantic shapes

  34. Preliminary Results-Test DBAs of Oct 15: All Ford models back to 1990 ~ 50 images As of Nov 12: Acura, Audi, Chrylser, Dodge, Ford, Honda, Mercury, Nissan, Pontiac, Saab, Saturn, Toyota, Volvo, VW models back to 1990 ~125 images

  35. Preliminary Results-Image Segmentation Software • Modified CTMRedit: a matlab GUI for viewing, segmenting, and interpolating CT and MRI Images • Written by Mark Hasegawa-Johnson and Jul Cha • Simplified GUI and added capability to store shapes specific to vehicle identification

  36. Preliminary Results-Image Segmentation Software Examples

  37. Preliminary Results • Create a feature vector that allows the comparison of one shape to another: Vector_Known(ws1,ws2,ws3,ws4,ds1,ds2,body shape) Vector_Unknown(ws1,ws2,ws3,ws4,ds1,ds2,body shape) Feature vector depends on shape descriptor in this case “Shape Contexts”

  38. Preliminary Results – Shape Contexts • How to effectively describe a shape? r o

  39. o Preliminary Results – Shape Contexts • How to effectively describe a shape? r r (5 bins) O (12 Bins)

  40. Preliminary Results – Shape Contexts • How to effectively describe a shape? Develop the Shape Context histograms for every point on the shape

  41. Preliminary Results – Distance Between Shape Contexts • How to effectively describe a shape? Known CHI^2 Test where K= # of bins, g is unknown histogram and h is the known histogram Each shape has 128 points, creates a 128x128 cost matrix Known Unknown Known

  42. Preliminary Results – Distance Between Shape Contexts • What is the best fit (minimum cost) to align all the points? • The Assignment Problem – Hungarian Method for bi-partite matching problem We will be working with the following problem: assign n = 9 candidates to n=9 jobs to minimize the total salary cost paid by the department. The individual salaries of each candidate at each job position depend on their qualification and are given by the cost matrix (in $ per hour): If we start with the position of Administrator and assign it to Alex (he gets the minimal salary for this position), then we assign the position of Secretary to Chair to Lois (he gets the minimal salary for this position), and so on, up to the position of Typist, then the assignment is given by the assignment matrix:

  43. Preliminary Results • Experimental Setup – Run 5 test cars against known database of 50 cars • Test cars re-segmented form known database • Plot out matches based on Euclidean Distance • Repeat by adding more cars of a different manufacturer to known DB

  44. Preliminary Results Unknown: 2003FordMustang2DGT

  45. Preliminary Results Unknown: 2003FordMustang2DGT-Volvos Added to Known DB

  46. Preliminary Results Unknown: 2004FordFocus4DZX5.dh1

  47. Preliminary Results Unknown: 2004FordFocus4DZX5.dh1-Volvos Added to Known DB

  48. Preliminary Results Unknown: 2004FordTaurus4DSES.dh1

  49. Preliminary Results Unknown: 2004FordTaurus4DSES.dh1-Volvos Added to Known DB

  50. Preliminary Results Unknown: 2005FordMustangCoupe2DV6Deluxe.dh1

More Related