1 / 14

Image Recognition Insights: Bayesian Classifiers & Classification Principles

Explore Bayesian classifiers for image recognition, learn how to set thresholds, use prior probabilities, and apply the Bayes rule for classification. Understand the significance of metadata and low-level features in indoor vs. outdoor classification. Delve into Bayesian networks and SVM for efficient classification processes.

deck
Download Presentation

Image Recognition Insights: Bayesian Classifiers & Classification Principles

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. CSSE463: Image Recognition Day 31 • Today: Bayesian classifiers • Tomorrow: Out-of-class project workday • Thursday: quiz • Friday: next milestone meeting • Questions?

  2. Bayesian classifiers • Use training data • Assume that you know probabilities of each feature. • If 2 classes: • Classes w1 and w2 • Say, circles vs. non-circles • A single feature, x • Both classes equally likely • Both types of errors equally bad • Where should we set the threshold between classes? Here? • Where in graph are 2 types of errors? p(x) P(x|w1) P(x|w2) Circles Non-circles x Detected as circles Q1-4

  3. What if we have prior information? • Bayesian probabilities say that if we only expect 10% of the objects to be circles, that should affect our classification Q5-8

  4. Bayesian classifier in general • Bayes rule: • Verify with example • For classifiers: • x = feature(s) • wi = class • P(w|x) = posterior probability • P(w) = prior • P(x) = unconditional probability • Find best class by maximum a posteriori (MAP) priniciple. Find class ithat maximizes P(wi|x). • Denominator doesn’t affect calculations • Example: • indoor/outdoor classification Fixed Learned from examples (histogram) Learned from training set (or leave out if unknown)

  5. Bayes rule is used in prediction of disease http://www.youtube.com/watch?v=D8VZqxcu0I0 Can you verify the approximation they found?

  6. Indoor vs. outdoor classification • I can use low-level image info (color, texture, etc) • But there’s another source of really helpful info!

  7. Camera Metadata Distributions Subject Distance Scene Brightness Flash Exposure Time Subject Distance

  8. Why we need Bayes Rule Problem: We know conditional probabilities like P(flash was on | indoor) We want to find conditional probabilities like P(indoor | flash was on, exp time = 0.017, sd=8 ft, SVM output) Let w = class of image, and x = all the evidence. More generally, we know P( x | w ) from the training set (why?) But we want P(w | x)

  9. Using Bayes Rule P(w|x) = P(x|w)P(w)/P(x) The denominator is constant for an image, so P(w|x) = aP(x|w)P(w) Q9

  10. Using Bayes Rule P(w|x) = P(x|w)P(w)/P(x) The denominator is constant for an image, so P(w|x) = aP(x|w)P(w) We have two types of features, from image metadata (M) and from low-level features, like color (L) Conditional independence means P(x|w) = P(M|w)P(L|w) P(w|X) = aP(M|w) P(L|w) P(w) Priors (initial bias) From histograms From SVM

  11. Bayesian network • Efficient way to encode conditional probability distributions and calculate marginals • Use for classification by having the classification node at the root • Examples • Indoor-outdoor classification • Automatic image orientation detection

  12. Indoor vs. outdoor classification Each edge in the graph has an associated matrix of conditional probabilities SVM SVM Color Features Texture Features KL Divergence EXIF header

  13. Effects of Image Capture Context Recall for a class C is fraction of C classified correctly

  14. Orientation detection • See IEEE TPAMI paper • Hardcopy or posted • Also uses single-feature Bayesian classifier (answer to #1-4) • Keys: • 4-class problem (North, South, East, West) • Priors really helped here! • You should be able to understand the two papers (both posted)

More Related