30 likes | 164 Views
Violation of NB Assumptions. Positional I ndependence Conditional I ndependence. Examples?. Posterior Probabilities in NB. Classification results of N aïve Bayes (the class with maximum posterior probability) are usually fairly accurate.
E N D
Violation of NB Assumptions Positional Independence Conditional Independence Examples?
Posterior Probabilities in NB Classification results of Naïve Bayes (the class with maximum posterior probability) are usually fairly accurate. However, due to the inadequacy of the conditional independence assumption, the actual posterior-probability numerical estimates are not. Output probabilities are commonly very close to 0 or 1. Correct estimation accurate prediction, but correct probability estimation is NOTnecessary for accurate prediction (just need right ordering of probabilities)
Example: Sensors NB FACTORS: P(r) = 1/2 P(s) = 1/2 P(+|s) = 1/4 P(+|r) = 3/4 Reality Raining Sunny P(+,+,r) = 3/8 P(-,-,r) = 1/8 P(+,+,s) = 1/8 P(-,-,s) = 3/8 NB Model PREDICTIONS: • P(r,+,+) = (½)(¾)(¾) • P(s,+,+) = (½)(¼)(¼) • P(r|+,+) = 9/10 • P(s|+,+) = 1/10 Raining? M1 M2