40 likes | 226 Views
Likelihood. probability of observing the data given a model with certain parameters Maximum Likelihood Estimation (MLE) find the parameter combination that maximizes the likelihood requires some basic knowledge of probability. A Poisson Example. Pr(Observation= x ) = e - l l x / x !
E N D
Likelihood • probability of observing the data given a model with certain parameters • Maximum Likelihood Estimation (MLE) • find the parameter combination that maximizes the likelihood • requires some basic knowledge of probability
A Poisson Example • Pr(Observation=x) = e-llx / x! • l is the parameter of the model • if Observation=4, • likelihood = e-ll4 / 4! = e-ll4 / 24
Multiple Observations • if two independent observations (4 & 2) • likelihood = Pr(Obs1=4) x Pr(Obs2=2) • to find the maximum • construct the likelihood equations • take the derivative(s) • solve for derivatives equal to zero
log-likelihood and deviance • log-likelihood (lnL) is more tractable • L = Pr1 x Pr2 x Pr3 x ... • lnL = lnPr1 + lnPr2 + lnPr3 + ... • deviance = -2*lnL