1 / 30

Hypothesis Testing Under General Linear Model

Hypothesis Testing Under General Linear Model. Previously we derived the sampling property results assuming normality: Y = X b + e where e t ~N(0, s 2 ) → Y~N(X b , s 2 I T ) b s =(X ' X) -1 X ' Y, E( b s )= b Cov( b s )=  β = s 2 (X ' X) -1 b l ~N( b , s 2 (X ' X) -1 )

wan
Download Presentation

Hypothesis Testing Under General Linear Model

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Hypothesis Testing Under General Linear Model • Previously we derived the sampling property results assuming normality: • Y = Xb + e where et~N(0,s2) • → Y~N(Xb,s2IT) • bs=(X'X)-1X'Y, E(bs)=b • Cov(bs)= β=s2(X'X)-1 • bl~N(b, s2(X'X)-1) • σU2 unbiased estimate of σ2 • An estimate of Cov(βs) = βs=σU2(X'X)-1 el = y - Xβl

  2. Hypothesis Testing Under General Linear Model • Single Parameter (βk,L) Hypothesis Test • βk,l~N(βk,Var(βk)) Σβs=σu2(X'X)-1 kth diagonal element of βs unknown true coeff. • When σ2 is known: • When σ2 not known:

  3. Hypothesis Testing Under General Linear Model • Can obtain (1-) CI for βk: • There is a (1-α) probability that the true unknown value of β is within this range • Does this interval contain our hypothesized value? • If it does, than we can not reject H0

  4. Hypothesis Testing Under General Linear Model • Testing More Than One LinearCombination of Estimated Coefficients • Assume we have a-priori information about the value of β • We can represent this information via a set of J-Linear hypotheses (or restrictions): • In matrix notation

  5. Hypothesis Testing Under General Linear Model known coefficients

  6. Hypothesis Testing Under General Linear Model • Assume we have a model with 5 parameters to be estimated • Joint hypotheses: β1=8 and β2=β3 • J=2, K=5 β2-β3=0

  7. Hypothesis Testing Under General Linear Model • How do we obtain parameter estimates if J hypotheses are true? • Constrained (Restricted) Least Squares • bR is β that minimizes: S=(Y-Xβ)'(Y-Xβ) s.t. Rβ=r = e'e s.t. Rβ=r e.g. we act as if H0 are true • S*=(Y-Xβ)'(Y-Xβ)+λ'(r-Rβ) • λ is (J x1) Lagrangian multipliers associated with J-joint hypotheses • We want to choose β such that we minimize SSE but also satisfy the J constraints (hypotheses), βR

  8. Hypothesis Testing Under General Linear Model • Min. S*=(Y-Xβ)'(Y-Xβ) + λ'(r-Rβ) • What and how many FOC’s? • K+J FOC’s K-FOC’s J-FOC’s

  9. Hypothesis Testing Under General Linear Model S*=(Y-Xβ)'(Y-Xβ)+λ'(r-Rβ) • What are the FOC’s? CRM βS • Substitute these FOC into 2nd set ∂S*/∂λ = (r-RβR) = 0J →

  10. Hypothesis Testing Under General Linear Model • The 1st FOC • Substitute the expression for λ/2 into the 1st FOC:

  11. Hypothesis Testing Under General Linear Model • βR is the restricted LS estimator of β as well as the restricted ML estimator • Properties of Restricted Least Squares Estimator • →E(bR) b if Rb  r • V(bR) ≤ V(bS) →[V(bS) - V(bR)]is positive semi-definite • diag(V(bR)) ≤ diag(V(bS)) True but Unknown Value

  12. Hypothesis Testing Under General Linear Model • From above, if Y is multivariate normal and H0 is true • βl,R~N(β,σ2M*(X'X)-1M*') ~N(β,σ2M*(X'X)-1) • From previous results, if r-Rβ≠0 (e.g., not all H0 true), estimate of β is biased if we continue to assume r-Rβ=0 ≠0

  13. Hypothesis Testing Under General Linear Model • The variance is the same regardless of he correctness of the restrictions and the biasedness of βR • → βR has a variance that is smaller when compared to βs which only uses the sample information.

  14. Hypothesis Testing Under General Linear Model • Beer Consumption Example : • qB≡ quantity of beer purchased PB ≡ price of beer PL ≡ price of other alcoholic bev. PO≡ price of other goods INC ≡ household income • Real Prices Matter? • All prices and INC  by 10% • β1 + β2 + β3 + β4=0 • Equal Price Impacts? • Liquor and Other Goods • β2=β3 • Unitary Income Elasticity? • β4=1 • Data used in the analysis

  15. Hypothesis Testing Under General Linear Model • Given the above, what does the R-matrix and r vector look like for these joint tests? • Lets develop a test statistic to test these joint hypotheses • We are going to use the Likelihood Ratio (LR) to test the joint hypotheses

  16. Hypothesis Testing Under General Linear Model • LR=lU*/lR* • lU*=Max [l(|y1,…,yT); =(β, σ) ] = “unrestricted” maximum likelihood function • lR*=Max[l(|y1,…,yT); • =(β, σ); Rβ=r] = “restricted” maximum likelihood function • Again, because we are possibly restricting the parameter space via our null hypotheses, LR≥1

  17. Hypothesis Testing Under General Linear Model • If lU* is large relative to lR*→data shows evidence that the restrictions (hypotheses) are not true (e.g., reject null hypothesis) • How much should LR exceed 1 before we reject H0? • We reject H0 when LR ≥ LRC where LRC is a constant chosen on the basis of the relative cost of the Type I vs. Type II errors • When implementing the LR Test you need to know the PDF of the dependent variable which determines the density of the test statistic

  18. Hypothesis Testing Under General Linear Model • For LR test, assume Y has a normal distribution • →e~N(0,σIT) • This implies the following LR test statistic (LR*) • What are the distributional characteristics of LR*? • Will address this in a bit

  19. Hypothesis Testing Under General Linear Model • We can derive alternative specifications of LR test statistic • LR*=(SSER-SSEU)/(Js2U) (ver. 1) • LR*=[(Rbe-r)′[R(X′X)-1R′]-1(Rbe-r)]/(Js2U)(ver. 2) • LR*=[(bR-be)′(X′X)(bR-be)]/(Js2U) (ver. 3) βe =βS=βl • What are the Distributional Characteristics of LR* (JHGLL p. 255) • LR* ~ FJ,T-K • J = # of Hypotheses • K= # of Parameters • (including intercept)

  20. Hypothesis Testing Under General Linear Model • Proposed Test Procedure • Choose a = P(reject H0| H0 true) = P(Type-I error) • Calculate the test statistic LR* based on sample information • Find the critical value LRcrit in an F-table such that: a = P(F(J, T – K)³ LRcrit), where α = P(reject H0| H0 true) f(LR*) α = P(FJ,T-K ≥ LRcrit) LRcrit α

  21. Hypothesis Testing Under General Linear Model • Proposed Test Procedure • Choose a = P(reject H0| H0 true) = P(Type-I error) • Calculate the test statistic LR* based on sample information • Find the critical value LRcrit in an F-table such that: a = P(F(J, T – K)³ LRcrit), where α = P(reject H0| H0 true) • Reject H0 if LR* ³ LRcrit • Don’t reject H0 if LR* < LRcrit

  22. Hypothesis Testing Under General Linear Model • Beer Consumption Example • Does the regression do a better job in explaining variation in beer consumption than if assumed the mean response across all obs.? • Remember SSE=(T-K)σ2U • Under H0: All slope coefficients=0 • Under H0, TSS=SSE given that that there is no RSS and TSS=RSS+SSE

  23. Hypothesis Testing Under General Linear Model SSE = 0.059972 *25 = 0.08992 R2=1- 0.08992/0.51497 TSS=SSER Mean of LN(Beer)

  24. Hypothesis Testing Under General Linear Model • Results of our test of overall significance of regression model • Lets look at the following GAUSS Code • GAUSS command: • CDFFC(29.544,4,25)=3.799e-009 • CDFFC Computes the complement of the cdf of the F distribution (1-Fdf1,df2) • Unlikely value of F if hypothesis is true, that is no impact of exogenous variables on beer consumption • Reject the null hypothesis • An alternative look

  25. Hypothesis Testing Under General Linear Model • Beer Consumption Example • Three joint hypotheses example • Sum of Price and Income Elasticities Sum to 0 (e.g., β1 + β2 + β3 + β4=0) • Other Liquor and Other Goods Price Elasticities are Equal (e.g., β2=β3) • Income Elasticity = 1 (e.g., β4=1) • cdffc(0.84,3,25)=0.4848

  26. Hypothesis Testing Under General Linear Model • Location of our calculated test statistic PDF F3,25 F 0.84 area = 0.4848

  27. Hypothesis Testing Under General Linear Model • A side note: How do you estimate the variance of an elasticity and therefore test H0 about this elasticity? • Suppose you have the following model: FDXt = β0 + β1Inct + β2 Inc2t + et • FDX= food expenditure • Inc=household income • Want to estimate the impacts of a change in income on expenditures. Use an elasticity measure evaluated at mean of the data. That is:

  28. Hypothesis Testing Under General Linear Model FDXt = β0 + β1Inct + β2 Inc2t + et • Income Elasticity (Γ) is: • How do you calculate the variance of Γ? • We know that: Var(α′Z)= α′Var(Z)α • Z is a column vector of RV’s • α a column vector of constants • Treat β0, β1 and β2 are RV’s. The α vector is: Linear combination of Z

  29. Hypothesis Testing Under General Linear Model • This implies var(Γ) is: (1 x 3) σ2(X'X)-1 (3 x 3) (3 x 1) Due to 0 α value (1 x 1)

  30. Hypothesis Testing Under General Linear Model C22 • This implies: var(Γ) is: C12 2C1C2

More Related