1 / 17

AAEC 4302 ADVANCED STATISTICAL METHODS IN AGRICULTURAL RESEARCH

AAEC 4302 ADVANCED STATISTICAL METHODS IN AGRICULTURAL RESEARCH. Chapter 13.3 Multicollinearity. Multicollinearity.

macy-wolfe
Download Presentation

AAEC 4302 ADVANCED STATISTICAL METHODS IN AGRICULTURAL RESEARCH

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. AAEC 4302ADVANCED STATISTICAL METHODS IN AGRICULTURAL RESEARCH Chapter 13.3 Multicollinearity

  2. Multicollinearity • When two or more independent variables in a regression model are highly correlated to each other, it is difficult to determine if each of these variables, individually, has an effect on Y, and to quantify the magnitude of that effect • Intuitively, for example, if all farms in a sample that use a lot of fertilizer also apply large amounts of pesticides (and vice versa), it would be hard to tell if the observed increase in yield is due to higher fertilizer or to higher pesticide use

  3. Multicollinearity • In economics, when interest and inflation rates are used as independent variables, it is often hard to quantify their individual effects on the dependent variable because they are highly correlated to each other • Mathematically, this occurs because, everything else being constant, the standard error associated to a given OLS parameter estimate will be higher if the corresponding independent variable is more highly correlated to the other independent variables in the model

  4. Multicollinearity • This potential problem is known as multicollinearity • It could be the reason why independent variables that are believed to be key in determining the value of a given dependent variable do not result statistically significant when conducting the basic significance test

  5. Multicollinearity • It is not a mistake in the model specification, but due to the nature of the data at hand • It is more common in time-series data models because time often affects the values taken by many of the independent variables in these type of models causing them to be highly correlated to each other

  6. Perfect Multicollinearity • Perfect multicollinearity occurs when there is a perfect linear correlation between two or more independent variables, i.e. when an independent variable is actually a linear function of one or more of the others

  7. Perfect Multicollinearity • When including total annual rainfall as well as rainfall during each of the seasons as independent variables in an (annual) time series model; • When independent variable takes a constant value in all observations

  8. Perfect Multicollinearity • If there is perfect multicollinearity, the OLS method can not produce parameter estimates • All cases of perfect multicollinearity are the result of making a mistake when specifying the model and can be easily corrected by properly specifying the models

  9. Severe Multicollinearity • A certain degree of correlation (multicollinearity) between the independent variables is normal and expected in most cases • Multicollinearity is considered severe and becomes a problem when this correlation is high and interferes with the estimation of the model’s parameters at the desired level of statistical certainty

  10. Symptoms of Multicollinearity • The following, when taken together, are considered symptoms of a multicollinearity problem • independent variable(s) considered critical in explaining the model’s dependent variable are not statistically significant according to the tests

  11. Symptoms of Multicollinearity • High R2, highly significant F-test, but few or no statistically significant t tests • Parameter estimates drastically change values and become statistically significant when excluding some independent variables from the regression

  12. Detecting Multicollinearity • A simple test for multicollinearity is to conduct “artificial” regressions between each independent variable (as the “dependent” variable) and the remaining independent variables • Variance Inflation Factors (VIFj) are calculated as: • where Rj2 is the R2 of the artificial regression with the jth independent variable as a “dependent” variable

  13. Detecting Multicollinearity • VIFj = 2, for example, means that variance is twice what it would be if Xj, was not affected by multicollinearity • A VIFj>10 is clear evidence that the estimation of Bj is being affected by multicollinearity

  14. Addressing Multicollinearity • Although it is useful to be aware of the presence of multicollinearity, it is not easy to remedy severe (non-perfect) multicollinearity • If possible, adding observations or taking a new sample might help lessen multicollinearity

  15. Addressing Multicollinearity • Exclude the independent variables that appear to be causing the problem • Even if this is not the case, recall that omitting relevant independent variables from the model will make the OLS estimators biased

  16. Addressing Multicollinearity • Modifying the model specification sometimes help, for example: • using real instead of nominal economic data • using a reciprocal instead of a polynomial specification on a given independent variable

  17. Addressing Multicollinearity • Remember that there is usually certain degree of multicollinearity in any model, and one should not worry about it as long as the statistical inferences are not disappointing

More Related