300 likes | 471 Views
Regression Analysis Part B Calculation Procedures. Read Chapters 3, 4 and 5 of Forecasting and Time Series, An Applied Approach. Regression Analysis Modules. Part A – Basic Model & Parameter Estimation Part B – Calculation Procedures
E N D
RegressionAnalysisPart BCalculation Procedures Read Chapters 3, 4 and 5 of Forecasting and Time Series, An Applied Approach.
Regression Analysis Modules Part A – Basic Model & Parameter Estimation Part B – Calculation Procedures Part C – Inference: Confidence Intervals & Hypothesis Testing Part D – Goodness of Fit Part E – Model Building Part F – Transformed Variables Part G – Standardized Variables Part H – Dummy Variables Part I – Eliminating Intercept Part J - Outliers Part K – Regression Example #1 Part L – Regression Example #2 Part N – Non-linear Regression Part P – Non-linear Example R
Alternative Calculation Procedures • Manual - use Excel and type in the formulas and intermediate steps. • Use the Data Analysis option of Excel. • Use SPSS statistical software program.
Excel, Data Analysis Calculations Univariate Case (continued)
SPSS Data Analysis Calculations Univariate Case SPSS: Analyze/Regression/Linear/
SPSS Data Analysis Calculations Univariate Case (continued)
Manual Calculations Multivariate Case (2 of 4) Shift + Control then Enter
Manual Calculations Multivariate Case (3 of 4) Shift + Control then Enter Shift + Control then Enter
Manual Calculations Multivariate Case (4 of 4) Shift + Control then Enter
Excel, Data Analysis Calculations Multivariate Case (continued)
SPSS Data Analysis Calculations Multivariate Case SPSS: Analyze/Regression/Linear/
SPSS Data Analysis Calculations Multivariate Case (continued)
Test for Multicollinearity by Correlation Analysis in Excel High correlation between dependent variable and the independent variables is desirable. High correlation between the independent variables is an undesirable. A potential multicollinearity condition. Excel: TOOLS / DATA ANALYSIS / Correlation
Test for Multicollinearity by Correlation Analysis in SPSS High correlation between dependent variable and the independent variables is desirable. High correlation between the independent variables is an undesirable, multicollinearity condition. SPSS: Analysis / Correlate / Bivariate
How large will a correlation be when there is a multicollinearity condition? Skip says: r > .98 may be a problem. Textbook says: r > .90 may be a problem.
Test for Multicollinearity by VIF in SPSS SPSS: Analysis / Regression / Linear • Potential multicollinearity: • If largest Rj2 > .9 • If largest VIFj > 10 • If Mean VIF >>> 1
Calculated VIF Values if only Excel is Available The R2 for each of the independent variables versus all of the remaining independent variables is needed to calculate the VIF’s. That is, “p” linear regression would need to be calculated. There is a useful trick that can be used to avoid doing the “p” regressions. The procedure is described in the next slides.
Calculated the R2(continued) These are the desired R2 ‘s
Calculated the R2(continued) CONCLUSION The VIFs are the diagonals of the C-Inverse matrix (see previous slide).
Verification of the R2 Calculations Individual regression fits.
Verification of the R2 Calculations (continued) From SPSS output.