1 / 14

Lesson 14 - 1

Lesson 14 - 1. Testing the Significance of the Least Squares Regression Model. Objectives. Understand the requirements of the least-squares regression model Compute the standard error of the estimate Verify that the residuals are normally distributed

brosh
Download Presentation

Lesson 14 - 1

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Lesson 14 - 1 Testing the Significance of the Least Squares Regression Model

  2. Objectives • Understand the requirements of the least-squares regression model • Compute the standard error of the estimate • Verify that the residuals are normally distributed • Conduct inference on the slope and intercept • Construct a confidence interval about the slope of the least-squares regression model

  3. Vocabulary • Bivariate normal distribution– one variable is normally distributed given any value of the other variable and the second variable is normally distributed given any value of the first variable • Jointly normally distributed– same as bivariate normal distribution

  4. Least-Squares Regression Model yi = β0 + β1xi + εi where yi is the value of the response variable for the ith individual β0 and β1 are the parameters to be estimated based on the sample data xi is the value of the explanitory variable for the ith individual εi is a random error term with mean 0 and variance σ²εi = σ²The error terms are independent and normally distributed I = 1, … , n where n is the sample size (number of ordered pairs in the data set)

  5. Requirements for Inferences • The mean of the responses depends linearly on the explanatory variable • Verify linearity with a scatter plot (as in Chapter 4) • The response variables are normally distributed with the same standard deviation • We plot the residuals against the values of the explanatory variable • If the residuals are spread evenly about a horizontal line drawn at 0, then the requirement of constant variance is satisfied • If the residuals increasingly spread outward (or decreasingly contract inward) about that line at 0, then the requirement of constant variance may not be satisfied

  6. Hypothesis Tests • Only after requirements are checked can we proceed with inferences on the slope, β1, and the intercept, β0 • Tests: Note: these procedures are considered robust (in fact for large samples (n > 30), inferential procedures regarding b1 can be used with significant departures for normality)

  7. (b1 – βi) b1 t0= --------------- = ------ se sb1 -------------- (xi – x)2 Σ Test Statistic Note: degrees of freedom = n – 2 H0: β1 = 0 tα/2 for two-tailed (≠0) tα for one-tailed (>0 or <0)

  8. Σ Σ (yi – yi)2 residuals2 se= --------------- = ---------------- n – 2 n – 2 Standard Error of the Estimate Note: by divide by n – 2 because we have estimated two parameters, β0 and β1

  9. Conclusions from Test Rejecting the null hypothesis means that for • The two-tailed alternative hypothesis, H1: β1 ≠ 0 • The slope is significantly different from 0 • There is a significant linear relationship between the variables x and y • The left-tailed alternative hypothesis, H1: β1 < 0 • The slope is significantly less than 0 • There is a significant negative linear relationship between the variables x and y • The right-tailed alternative hypothesis, H1: β1 > 0 • The slope is significantly greater than 0 • There is a significant positive linear relationship between the variables x and y

  10. Hypothesis Testing on β1 Steps for Testing a Claim Regarding the Population Mean with σ Known 0. Test Feasible (requirements) • Determine null and alternative hypothesis (and type of test: two tailed, or left or right tailed) • Select a level of significance α based on seriousness of making a Type I error • Calculate the test statistic • Determine the p-value or critical value using level of significance (hence the critical or reject regions) • Compare the critical value with the test statistic (also known as the decision rule) • State the conclusion

  11. Example

  12. se Upper bound = b1+ tα/2--------------- = b1 + tα/2· sb1 (xi – x)2 Σ Confidence Intervals for β1 Confidence intervals are of the form Point estimate ± margin of error se Lower bound = b1– tα/2--------------- = b1 - tα/2· sb1 (xi – x)2 Σ • note: tα/2degrees of freedom = n – 2 • pre-conditions: • data randomly obtained • residuals normally distributed • constant error variance

  13. Using TI • Enter explanatory variable in L1 and the response variable in L2 • Press STAT, highlight TESTS and select E:LinRegTTest • Be sure Xlist is L1 and Ylist is L2. Make sure that Freq is set to 1. Set the direction of the alternative hypothesis. Highlight calculate and ENTER.

  14. Summary and Homework • Summary • Confidence intervals and prediction intervals quantify the accuracy of predicted values from least-squares regression lines • Confidence intervals for a mean response measure the accuracy of the mean response of all the individuals in a population • Prediction intervals for an individual response measure the accuracy of a single individual’s predicted value • Homework • pg 748 - 752; 1, 2, 3, 4, 7, 12, 13, 18

More Related