Business Statistics - QBM117

1. Business Statistics - QBM117 Interval estimation for the slope and y-intercept Hypothesis tests for regression

2. Objectives • To determine confidence interval estimators of the slope and the y intercept. • To test hypotheses about the slope of the regression line.

3. Estimating the slope and the y-intercept As we are aware from our study on confidence interval estimators previously, there are two types of estimators when estimating a population parameter: point estimators and interval estimators. The point estimators for the slope and the y - intercept can easily be determined from the Excel output generated when fitting the regression. The interval estimators can be just as easily determined from the Excel output generated.

5. Therefore the 95% confidence interval estimate of the slope is from 0.336 to 3.009 ie from $336 to $3009. Excel also generates a confidence interval estimate for the y-intercept. This will only be considered if the y-intercept has a sensible interpretation in the situation described. For our salary and experience example, the y- intercept does has a sensible interpretation ie it is the salary for a person with no experience. As such, we would also be interested in determining a confidence interval estimate of the intercept. Therefore the 95% confidence interval estimate of the intercept is from -1.933 to 32.569 ie from -$1933 to $32 569.

6. Testing whether the relationship is real or coincidence • We can easily summarise the relationship between two variables, whether it exists or not. • Hypothesis testing will tell us whether the relationship that appears to be there, is pure coincidence or, there is in fact a significant relationship between the two variables. • The null hypothesis states that there is no relationship betweenx and y. • Therefore the hypotheses for testing a significant relationship are

7. r = –0.471 r = 0.089 r = 0.395 Why Statistical Inference? • Because there can seem to be a relationship • when, in fact, the population is just random • Below are plots of the data from samples of size n = 10 • from a population with no relationship (correlation 0) • Notice that the sample correlations are not zero! • This is due to the randomness of sampling

8. For our example, we would be testing: is there a significant relationship between salary and experience? Step 1 Step 2 Step 3

9. Step 4 Step 5

10. Step 4 Step 5 Step 6 Since 3.48 > 2.776 we reject H0. There is sufficient evidence at  = 0.05 to conclude that there is a significant linear relationship between salary and experience.

11. Using the p-value to test: is there a significant relationship between salary and experience? Level of significance: Decision rule: There is sufficient evidence at  = 0.05 to conclude that there is a significant linear relationship between salary and experience.

12. An important point to remember about using the p-value to test a hypothesis is that the p-value can give us a good indication of how much evidence exists to support the alternative hypothesis. The smaller the p-value, the more overwhelming is the evidence to support the alternative hypothesis. In our example here, the p-value was only 0.025. This allows us to conclude that a linear relationship exists when testing at  = 0.05 and 0.1, but our conclusion would be different at  = 0.01

13. Testing for a significant correlation • In situations where we are interested in how the independent variable affects the dependent variable, we estimate and test hypotheses about the linear regression model. • In many situation however, one variable does not influence the other and therefore we are not interested in estimating how the independent variable affects the dependent variable. • We simply want to test whether there is a linear correlation between the two variables.

14. Testing for a significant correlation • For these situations the null hypothesis states that there is no linear correlation betweenx and y. • Therefore the hypotheses for testing a significant linear correlation are When we test for a significant correlation, you will find that the value of the test statistic and the conclusion are exactly the same as when we test for a significant relationship between two variables. This is because we are in fact testing the same thing. Are the two variables linearly related (correlated)? Therefore we perform one test or the other - not both!

15. For our previous example, we would be testing: is there a significant linear correlation between salary and experience? Step 1 Step 2 Step 3

16. Step 4 Step 5

17. Step 4 Step 5 Step 6 Since 3.48 > 2.776 we reject H0. There is sufficient evidence at  = 0.05 to conclude that there is a significant linear correlation between salary and experience.

18. Using the p-value to test: is there a significant correlation between salary and experience? Level of significance: Decision rule: There is sufficient evidence at  = 0.05 to conclude that there is a significant linear correlation between salary and experience.

19. Reading for next lecture Read Chapter 18 Sections 18.6 (Chapter 11 Sections 11.6 abridged) Exercises to be completed before next lecture S&S 18.27 18.29 (11.27 11.29 abridged)