1 / 38

Math 3680 Lecture #19 Correlation and Regression

Math 3680 Lecture #19 Correlation and Regression. The Correlation Coefficient: Limitations. Moral : Correlation coefficients only measure linear association. Moral : Correlation coefficients are most appropriate for football-shaped scatter diagrams and can be very sensitive to outliers.

ion
Download Presentation

Math 3680 Lecture #19 Correlation and Regression

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Math 3680 Lecture #19 Correlation and Regression

  2. The Correlation Coefficient: Limitations

  3. Moral: Correlation coefficients only measure linear association.

  4. Moral: Correlation coefficients are most appropriate for football-shaped scatter diagrams and can be very sensitive to outliers.

  5. Regression

  6. The heights and weights from a survey of 988 men are shown in the scatter diagram. Avg height = 70 in SD height = 3 in Avg weight = 162 lb SD weight = 30 lb r = 0.47

  7. Example. Suppose a man is one SD above average in height (70 + 3 = 73 inches). Should you guess his weight to be one SD above average (162 + 30 = 192 pounds)?

  8. (73, 192) Solution: No. Notice that maybe 10 or 11 of the men 73 inches tall have weights above 192 pounds, while dozens have weights below 192 pounds.

  9. A better prediction is obtained by increasing by not a full SD but by r SDs: Prediction = Average + ( r )(# SDs)(SD) = 162 + (0.47) (1) (30) = 176.1 lb This is our second interpretation of the correlation coefficient.

  10. (73, 176.1) Prediction =162+(1) (0.47) (30) =176.1 lb

  11. (73, 176.1) (70, 162) (0.47)(30) lbs 3 inches Slope =

  12. Example:Predict the height of a man who is 176.1 pounds. Does this contradict our previous example?

  13. Example:Predict the weight of a man who is 5’6”. Where does this prediction appear in the diagram?

  14. sy Notice that these points are displayed on the solid line in the diagram. This line is called the regression line. To obtain this line, you start at the point of averages, and draw a line with slope In other words, the equation of the regression line is Reverse the roles of x and y when predicting in the other direction. × r sx

  15. Example:Find the equation of the regression line for the height-weight diagram.

  16. Example: A university has made a statistical analysis of the relationship between SAT-M scores and first-year GPA. The results are: Average SAT score = 550 SD = 80 = 0 4 r . Average first-year GPA = 2.6 SD = 0.6 The scatter diagram is football shaped. Find the equation of the regression line. Then predict the first-year GPA of a randomly chosen student with an SAT-M score of 650.

  17. Both Excel and TI calculators are capable of computing and visualizing regression lines. (See book p. 426). In Excel 2007, highlight the x- and y-values and use Insert, Scatter, to draw a scatter plot. Click the data points, and then right-click Add Trendline to see the regression line.

  18. The Regression Effect

  19. Average fathers’ height = 68 in SD = 2.7 in Average sons’ height = 69 in SD = 2.7 inches 0.5 For a study of 1,078 fathers and sons: @ r Suppose a father is 72 inches tall. How tall would you predict his son to be? Repeat for a father who is 64 inches tall.

  20. Notice that tall fathers tend to have tall sons – though sons who are not as tall. Likewise, short fathers on average will have short sons – just not as short. Hence the term, “regression.” A pioneering but aristocratic statistician (Galton) called this effect, the “regression toward mediocrity,” and the term has stuck. There is no biological cause to this effect – it is strictly statistical.Thinking that the regression effect is due to something important is called the regression fallacy.

  21. Example:A preschool program attempts to boost students’ IQs. The children are tested when they enter the program (pretest), and again when they leave the program (post-test). On both occasions, the average IQ score was 100, with an SD of 15. Also, students with below-average IQs on the pretest had scores that went up by 5 points, while students with above average scores of the pretest had their scores drop by an average of 5 points. What is going on? Does the program equalize intelligence?

  22. Example. Suppose someone gets a score of 140 on the pretest. Does this mean that the student has an IQ of exactly 140?

  23. Solution: No. There will always be chance error associated with the measurement. For the sake of argument, let’s assume that the chance error is equal to 5 points. Then there are two likely explanations, they are:          Actual IQ of 135, with a chance error of +5          Actual IQ of 145, with a chance error of -5 Which of the above is the most likely explanation?

  24. This explains the regression effect. If someone scores above average on the first test, we would estimate that the true score is probably a bit lower than the observed score.

  25. Example:An instructor gives a midterm. She asks the students who score 20 points below average to see her regularly during her office hours for special tutoring. They all scored at least average on the final. Can this improvement be attributed to the regression effect?

  26. Regression and Error Estimation

  27. n = 988 Avg height = 70 in SD height = 3 in Avg weight = 162 lb SD weight = 30 lb r = 0.47 For a man 73 in tall, we predict weight of 162+(1) (0.47) (30) =176.1 lb Next question: what is the error for this estimate? Based on the picture, is it 30 lb? Or less?

  28. THEOREM. Assuming the data is normally distributed, we have For the current example, that means The weight is therefore estimated as 176.1 ± 26.5 lb.

  29. Note. If n is large, the last factor in may be safely ignored. In other words, if n is large, then

  30. Fathers: Average height = 68 in SD = 2.7 in Sons: Average height = 69 in SD = 2.7 inches r = 0.5 Example: For a study of 1,078 fathers and sons: Suppose a father is 63 inches tall. What percentage have sons who are at least 66 inches tall?

  31. Testing Correlation

  32. Recall the equation of the regression line: so that the slope of the regression line is . The standard error for the slope is given by

  33. The standard error for the slope is given by Under the assumptions of: • normality, and • homoscedasticity(see below), the t distribution with df = n - 2 may be used to find confidence intervals and perform hypothesis tests. Homoscedasticity means that the variability of the data about the regression line does not depend on the value of x.

  34. n = 988 Avg height = 70 in SD height = 3 in Avg weight = 162 lb SD weight = 30 lb r = 0.47

  35. For df = 986, the Student t distribution is almost normal. So a 95% confidence interval for the slope is The corresponding confidence interval for the correlation coefficient for all men is

  36. Fathers: Average height = 68 in SD = 2.7 in Sons: Average height = 69 in SD = 2.7 inches r = 0.5 Example: For a study of 1,078 fathers and sons: Test the hypothesis that the correlation coefficient for all fathers and sons is positive.

More Related