Bivariate Data Analysis

1. Bivariate Data Analysis Bivariate Data analysis 4

2. If the relationship is linear the residuals plotted against the original x - values would be scattered randomly above and below the line.

5. A scatter plot of residuals versus the x-values should be boring and have no interesting features, like direction or shape. It should stretch horizontally with about the same amount of scatter throughout. It should show no curves or outliers

6. r = 0.87 indicates a strong linear relationship between x and y

7. The scatter plot below however shows the relationship is clearly non-linear

8. When examining residuals to check whether a linear model is appropriate, it is usually best to plot them. The variation in the residuals is the key to assessing how well the model fits.

9. The pattern of residuals looks more like a parabola. This should indicate that the data were not really linear, but were more likely to be quadratic.

10. Discuss this data.

11. Outlier? Discuss this situation.

12. Discuss the plot of the residuals

13. Discuss this scatter plot

14. Linear?

15. Residuals

16. Useful website • http://stat-www.berkeley.edu/~stark/Java/Correlation.htm plots residuals, regression lines etc

17. Many of our tools for displaying and summarizing data work only when the data meet certain conditions. We cannot use a linear model unless the relationship between two variables is linear. Often re-expression can save the day, straightening bent relationships so that we can fit and use a simple linear model.

18. Displays of the residuals can often help you find subsets in the data.

19. When a scatterplot shows a CURVED form that consistently increases or decreases, we can often straighten the form of the plot be re-expressing one or both of the variables.

20. The correlation is 0.979. That sounds pretty high, but the scatter plot shows something is not quite right.

21. Re-expressing f/stop speed by squaring straightens the plot.

22. This plot looks ‘straight’. The correlation is now 0.998, but the increase in correlation is not important. (The original value of 0.979 is already large.) What is important is the form of the plot is now straight, so the correlation is now an appropriate measure of association.

23. Goals of re-expression • Make the distribution (as seen in its histogram, for example) more symmetric. • Make the form of the scatter plot more nearly linear. • Make the scatter in a scatter plot spread out evenly rather than following a fan shape.

24. Some hints • Try y2 for unimodal skewed to the left. • Try square root of y for counted data. • Try logs for measurements that can’t be negative and especially when they grow by percentage increases. • Try -1/y or -1/(square root of y). • Logs straighten exponential trends and pull in a long right trail. • Logs straighten power curves.

25. Try y versus x2

26. Try y versus x2

27. Try log or 1/x

28. Try log or 1/x

29. Don’t stray too far from the powers suggested. Taking a high power may artificially inflate R2, but it won’t give a useful or meaningful model. It is better to stick with powers between 2 and -2. Even in that range you should prefer the simpler powers in the ladder to those in the cracks. A square root is easier to understand than the 0.413 power.

30. Comparing histograms and scatter graphs

31. The data in the scatter plot below shows the progression of the fastest times for the men’s marathon since the Second World War. We may want to use this data to predict the fastest time at 1 January 2010 (i.e. 64 years after 1 January 1946). Page 53

32. Possible solutions • a quadratic (y = ax2 + bx + c) • an exponential function (y = aebx) • a power function (y = axb) • 2 separate straight lines – one for say 0 – 23 years and one for say 23 – 60 years • a line for only the later years, say 23 – 60 years

33. Quadratic • Curve seems to fit • R2 = 0.9592 is very high • Inappropriate to quote r as it is not linear • time starts increasing (not sensible) Page 54

34. Exponential • Doesn’t fit the data points particularly well

35. Power Function • reasonable fit, • R2 is high • R2 = 0.9401 √

36. Line for only the later years (1969-2003) √ • Line (1969-2003) – reasonable fit, • R2 is high • Note: We only use the later years line for the prediction and ignore the earlier years

37. The data in the scatter plot below comes from a random sample of 60 models of new cars taken from all models on the market in New Zealand in May 2000. We want to use the engine size to predict the weight of a car. • Seems to be linear for engine sizes less than 2500cc. • Very weak or no linear relationship for engine sizes over 2500cc. • Solution: Fit a line for engine sizes less than 2500cc. Page 55