1 / 122

Chapter 8 Statistical inference: Significance Tests About Hypotheses

Chapter 8 Statistical inference: Significance Tests About Hypotheses. Learn …. To use an inferential method called a Significance Test To analyze evidence that data provide To make decisions based on data. Two Major Methods for Making Statistical Inferences about a Population.

xylia
Download Presentation

Chapter 8 Statistical inference: Significance Tests About Hypotheses

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Chapter 8Statistical inference: Significance Tests About Hypotheses • Learn …. To use an inferential method called a Significance Test To analyze evidence that data provide To make decisions based on data

  2. Two Major Methods for Making Statistical Inferences about a Population • Confidence Interval • Significance Test

  3. Questions that Significance Tests Attempt to Answer • Does a proposed diet truly result in weight loss, on the average? • Is there evidence of discrimination against women in promotion decisions? • Does one advertising method result in better sales, on the average, than another advertising method?

  4. Section 8.1 What Are the Steps For Performing a Significance Test?

  5. Hypothesis • A hypothesis is a statement about a population, usually of the form that a certain parameter takes a particular numerical value or falls in a certain range of values • The main goal in many research studies is to check whether the data support certain hypotheses

  6. Significance Test • A significance test is a method of using data to summarize the evidence about a hypothesis • A significance test about a hypothesis has five steps

  7. Step 1: Assumptions • A (significance) test assumes that the data production used randomization • Other assumptions may include: • Assumptions about the sample size • Assumptions about the shape of the population distribution

  8. Step 2: Hypotheses • Each significance test has two hypotheses: • The null hypothesis is a statement that the parameter takes a particular value • The alternative hypothesis states that the parameter falls in some alternative range of values

  9. Null and Alternative Hypotheses • The value in the null hypothesis usually represents no effect • The symbol Ho denotes null hypothesis • The value in the alternative hypothesis usually represents an effect of some type • The symbol Ha denotes alternative hypothesis

  10. Null and Alternative Hypotheses • A null hypothesis has a single parameter value, such as Ho: p = 1/3 • An alternative hypothesis has a range of values that are alternatives to the one in Ho such as • Ha: p ≠ 1/3 or • Ha: p > 1/3 or • Ha: p < 1/3

  11. Step 3: Test Statistic • The parameter to which the hypotheses refer has a point estimate: the sample statistic • A test statistic describes how far that estimate (the sample statistic) falls from the parameter value given in the null hypothesis

  12. Step 4: P-value • To interpret a test statistic value, we use a probability summary of the evidence against the null hypothesis, Ho • First, we presume that Ho is true • Next, we consider the sampling distribution from which the test statistic comes • We summarize how far out in the tail of this sampling distribution the test statistic falls

  13. Step 4: P-value • We summarize how far out in the tail the test statistic falls by the tail probability of that value and values even more extreme • This probability is called a P-value • The smaller the P-value, the stronger the evidence is against Ho

  14. Step 4: P-value

  15. Step 4: P-value • The P-value is the probability that the test statistic equals the observed value or a value even more extreme • It is calculated by presuming that the null hypothesis H is true

  16. Step 5: Conclusion • The conclusion of a significance test reports the P-value and interprets what it says about the question that motivated the test

  17. Summary: The Five Steps of a Significance Test • Assumptions • Hypotheses • Test Statistic • P-value • Conclusion

  18. Is the Statement a Null Hypothesis or an Alternative Hypothesis? In Canada, the proportion of adults who favor legalize gambling is 0.50. • Null Hypothesis • Alternative Hypothesis

  19. Is the Statement a Null Hypothesis or an Alternative Hypothesis? The proportion of all Canadian college students who are regular smokers is less than 0.24, the value it was ten years ago. • Null Hypothesis • Alternative Hypothesis

  20. Section 8.2 Significance Tests About Proportions

  21. Example: Are Astrologers’ Predictions Better Than Guessing? • Scientific “test of astrology” experiment: • For each of 116 adult volunteers, an astrologer prepared a horoscope based on the positions of the planets and the moon at the moment of the person’s birth • Each adult subject also filled out a California Personality Index Survey

  22. Example: Are Astrologers’ Predictions Better Than Guessing? • For a given adult, his or her birth data and horoscope were shown to an astrologer together with the results of the personality survey for that adult and for two other adults randomly selected from the group • The astrologer was asked which personality chart of the 3 subjects was the correct one for that adult, based on his or her horoscope

  23. Example: Are Astrologers’ Predictions Better Than Guessing? • 28 astrologers were randomly chosen to take part in the experiment • The National Council for Geocosmic Research claimed that the probability of a correct guess on any given trial in the experiment was larger than 1/3, the value for random guessing

  24. Example: Are Astrologers’ Predictions Better Than Guessing? • Put this investigation in the context of a significance test by stating null and alternative hypotheses

  25. Example: Are Astrologers’ Predictions Better Than Guessing? • With random guessing, p = 1/3 • The astrologers’ claim: p > 1/3 • The hypotheses for this test: • Ho: p = 1/3 • Ha: p > 1/3

  26. What Are the Steps of a Significance Test about a Population Proportion? Step 1: Assumptions • The variable is categorical • The data are obtained using randomization • The sample size is sufficiently large that the sampling distribution of the sample proportion is approximately normal: • np ≥ 15 and n(1-p) ≥ 15

  27. What Are the Steps of a Significance Test about a Population Proportion? Step 2: Hypotheses • The null hypothesis has the form: • Ho: p = po • The alternative hypothesis has the form: • Ha: p > po (one-sided test) or • Ha: p < po (one-sided test) or • Ha: p ≠ po (two-sided test)

  28. What Are the Steps of a Significance Test about a Population Proportion? Step 3: Test Statistic • The test statistic measures how far the sample proportion falls from the null hypothesis value, po, relative to what we’d expect if Ho were true • The test statistic is:

  29. What Are the Steps of a Significance Test about a Population Proportion? Step 4: P-value • The P-value summarizes the evidence • It describes how unusual the data would be if H0 were true

  30. What Are the Steps of a Significance Test about a Population Proportion? Step 5: Conclusion • We summarize the test by reporting and interpreting the P-value

  31. Example: Are Astrologers’ Predictions Better Than Guessing? Step 1: Assumptions • The data is categorical – each prediction falls in the category “correct” or “incorrect” prediction • Each subject was identified by a random number. Subjects were randomly selected for each experiment. • np=116(1/3) > 15 • n(1-p) = 116(2/3) > 15

  32. Example: Are Astrologers’ Predictions Better Than Guessing? Step 2: Hypotheses • H0: p = 1/3 • Ha: p > 1/3

  33. Example: Are Astrologers’ Predictions Better Than Guessing? Step 3: Test Statistic: • In the actual experiment, the astrologers were correct with 40 of their 116 predictions (a success rate of 0.345)

  34. Example: Are Astrologers’ Predictions Better Than Guessing? Step 4: P-value • The P-value is 0.40

  35. Example: Are Astrologers’ Predictions Better Than Guessing? Step 5: Conclusion • The P-value of 0.40 is not especially small • It does not provide strong evidence against H0: p = 1/3 • There is not strong evidence that astrologers have special predictive powers

  36. How Do We Interpret the P-value? • A significance test analyzes the strength of the evidence against the null hypothesis • We start by presuming that H0 is true • The burden of proof is on Ha

  37. How Do We Interpret the P-value? • The approach used in hypotheses testing is called a proof by contradiction • To convince ourselves that Ha is true, we must show that data contradict H0 • If the P-value is small, the data contradict H0 and support Ha

  38. Two-Sided Significance Tests • A two-sided alternative hypothesis has the form Ha: p ≠ p0 • The P-value is the two-tail probability under the standard normal curve • We calculate this by finding the tail probability in a single tail and then doubling it

  39. Example: Dr Dog: Can Dogs Detect Cancer by Smell? • Study: investigate whether dogs can be trained to distinguish a patient with bladder cancer by smelling compounds released in the patient’s urine

  40. Example: Dr Dog: Can Dogs Detect Cancer by Smell? • Experiment: • Each of 6 dogs was tested with 9 trials • In each trial, one urine sample from a bladder cancer patient was randomly place among 6 control urine samples

  41. Example: Dr Dog: Can Dogs Detect Cancer by Smell? • Results: In a total of 54 trials with the six dogs, the dogs made the correct selection 22 times (a success rate of 0.407)

  42. Example: Dr Dog: Can Dogs Detect Cancer by Smell? • Does this study provide strong evidence that the dogs’ predictions were better or worse than with random guessing?

  43. Example: Dr Dog: Can Dogs Detect Cancer by Smell? Step 1: Check the sample size requirement: • Is the sample size sufficiently large to use the hypothesis test for a population proportion? • Is np0 >15 and n(1-p0)>15? • 54(1/7) = 7.7 and 54(6/7) = 46.3 • The first, np0 is not large enough • We will see that the two-sided test is robust when this assumption is not satisfied

  44. Example: Dr Dog: Can Dogs Detect Cancer by Smell? Step 2: Hypotheses • H0: p = 1/7 • Ha: p ≠ 1/7

  45. Example: Dr Dog: Can Dogs Detect Cancer by Smell? Step 3: Test Statistic

  46. Example: Dr Dog: Can Dogs Detect Cancer by Smell? Step 4: P-value

  47. Example: Dr Dog: Can Dogs Detect Cancer by Smell? Step 5: Conclusion • Since the P-value is very small and the sample proportion is greater than 1/7, the evidence strongly suggests that the dogs’ selections are better than random guessing

  48. Example: Dr Dog: Can Dogs Detect Cancer by Smell? • Insight: • In this study, the subjects were a convenience sample rather than a random sample from some population • Also, the dogs were not randomly selected • Any inferential predictions are highly tentative • The predictions become more conclusive if similar results occur in other studies

  49. Summary of P-values for Different Alternative Hypotheses

  50. The Significance Level Tells Us How Strong the Evidence Must Be • Sometimes we need to make a decision about whether the data provide sufficient evidence to reject H0 • Before seeing the data, we decide how small the P-value would need to be to reject H0 • This cutoff point is called the significance level

More Related