1 / 16

Hypothesis Testing

Hypothesis Testing. Introduction. Always about a population parameter Attempt to prove (or disprove) some assumption Setup: alternate hypothesis : What you wish to prove Example: Person is guilty of crime

nash-smith
Download Presentation

Hypothesis Testing

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Hypothesis Testing

  2. Introduction Always about a population parameter Attempt to prove (or disprove) some assumption Setup: alternate hypothesis: What you wish to prove Example:Person is guilty of crime null hypothesis: Assume the opposite of what is to be proven. The null is always stated as an equality. Example:Person is innocent

  3. The test • Take a sample, compute statistic of interest. The evidence gathered against defendent • How likely is it that if the null were true, you would get such a statistic? (the p-value) How likely is it that an innocent person would be found at the scene of crime, with gun in hand, etc. • If very unlikely, then null must be false, hence alternate is proven beyond reasonable doubt. • If quite likely, then null may be true, so not enough evidence to discard it in favor of the alternate.

  4. Types of Errors

  5. Hypothesis Testing Continuous Attribute Normal, Interval Scaled Non-Normal, Ordinal Scaled c2 Contingency Tables Correlation Variance Variance Means Medians Same tests as Non-Normal Medians Z-tests Levene’s Correlation c2 Sign Test t-tests F-test ANOVA Bartlett’s Wilcoxon Correlation Kruskal-Wallis Regression Mood’s Friedman’s Hypothesis Testing Roadmap

  6. Parametric Tests Use parametric tests when: • The data are normally distributed • The variances of populations (if more than one is sampled from) are equal • The data are at least interval scaled

  7. One sample z - test Used when testing to see if sample comes from a known population. A sample of 25 measurements shows a mean of 17. Test whether this is significantly different from a the hypothesized mean of 15, assuming the population standard deviation is known to be 4. One-Sample Z Test of mu = 15 vs not = 15 The assumed standard deviation = 4 N Mean SE Mean 95% CI Z P 25 17.0000 0.8000 (15.4320, 18.5680) 2.50 0.012

  8. Z-test for proportions 70% of 200 customers surveyed say they prefer the taste of Brand X over competitors. Test the hypothesis that more than 66% of people in the population prefer Brand X. Test and CI for One Proportion Test of p = 0.66 vs p > 0.66 95% Lower Sample X N Sample p Bound Z-Value P-Value 1 140 200 0.700000 0.646701 1.19 0.116

  9. One sample t-test BP Reduction% 10 12 9 8 7 12 14 13 15 16 18 12 18 19 20 17 15 The data show reductions in Blood Pressure in a sample of 17 people after a certain treatment. We wish to test whether the average reduction in BP was at least 13%, a benchmark set by some other treatment that we wish to match or better.

  10. One Sample t-test – Minitab results One-Sample T: BP Reduction Test of mu = 13 vs > 13 95% Lower Variable N Mean StDev SE Mean Bound T P BP Reduction 17 13.8235 3.9248 0.9519 12.1616 0.87 0.200 The p-value of 0.20 indicates that the reduction in BP could not be proven to be greater than 13%. There is a 0.20 probability that it is not greater than 13%.

  11. Two Sample t-test You realize that though the overall reduction is not proven to be more than 13%, there seems to be a difference between how men and women react to the treatment. You separate the 17 observations by gender, and wish to test whether there is in fact a significant difference between genders. M F 10 15 12 16 9 18 8 12 7 18 12 19 14 20 13 17 15

  12. Two Sample t-test The test for equal variances shows that they are not different for the 2 samples. Thus a 2-sample t test may be conducted. The results are shown below. The p-value indicates there is a significant difference between the genders in their reaction to the treatment. Two-sample T for BP Reduction M vs BP Reduction F N Mean StDev SE Mean BP Red M 8 10.63 2.50 0.89 BP Red F 9 16.67 2.45 0.82 Difference = mu (BP Red M) - mu (BP Red F) Estimate for difference: -6.04167 95% CI for difference: (-8.60489, -3.47844) T-Test of difference = 0 (vs not =): T-Value = -5.02 P-Value = 0.000 DF = 15 Both use Pooled StDev = 2.4749

  13. Basics of ANOVA Analysis of Variance, or ANOVA is a technique used to test the hypothesis that there is a difference between the means of two or more populations. It is used in Regression, as well as to analyze a factorial experiment design, and in Gauge R&R studies. The basic premise of ANOVA is that differences in the means of 2 or more groups can be seen by partitioning theSum of Squares. Sum of Squares (SS) is simply the sum of the squared deviations of the observations from their means. Consider the following example with two groups. The measurements show the thumb lengths in centimeters of two types of primates. Total variation (SS) is 28, of which only 4 (2+2) is within the two groups. Thus 24 of the 28 is due to the differences between the groups. This partitioning of SS into ‘between’ and ‘within’ is used to test the hypothesis that the groups are in fact different from each other. See www.statsoft.com for more details.

  14. Results of ANOVA One-way ANOVA: Type A, Type B Source DF SS MS F P Factor 1 24.00 24.00 24.00 0.008 Error 4 4.00 1.00 Total 5 28.00 ___________________________________ S = 1 R-Sq = 85.71% R-Sq(adj) = 82.14% The results of running an ANOVA on the sample data from the previous slide are shown here. The hypothesis test computes the F-value as the ratio of MS ‘Between’ to MS ‘Within’. The greater the value of F, the greater the likelihood that there is in fact a difference between the groups. looking it up in an F-distribution table shows a p-value of 0.008, indicating a 99.2% confidence that the difference is real (exists in the Population, not just in the sample). Minitab: Stat/ANOVA/One-Way (unstacked)

  15. Two-Way ANOVA Is the strength of steel produced different for different temperatures to which it is heated and the speed with which it is cooled? Here 2 factors (speed and temp) are varied at 2 levels each, and strengths of 3 parts produced at each combination are measured as the response variable. Strength Temp Speed 20.0 Low Slow 22.0 Low Slow 21.5 Low Slow 23.0 Low Fast 24.0 Low Fast 22.0 Low Fast 25.0 High Slow 24.0 High Slow 24.5 High Slow 17.0 High Fast 18.0 High Fast 17.5 High Fast Two-way ANOVA: Strength versus Temp, Speed Source DF SS MS F P Temp 1 3.5208 3.5208 5.45 0.048 Speed 1 20.0208 20.0208 31.00 0.001 Interaction 1 58.5208 58.5208 90.61 0.000 Error 8 5.1667 0.6458 Total 11 87.2292 S = 0.8036 R-Sq = 94.08% R-Sq(adj) = 91.86% The results show significant main effects as well as an interaction effect.

  16. Two-Way ANOVA The box plots give an indication of the interaction effect. The effect of speed on the response is different for different levels of temperature. Thus, there is an interaction effect between temperature and speed.

More Related