Confidence Interval & P-Value Tutorial

1. Confidence Interval & P-Value Tutorial Lecture & tutorial material prepared by: Dr. ShaffiShaikh Tutorial presented by: Dr. RufaidahDabbagh Dr. Nurah Al-Amro

2. What is a confidence interval? • When we say that our confidence interval is 95% this means that : If we repeat our study several times we will find that the outcome we are calculating lies in the interval 95% of the times.

3. Example • Say you conducted a study to estimate the risk of lung cancer among smokers. • You did your data analysis and you found out that the OR (odds ratio) for lung cancer comparing smokers with non-smokers. OR was 3.8 with a 95% CI of (2.5, 4.1). • This means: If we conducted this same study several times and calculated the odds ratio for lung cancer, the OR value will be between 2.5 and 4.1, 95% of the time.

4. What is a P-Value • P-Value is defined as: the probability of getting an outcome as extreme or even more extreme than the actual observed value under the null hypothesis. (in other words, it is the probability of rejecting the null hypothesis when the null hypothesis is actually true) • P-value is usually assigned by the researcher at the beginning of the study. • The significant p-value agreed upon must be ≤ 0.05

5. Hypothesis testing • When we conduct a study, we are interested in showing proof that what we are hypothesizing is actually true. • In statistics, it is difficult for you to prove your hypothesis is true on its own. Instead, you have to prove that the “opposite” of what you are hypothesizing is false. • We call this refuting the null hypothesis.

6. What is the null-hypothesis • The null hypothesis is basically the opposite of what you hypothesize. • If you hypothesize that there will be a difference in incidence of a specific disease between males and females, the null hypothesis will be that: there is NO difference in incidence between males and females • If you are hypothesizing that oral contraceptives increases the risk of ovarian cancer in your study, the null hypothesis will be that: There is no difference in ovarian cancer risk between those who take oral contraceptives and those who don’t take oral contraceptives.

7. What is the association between the null hypothesis and the p-value? • As mentioned before, the p-value is the probability of rejecting the null hypothesis when it is actually true. • In our studies, we want this probability to be very small, so that we can convince people that our results will have a good impact on health. • When you get a statistically significant p-value, you can reject the null hypothesis and conclude that what you hypothesized (the alternative hypothesis) is most probably true.

8. What if you don’t get a statistically significant P-Value? • In this situation, you won’t be able to reject the null hypothesis. • You will conclude that you don’t have enough evidence to reject the null hypothesis and therefore, you won’t be able to comment whether what you hypothesized is actually true or false. • You will need to do further studies.

9. Q1. Definition of “p-value” • Mark correct and false statements as: (Yes/No)