Study Designs: Overview, analytic techniques and measures of association/effect

1. Lecture 2 Study Designs: Overview, analytic techniques and measures of association/effect Larry Holmes, Jr., Jobayer Hossain Research Statistics Lecture Series Nemours, DE - October, 2008 Research STATS

2. What do you see? Error!!! Bias!!!

3. Lecture Objectives • At the end of this presentation participants will be expected to: • Identify and describe the types of designs used to conduct clinical studies • Understand the selection of study subjects or participants in research • Identify the measure of association or effect • Estimate relative risk and odds ratio from cohort and case-control studies respectively

4. Why Design Strategies?Inappropriate study designs generate validity issues that cannot be corrected by statistics, however sophisticated the modelwe use “No intelligent person would underestimate the importance of mathematics in science or question the necessity for its correctness, but it cannot bring truth out of error. If it is applied to truth it will produce truth, and if it is applied to error it will almost certainly produce error” – Dingle H, 1958

5. Design or Sampling?

6. Research Feasibilities: Health Care OutcomeApproaches Management Outcome Measures Patient Health Care Provider • survival • recurrence • new disease • treatment complications • health related quality of life • disease-specific impairments • satisfaction with care • financial & family burden • medical specialty • medical coverage/insurance • access to clinical trials • support group availability • prognostic factors • knowledge/interest learning about cancer • coping strategies • quality of life Treatment/Diagnostic • treatment recommendation • treatment given • appropriateness of treatment • pain/symptom management

7. Study Conceptualization: Framework Theory/ Knowledge/ Problems Synthesis & Hunches Inferences Re Conceptual Ho Conclusions and Interpretations Conceptual Hypotheses Inferences Re Operational Ho Study Design Empirical Findings Operational Hypotheses Data Collection Observations/ Data Data Analysis

8. Research conceptualization:Schematic representation of the natural history of disease STAGE OF SUSCEPTIBILTY PRE- CLINICAL DISABILITY DISEASESYMPTO- DISEASE OR RECOVERY MATIC TISSUE Resolution or CHANGES Pre-Pathogenesis Pathogenesis Sequelae LEVEL OF PREVENTION Primary Secondary Tertiary MODES OF Health Promotion Detection Treatment and INTERVENTION Specific Early Rehabilitation Protection Diagnosis Limitation of Prompt Disability Treatment Outcome Death E Clinical Disease Chronicity B D A C Clinical Horizon Residual Disability Inapparent or Subclinical

9. Research/Study Design Analytic Examine etiology, efficacy Descriptive To: Describe an experience, programs, treatment, unusual observation Experimental? Evaluate the efficacy of a therapeutic , or other interventions Observational Association of cause and effect Comparison between 2 treatments • Examples: • Case Reports • Case series • 3) Ecological study • Examples: • Clinical Trial • Community trial Examples: 1) Cross-sectional 2) Case-control 3) Cohort Meta-analysis? Combination of studies

10. Ecological Study Design The strategy is based on determining whether those ecological units with a high frequency of exposure also tend to be the groups with a high frequency of health outcome occurrence. Measure group rates of the health outcome and exposure prevalence for the same population group, but not necessarily using the same source of data. Types of comparisons: Geographical or group comparisons, e.g., countries or administrative units. Temporal comparisons Combines geographic and temporal comparisons Time-series studies.

11. Cross-Sectional Study Cross-sectional studies typically conducting a medical survey in a community or defined population – orthopedic hospital. Key steps in conducting a cross-sectional medical survey are: To identify the base population To choose a sampling design and sampling frame for selecting the study participants To measure exposure (spine fusion) and health outcome status (post-operative pancreatitis) on the study subjects. A critical aspect of conducting a medical surveys is the logistical plans for examining the subjects and obtaining and processing any biological specimens. Cross-sectional studies may also be based on existing records. For example, a study using data from Fracture Registry to evaluate the association between osteopena or ontogenesis imperfecta and repeated fractures

12. Cross-sectional design Sampled or surveyed population Exposure – risk present (eg. Developmental motor delay) – (n?) Non-exposure – risk absent (eg. No developmental motor delay) – (n?) Disease – thoraco lumbar kyphosis (TLK) progression (n1 ?) Non-disease (n2?) Disease – TLK progression (n?) Non-disease – (n?) Prevalence (PE) – n1/(n1 + n2) Prevalence (PU) – n1/(n1 + n2) Relative prevalence – PE/PU - Using 2x2 table a/(a+b) / c(c+d). Prevalence odds ratio – ad/bc

13. Measuring Association in a Cross-Sectional Study Simplest case is to have a dichotomous outcome and dichotomous predictor variable Everyone in the sample is classified as diseased or not and having the risk factor or not, making a 2 x 2 table The proportions with disease are compared among those with and without the risk factor

14. 2 x 2 table for association of disease and exposure Disease Yes No Yes a + b b a Exposure c + d c d No N = a+b+c+d a + c b + d

15. Prevalence ratio of disease in exposed and unexposed Disease Yes No a a Yes b a + b PR = Exposure c c d c + d No

16. Case-ControlStudy Is a study that starts with the identification of persons with the outcome of interest and a suitable control group of persons without the outcome. The relationship of an exposure to the outcome is examined by comparing those with and without the outcome with regard to how frequently the exposure is present, or if quantitative, the levels of exposure in each of the groups Syn: Case-referent Study; Retrospective Study;

17. What is a case-control study? Case-control study is a method of sampling a population in which cases of disease are identified and enrolled, and a sample (controls) of the population that produced the cases is identified and enrolled. Exposures are determined for individuals in each group.

18. What is a case-control study?(Cont’d) Case-control study has two groups (case group and control group): one group has the disease of interest (cases) and a comparable group is free from the disease (controls). The case-control study identifies possible causes of disease by finding out how the two groups differ with respect to exposure to the study factor of interest and other factors.

19. Whatever selection factors in the referral system affected admissions of cases to a certain hospital would also affect the admission of hospital controls.

20. Characteristics of the Case-Control Study A single point of observation. Defined by presence or absence of the outcome. Exposure is determined retrospectively. Does not directly provide incidence data.

21. Design of a Case-Control Study Hallmark of the case-control study is that it begins with people with the disease (case) and compares them to people without the disease (control). This is in contrast to the design of a cohort study

22. Design of a case-control study

23. Design of a case-control study. A, Starting with cases and controls.

24. Design of a case-control study. B, Measuring exposure in both groups.

25. Design of a case-control study. C, Expected findings if the exposure is associated with disease.

26. Design of case-control studies

27. Odds Ratios in Case-Control Study Odds of an event is defined as the ratio of the number of ways the event can occur (P) to the number of ways the event cannot occur (1-P). Odds= _P__ 1 - P If probability of winning n= 60% Then, odds of winning = 60%/(1-60%) = 60%/40% = 1.5.

28. Odds ratio in a cohort study

29. Odds ratio in a case-control study.

30. Odds Ratio From a Case-Control Study

31. Analysis in Case-Control Studies Odd Ratio (OR) – crude and adjusted (from multivariate statistical analysis) OR ~= RR when disease is rare and cases/controls representative of all cases/population with regard to exposure.

32. Interpretation of an Odds Ratio (OR) OR=1 implies no association. Assuming statistical significance: OR = 2 suggests cases were twice as likely as controls to be exposed, or cases were 2 times more likely to be exposed than controls. Above Example: Patients with CHD were 1.62 times more likely to be smokers than controls without CHD. OR < 1 suggests a protective factor.

33. What is a cohort? A cohort is defined as a population group, or subset thereof, that is followed over a period of time. The term cohort is said to originate from the Latin cohors, which referred to one of ten divisions of an ancient Roman legion.

34. What is a cohort? (cont’d) Cohort group members experience a common exposure associated with a specific setting (e.g., an occupational cohort or a school cohort) or they share a non-specific exposure associated with a general classification (e.g., a birth cohort—being born in the same year or era).

35. COHORT STUDIES Follow-up studies, longitudinal studies, and incidence studies Cohort study is the method in which subsets of a defined population can be identified who are, have been, or in the future may be exposed or not exposed to a factor or factors hypothesized to influence the probability of occurrence of a given disease or other outcome.

36. Historical Cohort Studies Retrospective Cohort Studies. When the cohort(s) are assembled from past records. Follow-up can be either in the present or from more recent past records. Historical cohort studies may study either general population cohorts or specific exposure cohorts.

37. Structure of a Cohort Study DISEASE EXPOSED NON-CASES NO DISEASE RANDOM SAMPLING SOURCE POPULATION DISEASE NON-EXPOSED NO DISEASE PREVALENT CASES FOLLOW-UPOUTCOME

38. Design of cohort study TIME Exposure Disease Study group Present Comparison Group Absent Disease rate for exposed = a a + b for nonexposed = c c + d a a+ b Relative Risk = c c+ d a Present b Absent c Present Absent d

39. Design of a Cohort Study Start with a group of subjects who lack a positive history of the outcome of interest and are at risk for the outcome. Include at least two observation points: one to determine exposure status and eligibility and a second (or more) to determine the number of incident cases.

40. Design of a Cohort Study(cont’d) Permit the calculation of incidence rates. Can be thought of as going from cause to effect. Involve the collection of primary data.

41. If we observe an association between an exposure and a disease or another outcome, the question is: Is the association causal?

42. Design of a cohort study.

43. Prospective Cohort Study Purely prospective in nature; characterized by determination of exposure levels at baseline (the present), and follow-up for occurrence of disease at some time in the future.

44. Figure 9-6. Time frame for a hypothetical prospective cohort study begun in 2004.

45. Advantages of Prospective Cohort Studies Enable the investigator to collect data on exposures; the most direct and specific test of the study hypothesis. The size of the cohort is under greater control by the investigators.

46. Advantages of Prospective Cohort Studies (cont’d) Biological and physiological assays can be performed with decreased concern that the outcome will be affected by the underlying disease process (e.g., cholesterol levels or nutrient levels). Direct measures of the environment (e.g., indoor radon levels, electromagnetic field radiation, cigarette smoke concentration) can be made in order to define exposures precisely.

47. Retrospective Cohort Study Despite substantial benefits of prospective cohort studies, investigators have to wait for cases to accrue. Retrospective cohort studies make use of historical data to determine exposure level at some baseline in the past.

48. Time frame for a hypothetical retrospective cohort study begun in 2004.

49. Figure 9-8. Time frames for a hypothetical prospective cohort study and a hypothetical retrospective cohort study begun in 2004.

50. Advantages of Retrospective Cohort Studies A significant amount of follow-up may be accrued in a relatively short period of time. The amount of exposure data collected can be quite extensive and available to the investigator at minimal cost.