430 likes | 591 Views
Spatial Analysis in Vaccine Trials: Spatial Effect Modifiers and Herd Immunity Measurement. Michael Emch Portland State University. Collaborators. Dr. John Clemens, Director, International Vaccine Institute (IVI), South Korea Dr. Mohammad Ali, Scientist, IVI
E N D
Spatial Analysis in Vaccine Trials: Spatial Effect Modifiers and Herd Immunity Measurement Michael Emch Portland State University
Collaborators • Dr. John Clemens, Director, International Vaccine Institute (IVI), South Korea • Dr. Mohammad Ali, Scientist, IVI • Dr. Ira Longini, Professor, Biostatistics, Rollins School of Public Health, Emory University • Dr. Mohammad Yunus, Senior Scientist & Head, Matlab Health Research Centre, International Centre for Diarrhoeal Disease Research, Bangladesh (ICDDR,B) • Dr. David Sack, Director, ICDDR,B & Professor, Johns Hopkins School of Public Health
Outline • Introduction and Objectives • Phase III Vaccine Trial Background & Traditional Efficacy Calculations • Local Efficacy Measurement & Spatial Effect Modifiers • Herd Immunity Measurement Using Spatial Information • Study Data and Methods • Findings and Conclusions
Introduction and Objectives Clemens et al. (1996) questioned the utility of conventional vaccine trial methods. Traditional protective efficacy measures don’t provide information to make decisions about whether or not to vaccinate diverse populations. Clemens, J., Brenner, R., Rao, M., Tafari, N., and Lowe, C. (1996) Evaluating new vaccines for developing countries: Efficacy of Effectiveness? Journal of the American Medical Association, 275(5): 390-7.
Justification Example Ty21a typhoid fever vaccine trials have produced conflicting results in different settings because of varying exposure levels to disease. Wahdan, M., Sarie, C,. and Derisier, Y. (1982) A controlled field trial of live Salmonella typhii strain Ty21a oral vaccine against typhoid. Journal of Infectious Diseases, 145: 292-5. Levine, M., Ferreccio, C., and Black, R. (1990) Large-scale field trial of Ty21a live oral typhoid vaccine in enteric-coated capsule formulation. Lancet, 336: 891-94. Simanjuntak, C.H., Paleologo, F.P., and Punjabi, N.H. (1991) Oral immunization against typhoid fever in Indonesia with Ty21a vaccine, Lancet 338: 1055-9
Introduction and Objectives This paper describes methods to calculate different efficacy values for different exposure levels within a phase III cholera vaccine trial area in rural Bangladesh.
Research Questions Question 1: How did the effectiveness of a cholera vaccine vary spatially in the study area? Question 2: How does protective efficacy vary by potential effect modifiers (i.e., risk factors for the disease)? Question 3: How does cholera incidence in the placebo group vary in areas with different vaccine coverage rates; i.e., was herd immunity important, and if so, at what level of coverage did it become important?
Vaccine Trial Background The evaluation of new vaccines conventionally proceeds through several stages of testing: Phase I: studies of safety and immunogenicity in low-risk individuals, usually healthy adults. Phase II: studies of safety and immunogenicity in the population to be targeted for the vaccine in practice. Phase III: randomized clinical trials that evaluate the safety and clinical protection of a vaccine in its target population.
Phase III Vaccine Trials Phase III trials serve as the final “gate-keepers” in the movement of new vaccines into public health practice. The conventional design for phase III trials- the randomized, double-blind, clinical trial- serves as the “gold standard” method for evaluating vaccines.
Vaccine Efficacy Measurement Protective efficacy is the proportionate reduction of the incidence of the target infection by vaccination Equation 1:
Local Efficacy Measurement Conventional efficacy calculations are global efficacy measures (i.e., efficacy of the vaccine for the entire study area). Conventional trials stratify protective efficacy by individual characteristics (e.g., age and sex). If locational data are available a local efficacy measure can be calculated for different subsets of the trial area.
The mathematical expression for computing an incidence rate in a raster system is: Equation 2 Local Efficacy Measurement where, j= incidence rate for pixel i cj = number of cases in pixel j pj = number of people in pixel j kj = kernel values of cell j of the filter n = number of cells in the kernel filter Incidence can be calculated for both vaccinee and non-vaccinee groups to calculate efficacy.
Spatial Effect Modifiers Effect modifiers are variables that modify the effect of a vaccine. There may be differences in the protective efficacy of vaccines in populations with one characteristic versus another. Some effect modifiers are spatial in nature. For instance, protective efficacy of the cholera vaccine might be worse near rivers because there are more cholera bacteria in rivers and the vaccine might not work as well when exposure to the bacteria is greater.
Differential Exposure and Spatial Effect Modifiers Efficacy might differ in different parts of a trial area since exposure to the disease varies within the study area. We can calculate relationships between socio-environmental risk factors and efficacy by neighborhood. Example: local sanitation environment is a risk factor for cholera and may modify the effect of the vaccine.
Differential Exposure (Force of Infection) and Spatial Effect Modifiers Efficacy stratified by: total risk (force of infection) specific risk factors
Spatial Effect Modifiers Are Risk Factors that Vary in Space Satellite remote sensing allows us to model environmental variables GIS allows us to model neighborhood-level variables and integrate environmental, health & demographic data John Jensen, 2004
High Incidence Areas of O139 and El Tor HIA=High Incidence Area LIA=Low Incidence Area
Ecological Spatial Variables Calculated Using a GIS Spatial Patterns of Sanitation Status
Cloud Penetrating Radar Satellite Image: Can easily differentiate between flooded/non-flooded areas
Herd Immunity Herd immunity is protection of an individual from a disease because others are immune to the disease. When enough people are vaccinated, the probability that the disease agent will come into contact with an individual who is not vaccinated is lower. This is called herd immunity because non-immunized people in the population are protected since most people in the population, i.e., the herd, are protected.
Herd Immunity Measurement We measured whether herd immunity is important for the cholera vaccine by using spatial information. This was done in three steps: calculated incidence in the placebo group by neighborhood calculated vaccine coverage rate by neighborhood measured relationship between incidence in the placebo group and vaccine coverage rate.
Matlab Research Area
Study Data In 1985, a community based individually randomized oral cholera vaccine trial was conducted in Matlab, Bangladesh. This double-blind trial measured the efficacy of two vaccines, the B subunit-killed whole cell (BS-WC) and the killed whole cell only (WC) vaccine. The control agent was Escherichia coli K12 strain.
Data Women over 15 and children aged 2 to 15 were the target group in the trial. Three vaccine doses were given to 62,285 people in the target group in six-week intervals. The vaccine trial used a passive surveillance system to identify cholera cases from the study area. The surveillance took place at one hospital and two community-based treatment centers.
Data During 5 years of follow-up, the protective efficacy for the BS-WC group was 49% (P < 0.001) and 47% for the WC group (P < 0.001). Protection was lower in children who were vaccinated at 2 to 5 years than in older persons. For children in this age group, protection waned after 4 to 6 months and was not evident during the third year. Persons vaccinated who were older than 5 years were protected even in the third year of follow-up.
Data What we do not know from this study: Whether efficacy varies within the study area. Whether the spatial variance is related to different socio-environmental characteristics that are responsible for spatially heterogeneous exposure. If there was herd immunity in areas with high vaccine coverage rates.
Question 1: Findings Spatial Pattern of Vaccine Efficacy 3 year cumulative
Question 2: Findings • As local-level population density increases the vaccine is not as effective • The vaccine is more effective in neighborhoods with higher socio-economic status. • In neighborhoods with higher vaccine coverage efficacy is higher. • Vaccine efficacy is lower farther away from passive surveillance facilities. Regression Model: Dependent Variable Efficacy by 1000 meter neighborhoods
Question 3: Findings Spatial distribution of oral cholera vaccine coverage based on 2 doses
Question 3: Findings • As vaccine coverage rates got larger the cholera incidence rate went down. • This pattern is true for both the placebo and vaccine group. Incidence rate and protective efficacy by vaccine coverage (based on two doses) * this is used as the reference group
Question 3: Findings • In the original trial, the cholera vaccines were less effective in the third year (Clemens et al., 1990) • Using spatial information we found that the vaccines remained effective (PE60%) in the third year in areas where the coverage is better (40% and over). • Non-vaccinees in high coverage areas benefited from reduced probability of infection.
Conclusions Vaccine efficacy varies in space no matter how it is measured at multiple scales Vaccine efficacy varies by different socio-environmental circumstances (i.e., these variables are spatial effect modifiers) Herd immunity is present is some areas Incorporating a spatial component into vaccine efficacy measurement provides specific information that is necessary to determine whether or not to vaccinate different populations.
Conclusions All vaccine researchers can use these methods in future phase III trials. Using spatial information policy makers can make better decisions about the effectiveness of a vaccine in different circumstances. For example, if poor sanitation modifies the effect of the cholera vaccine then public health officials can stratify efficacy measures for different sanitation circumstances. They can therefore know how well the vaccine will perform in another area with a similar sanitation environment.
Next Explore more effect modifiers and total risk (force of infection). We are just getting started on the spatial effect modification question. Explore herd immunity further Create spatially autoregressive models to control for spatially autocorrelated variables. Investigate local relationships by mapping geographically weighted regression (GWR) results.
Acknowledgements This project is being funded by: National Institutes of Health (NIH): National Institute of Allergies and Infectious Disease. National Science Foundation (NSF): Geography and Regional Science