1 / 22

Chantal D. Larose

Evaluating Diagnostic Accuracy of Prostate Cancer Using Bayesian Analysis Part of an Undergraduate Research course. Chantal D. Larose. Overview. Introduction Three Ingredients to the Analysis ROC Curves Bayesian Analysis Results Discussion. Introduction.

ross-osborn
Download Presentation

Chantal D. Larose

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Evaluating Diagnostic Accuracy of Prostate Cancer Using Bayesian AnalysisPart of an Undergraduate Research course Chantal D. Larose

  2. Overview • Introduction • Three Ingredients to the Analysis • ROC Curves • Bayesian Analysis • Results • Discussion

  3. Introduction • Prostate cancer is the most common non-skin cancer in America • The risk of being diagnosed with prostate cancer increase with age. While 1 in 10,000 men under 40 years of age are diagnosed, the rate increases to 1 in 15 in men over 60. Normal Prostate Prostate Cancer

  4. Introduction • America’s population is aging • In 2000, persons over the age of 65 made up 12.4% of the country’s population. The proportion is expected to increase. That means an increasing proportion of the population is at risk for prostate cancer. • Accurate testing could help thousands of patients.

  5. Three Ingredients to the Analysis • Test - A simple, non-invasive procedure • Blood test to measure Prostate-Specific Antigen (PSA) levels. • Gold standard - Can be a complex, expensive, invasive • Determines the presence or absence of prostate cancer. • Our gold standard is a biopsy • Covariate - Additional information • May help us increase the accuracy of our prediction. • Our covariate is patient age.

  6. There are two main questions: • How good is the PSA test alone at predicting the presence of prostate cancer? • How good is the PSA test at predicting prostate cancer when combined with information about a patient’s age.

  7. ROC Curves • Receiver Operating Characteristic (ROC) curves plots ‘True Positive Rate’ versus ‘False Positive Rate’ • True Positive Rate: probability that Positive test result is correct • False Positive Rate: probability that Positive test result is incorrect

  8. ROC Curves • The area under the ROC curve (AUC) serves as a measure of overall accuracy. • If the AUC equals… • 1, the test is perfect every time • 0.5, it is as good as a coin flip • 0, the diagnosis is the opposite of the test result. • We expect values between 0.5 and 1. ROC curve and its AUC

  9. Bayesian Analysis: Three Key Parts The Prior Distribution • Knowledge about the target parameter before looking at the data. • One of two general types: • Informative prior: Holds information we know or suspect to be true, based on previous experiments or expert knowledge. • Noninformativeprior: Holds very little information. Best when we do not have previous experience or expert knowledge.

  10. Bayesian Analysis: Three Key Parts • The Data • The data used in Bayesian analysis is represented with a likelihood. • The likelihood is combined with the prior distribution.

  11. Bayesian Analysis: Three Key Parts • The Posterior Distribution • After combining the prior information with the data, represented by the likelihood, the result is the posterior distribution. • The posterior represents a natural updating of the prior knowledge based on the information from the data.

  12. Bayesian vs. Frequentist Analysis • Bayesian analysis allows us to update our initial distribution assumption to account for the observed data. • The analysis also provides us the flexibility of directly analyzing the entire posterior distribution of the target parameter. • Thus, we can look at the mean, median, and other statistics that are useful to the questions we want to answer.

  13. Bayesian vs. Frequentist Analysis One key difference between Frequentist and Bayesian methods is how population parameters are treated. Frequentist Approach Bayesian Approach considers population parameters as fixed, unknown constants. It is assumed that all the randomness lies in the data. takes the opposite view. The parameters are considered random variables which have their own distribution of possible values. The data is the known information. All resulting error comes from the distribution parameters.

  14. Bayesian vs. Frequentist Analysis • When is Bayesian analysis more appropriate? • When a parameter of a distribution is itself a random variable, or when expert knowledge is available • Works well with small data sets, where maximum likelihood methods are not appropriate

  15. Bayesian vs. Frequentist Analysis Advantages Disadvantages • Likely to have an idea about the prior distribution. • If expert knowledge is not available, we may use a non-informative prior. • Flexibility in choosing prior distribution • Works well with small data sets, where maximum likelihood methods are not appropriate • The Two Bayesian Problem: different priors produce different posteriors. • Addressed by noninformative prior.

  16. Forming an ROC Curve • A parametric approach, using binormal distribution • The curve is a function of parameters aand b. • The values of a and b are also functions of two parameters, Beta and Variance. • These values are determined by a prior assumption and information from the data. The trickle-down effect

  17. Forming an ROC Curve • In other words, there is a trickle-down effect from the data and first assumptions to the ROC curve. • To calculate this trickle-down effect, we use Bayesian statistical analysis. The trickle-down effect

  18. Results • Our analysis starts with two noninformative priors • The majority of the information in the posterior will come from the data.   • The data is organized into three groups: • All patients • Younger patients only • Older patients only

  19. Results • Each group undergoes two analyses: • one uses only test data to predict the diagnosis, • one uses test and age data combined. • Each analysis produces an ROC curve. All together, six curves are calculated.

  20. Discussion • Each ROC curve had a section which fell below the 50% accuracy line. • There was very little difference between pairs of ROC curves for a single age group • Differences in curves between older and younger patients were more pronounced. • This makes sense. Since younger patients have naturally low PSA levels, it is easier to detect high levels, and elevated levels are more likely due to cancer.

  21. Discussion • Our progress so far has brought more questions. Among these include: • How would we use the Bayesian technique with an incomplete dataset (i.e. missing information for certain patients)? • Why does each ROC curve dip below the 50% accuracy line? • What effects do other covariates, such as ethnic background, have on the ROC curve?

More Related