260 likes | 521 Views
Risk Adjusted X-bar Chart. Based on Work of Eric Eisenstein and Charles Bethea, The use of patient mix-adjusted control charts to compare in hospital costs of care Health Care Management Science, 2 (1999), 193-198. Farrokh Alemi, Ph.D. Why Chart Data?. To discipline intuitions
E N D
Risk Adjusted X-bar Chart Based on Work of Eric Eisenstein and Charles Bethea, The use of patient mix-adjusted control charts to compare in hospital costs of care Health Care Management Science, 2 (1999), 193-198 Farrokh Alemi, Ph.D.
Why Chart Data? • To discipline intuitions • To communicate data in vivid graphical ways Decision makers often attribute positive outcomes to their own skills and negative outcomes to others, while in reality both could be due to chance
Data Needed • Data collected over time • Risk (expected outcomes) for each patient • Outcomes for each patient measured as a continuous variable The purpose is to improve not to get so lost in measurement to loose sight of improvement.
What Is Risk? • A patient’s condition or characteristics that affects the expected outcomes for the patient • A severity index used to predict patient outcomes • Clinicians’ consensus regarding expected outcomes • Patient’s self rating of expected outcomes
Number of cases Expected cost predicted from severity of the patient’s illness or based on experts’ consensus. Example: Observed & Expected Costs
Elements of a Control Chart • X axis shows time • Y axis shows average cost (or dependent variable of interest) • Observed rates are plotted against time sequence • Upper or lower control limit are drawn so that points 95% or 99% of data should fall within these limits
Steps in Creating X-bar Chart • Check assumptions • Calculate average costs and plot them • Calculate average expected costs • Calculate standard deviation of difference of observed and expected cost • Calculate control limits and plot them • Interpret findings • Distribute chart
Step One: Check Assumptions • We are examining continuous variables measured on a ratio or interval scale, e.g. cost, satisfaction ratings, blood pressure, etc. • Observations are independent from each other. This assumption is violated if current observations can accurately predict future values. • More than 5 observations for each time period.
Check Normal Distribution • Histogram the observed costs • Eyeball test: Is the shape bell shaped curve with most data in the middle and little data in both tails • For more precise verification of assumption you can do statistical tests of Normal distribution
Check Equality of Variance • Eyeball test: Accept the assumption if ranges are within the same ball park (No range several multiple of the other ranges) • For more precise test of the assumption you can do statistical test of equality of variances
Step 2: Calculate Average Cost Cij = Cost of case “i” in time period “j” nj = Number of cases in time period “j” Cj = Average cost for time period “j” = i=1, … njCij / nj Plot of average costs
Plot of the Observed Rates • A graph helps us see possible relationships. Maybe August was a low cost month. • Wait, until you see control limits of what could have been expected.
Step 3: Average Expected Costs Eij = Expected cost of case ‘i’ in time period “j” Ej = Expected cost for time period “j” Ej = (i=1,…,nj Eij ) / nj
Plot Expected Costs Plotting expected cost helps interpret the observed costs but does not settle the question of whether differences are due to chance.
Step 4: Standard Deviation of Differences Dij = Difference of observed and expected cost of case ‘i’ in time period “j” D = Average difference of observed and expected cost for all cases in all time periods S = Standard deviation of differences S = [i=1,…,nj j = 1, …m (Dij-D)2 / (n-1)]0.5 Sj = Standard deviation of differences for time period “j” Sj = S/(nj)0.5 See sample calculation
Standard Deviation of Difference A. Calculate differences for each case B. Calculate standard deviation of differences C. Calculate standard deviation of differences in each time period
Step 5: Calculate Limits UCLj = Upper control limit for time period “j” LCLj = Lower control limit for time period “j” UCLj = Ej + t * Sj LCLj = Ej - t * Sj t = Constant based on t-student distribution
Control Limits for First Period • UCL1 = 335.81 + 3.2 * 20.8 • LCL1 = 335.81 – 3.2 * 20.8 t-value Negative limits are set to zero as negative costs are not possible
Step 6: Interpret Findings • Two points are outside limits. • In these months, costs were different from what could be expected from patients’ severity of illness.
Step 7: Distribute Control Chart • Include in the information: • How was severity measured and expected costs anticipated? • Why are assumptions met? • What does the control chart look like? • What is the interpretation of the findings?
Summary of Steps • Check assumptions • Calculate and plot observed cost • Calculate expected cost • Calculate standard deviation of differences • Calculate and plot control limits • Interpret findings • Distribute control chart