The Standardized Infection Ratio

1. The Standardized Infection Ratio Steven P Hudson, MBA, MA Statistician Health Care Excel, Inc

2. Objectives • Describe what the Standardized Infection Ratio (SIR) is and how it is calculated. • Explain how to generate and interpret a report utilizing the SIR.

3. What is a standardized infection ratio? The standardized infection ratio (SIR) is a summary measure used to track healthcare-associated infections (HAIs) at a national, state, or local level over time. The SIR adjusts for patients of varying risk within each facility. - The National Healthcare Safety Network (NHSN)

4. The SIR calculation SIR= • In HAI data analysis, the SIR compares the actual number of HAIs reported (observed) with the baseline U.S. experience (expected/predicted), adjusting for several risk factors that have been found to be significantly associated with differences in infection incidence. number of observed (O) number of expected (E) • NHSN aggregate data are used as the standard population and considered the baseline U.S. experience • NHSN baseline data used in a SIR are used to calculate the expected or predicted number of HAIs adjusting for the identified risk factors.

5. What does the SIR number mean? • Accounting for differences in the types of patient followed: • A SIR greater than 1.0 indicates that more HAIs were observed than predicted. • A SIR less than 1.0 indicates that fewer HAIs were observed than predicted. • A SIR equal to 1.0 indicates the same number of HAIs were observed than predicted. • However, the SIR alone does not imply statistical significance.

6. Statistical significance of the SIR:p-value and 95% confidence intervals • The SIR is only a point estimate and needs additional information to indicate if it is statistically significantly different from 1. • A 95% confidence interval (CI) and a p-value are calculated by NHSN for each SIR and determines statistical significance. • A 95% CI assesses the magnitude and stability of a SIR. Therefore, a 95% CI is the range of estimated SIR values that have a 95% probability of including the true SIR for the population. • If the 95% CI does not contain the value 1, the SIR is “statistically significant.” • If the p-value is less than 0.05, the SIR is “statistically significant.”

7. Statistical Significance If the p-value is less than .05, then your rates are different than the national average If the confidence level does not overlap 1, then your rates are different than the national average.

8. I was just getting used to rates, why the SIR? More sensitive for low denominators Ability to combine data Useful for predicting state and national rates

9. OK , I’m no statistician-what’s all this mumbo jumbo about? The SIR In simple terms- you are compared to the average of a referent population and adjusted for risk In this case, it is a historical control.

10. Calculation SIR= Observed (actual number of Infections) Expected (expected number of infections)

11. Let’s take a closer look Hospital A :

12. Turned into SIR SIR is less than 1

13. SimplyPut • A SIR of 1.0 means the observed number of infections is equal to the number of expected infections. • A SIR above 1.0 means that the infection rate is higher than that found in the "standard population." For HAI reports, the standard population comes from data reported by the hundreds of U.S. hospitals that use the NHSN system. The difference above 1.0 is the percentage by which the infection rate exceeds that of the standard population. • A SIR below 1.0 means the infection rate is lower than that of the standard population. The difference below 1.0 is the percentage by which the infection rate is lower than that experienced by the standard population.

14. How to generate NHSN SIR outputs Log into NHSN --> enter the Patient Safety Module Starting from the blue navigation menu on the left, click “Analysis” --> “Generate Data Set” --> “Generate New” (note: this will take some time to load) Click “Analysis” --> “Output Options” On the white screen, click “Device-Associated Module” --> “Central Line-Associated BSI” --> “CDC Defined Output” --> “SIR – In-Plan CLAB Data” Select “Run” for data aggregated by 6-month intervals and CDC location type or select “Modify” to customize the output

15. Conducting your own analysis

19. orgid=10330

21. Surgical SIR

22. SSI SIR

23. SSI data are summarized like they are for CLABSIs:

24. Interpreting the SIR • During 2009, there were 524 procedures performed and 13 SSIs identified. • Based on the NHSN 2006-2008 baseline data 6.687 SSIs were expected. • This results in a SIR of 1.94 (13/6.687), signifying that during this time period our facility identified 94% more SSIs than expected. • The p-value and 95% confidence interval indicate that the number of observed SSIs is significantly higher than the number of expected SSIs.

25. The SIR

26. Questions ?

27. Contact Info • Email: shudson@kyqio.sdps.org • 502-454-5112 ext 2252 This material was prepared by Health Care Excel, the Medicare Quality Improvement Organization for Indiana, under contract with the Centers for Medicare & Medicaid Services (CMS), an agency of the U.S. Department of Health and Human Services. The contents presented do not necessarily reflect CMS policy. 10SOW-IN-INDPAT-13-012 4/1/13