220 likes | 463 Views
The Consumer Role in Motivating Quality Improvement. Judith H. Hibbard University of Oregon Dept of Planning, Public Policy, & Management With funding from the HCFO Initiative Robert Wood Johnson Foundation. Assumptions About How Public Reports Can Affect Quality Improvement .
E N D
The Consumer Role in Motivating Quality Improvement Judith H. Hibbard University of Oregon Dept of Planning, Public Policy, & Management With funding from the HCFO Initiative Robert Wood Johnson Foundation
Assumptions About How Public Reports Can Affect Quality Improvement • 1 consumers can drive improvements through informed choice [market share] • 2 concerns about public image can motivate improvements [reputation] • 3 the feedback about own performance might be sufficient to motivate improvements [feedback]
What is the Consumer Role? • Pathway 1: [market share] • Use comparative Performance information to make a hospital choice • Pathway 2: [reputation] • Observe that there are differences • Be able to identify high and low performing hospitals • Remember them • Talk to others about the high and low performers • Pathway 3: [feedback] • No role for consumers
Evaluation of the QualityCounts Hospital Report • The Alliance produced and disseminated a report on 24 hospitals in S. Central WI • Report rated hospitals on complications and deaths • administrative data-- risk adjusted • Public report widely disseminated • Employees of The Alliance member companies • Inserted in Newspaper • Newspaper stories • Community groups/ library/Website
What the symbols mean: Fewer mistakes, complications and deaths than expected Average number of mistakes, complications and deaths More mistakes, complications and deaths than expected
91 Non-Alliance Hospitals 24 Alliance service area (HospitalsIn Public Report) Random Assignment 46 No Report Hospitals 45 Private Report Hospitals* Impact of report on Hospitals:Experimental Design 115 Eligible Hospitals in Wisconsin * Three hospitals were lost to closure and two hospitals were ineligible due to overlapping administrative structures
Research Questions: • Does Making Performance PublicIncrease: • QI efforts within areas reported upon? Are QI efforts greatest among those with lower performance scores? • To what degree do ‘private reports’ stimulate QI activities? • Actual improvements in care?
Average number of quality improvement activities to reduce obstetrical complications: Public report group has more QUALITY IMPROVEMENT (p < .01, n = 93) Best practices around c-sectionsBest practices around v-bacs Reducing 3rd or 4th degree laceration Reducing hemorrhageReducing pre-natal complicationsReducing post-surgical complicationsOther
Hospitals with poor OB scores: # of QI activities by experimental condition(p = .001, n = 34)
Percent of hospitals with significant Improvements or Declines in OB Performance in the Post-Report Period:
Percentage of hospitals who had poor scores at baseline and who improved their scores in the post-report period
Enhance Neither Enhance nor detract Detract Belief: Likelihood that the report would affect their hospital’s public image(N = 79) Scores: Main effects, p < .05, interaction effects, p < .05
The stimulus for QI appeared to be concern that the public report would affect their hospital reputation • The findings indicate that it is all about reputation.
Did the QualityCounts report affect hospital reputations? In the short term? In the long term? Did consumers come away with: • An overall impression that there are better and worse options? • Are impressions about which hospitals are better remembered? • Did they discuss the report with others?
Evaluation of the impact of the report on consumers • Surveyed Prior to distribution of report: • Alliance Member Employees • Community members (RDD sample) • Surveyed after the distribution of report: • Employee panel (N= 93) • RDD panel (N= 67) • RDD post only (N= 469) Surveyed 2 years later: • New RDD sample (N= 729)
Employees Panel RDD Post-only Percentage of Respondents Who Saw the Report, Saw News Stories about the Report, or Heard about the Report from Others. 60% 56.5% 50% RDD Panel 40% Percent of Respondents 30% 25.4% 20% 16.3% 15.2% 14.8% 14.0% 12.2% 10.4% 8.8% 10% 0% Saw Report Saw News Stories Heard about report from others
Exposure to the Performance Report * Saw, read about, or heard about the performance report
How the Hospital Report was Used: Immediately after release and 2 years later
Correctly Identified Highly Rated Hospitals *** p < .001
Correctly Identified Low Rated Hospitals * p < .05, *** p < .001<
Reports can influence consumers • Evidence for an impact on consumer perceptions of hospital quality– with diminishing but observable long-term effects • People talked about the report and influenced the views of others
Implication: Public Reporting Does Work • It does stimulate quality improvement --- primarily through a concern for reputation • Consumers do have a role, but it does not necessarily involve choice. • Feedback, and market share were not found to be significant pathways in this study