420 likes | 591 Views
National Quality Measures Clearinghouse: An Expanded Tool with Real-world Relevance. Vivian H. Coates, MBA Vice President, Information Services and Health Technology Assessment Project Director, National Guideline Clearinghouse and N ational Q uality Measures Clearinghouse ECRI Institute
E N D
National Quality Measures Clearinghouse: An Expanded Tool with Real-world Relevance Vivian H. Coates, MBA Vice President, Information Services and Health Technology Assessment Project Director, National Guideline Clearinghouse and National Quality Measures Clearinghouse ECRI Institute Eric C. Schneider MD, MSc RAND Distinguished Chair in Health Care Quality Director, RAND Boston Associate Professor, Harvard Medical School R. Heather Palmer, MB, BCh, SM Professor, Health Policy & Management Harvard School of Public Health
Outline • NQMC: An Introduction to the Web Site • The NQMC Domain Framework: Development and Evolution
Audience Background Please select your primary professional role: A. Practicing clinician B. Administrator or policy maker C. Performance measure developer D. Researcher E. Student or trainee F. Other
Audience Background Please describe your familiarity with NQMC: A. Never heard of it before today B. Heard of it, but never visited the site C. Visited the site a few times D. Use NQMC fairly often
Introduction to NQMC: What Is It and What Can It Do? NQMC Web site went live Feb. 19, 2003 – 8 years old! • 6,760 measures submitted from 54 orgs (as of August 31, 2011) • 2,002 measure summaries currently publishedfrom 51 orgs (as of August 31, 2011) • ~14 measuresummaries published per week (August 2010-August 2011 weekly average) • 563 additional measure summaries currently in progress in work queue (as of August 31, 2011)
NQMC Web Site Usage • NQMC Web Site Usage (August 1, 2010 – July 31, 2011): • Average monthly visits: 17,250 • Average weekly visits: 3, 980 • Average time spent per visit: 7:51 minutes • Average page views per visit: 4.25 • New visitors: 32,800 • Now sending weekly “What’s New e-mail alerts” to more than 40,323 subscribers (as of August 31, 2011)
Profile of NQMC Users • 38.2% of respondents: managers, purchasers, or policy makers • 11.8% : physicians • 11.7% : researchers, measure developers, or information specialists • 11.2% : physician assistants or nurses • Source: 2008 NQMC user survey
Profile of NQMC Users • 44.6% of respondents: affiliated with inpatient care hospitals • 15.4%: oversight organizations or purchasers • 12.7 : outpatient ambulatory settings • 11.9%: academic institutions • Source: 2008 NQMC user survey
What Can NQMC Do? • Help users to find and compare measures (from many countries) • Search using multiple controlled taxonomies (eg, UMLS vocabularies: including MeSH, SNOMED, ICD) • Search using filters (eg, identify measures that are endorsed by NQF) • Forum for debate: Expert Commentaries • Educate users about measurement and measurement frameworks
Evolution of the Domain Framework • NQMC classifies measures into domain categories that can assist users in searching and browsing the database • Design of framework is empirically driven based on analysis of thousands of “measures” submitted to NQMC from across the globe
Audience Query:Classify this Measure The percentage of adult members who were hospitalized and discharged alive with a diagnosis of acute myocardial infarction (AMI) and who received persistent beta-blocker treatment for six months after discharge. In which domain would you classify this measure? • Process • Access • Outcome • Structure • Patient Experience
Audience Query: Classify this Measure The percent of patients who have had a visit to an Emergency Department (ED)/Urgent Care office for asthma in the past six months. In which domain would you classify this measure? • Process • Outcome • Access • Patient Experience • None of the above
Audience Query: Classify this Measure The percent of diabetic patients in the clinical information system who are current smokers (documented in the last 12 months). In which domain would you classify this measure? • Structure • Process • Outcome • Patient Experience • None of the above
Audience Query: Classify this Measure Whether a practice has a policy to ensure the prevention of fraud and has defined levels of financial responsibility and accountability for staff undertaking financial transactions. In which domain would you classify this measure? • Process • Structure • Outcome • Patient experience • None of the above
Audience Query: Classify this Measure The number of cases of selected Central venous catheter-related bloodstream infections per 100,000 population in county or Metro Area. In which domain would you classify this measure? • Process • Access • Outcome • Health State • None of the Above
Population Health Domain Rationale • Denominator includes individuals who may not have received care from the clinical delivery system (“geographically-defined” denominator) • AHRQ National Quality Report and National Health Disparities Reports include population health measures • Federal and state agencies are investing in public health standards and measurement initiatives • NQF considering expansion of its purview to include population health • The Clearinghouses are well positioned to serve as a resource for public health professionals
Population Health Domain • Definition of Population • a group of persons identified by geographic location, organizational affiliation or non-clinical characteristics. Denominator inclusion for measures classified in population health domains is not restricted to recipients of clinical care or enrollees in a health plan.
Population Health Domain Development • Public health measure analysis sets: • LA County Department of Public Health • U.S. Public Health Service’s Healthy People 2010 • CDC Indicators for Occupational Health Surveillance • CDC Indicators for Chronic Disease Surveillance • Commission for Environmental Cooperation: Children’s Health and the Environment in North America • New York State County Health Assessment Indicators • Utah Department of Health Indicator-Based Information System for Public Health (IBIS-PH) • Swedish National Board of Health and Welfare
Population Health Measures: Examples • Population Process • The proportion of adults ages 65 years and older in a county who have received an influenza vaccination in the past year. • Population Access • The percentage of smokers in a county who reported that they were able to receive services from a smoking-cessation program.
Population Health Measures: Examples • Population Outcome • The proportion of children with elevated blood lead levels whose homes undergo lead remediation, and whose blood lead levels are subsequently reduced to normal levels. • Population Experience • The percentage of smokers in a county reporting that they have seen or heard public service announcements promoting a county health department-sponsored smoking-cessation program. • Population Structure • The number of licensed child care facilities and slots in a county.
Population Health Measures: Examples • Population Health Knowledge • The mean response score to a set of questions about HIV prevention. • Social Determinants of Health • The proportion of families living at or below the poverty level. • Environment • The number of days in the past year when the concentration of particulate air pollution in a community exceeds a defined threshold.
Audience Query: Classify this Measure The proportion of families living at or below the poverty level. In which domain would you classify this measure? A. Population Outcome B. Population Process C. Population Structure D. Social Determinants of Health E. Environment
Audience Query: Classify this Measure The mean response score to a set of questions about HIV prevention. In which domain would you classify this measure? A. Population Process B. Population Structure C. Population Health Knowledge D. Social Determinants of Health E. Environment
Audience Query: Classify this Measure The number of days in the past year when the concentration of particulate air pollution in a community exceeds a defined threshold. In which domain would you classify this measure? A. Population Process B. Population Structure C. Population Health Knowledge D. Social Determinants of Health E. Environment
Measuring Cost and Efficiency: Rationale • Costs and resource use measures now a high priority • NQF National Priorities Partners Areas • Payment reform models • Interest in price transparency • Earlier cost reporting efforts • Pennsylvania HC4 CABG Surgery Mortality Report (1991) • NCQA Use of services measures (1993) • Renewed efforts to try to measure efficiency • NCQA Relative Resource Use Measures • Use of Episode Groupers to carry out relative cost measurement
Efficiency and Cost Domain Development • Cost • the monetary or resource units expended by a health care organization or clinician to deliver health care to individuals or populations. • Efficiency • a measure of cost of care associated with a specified level of quality of care.
Cost vs. Efficiency Hospital Cost Measure: Median Charge per Hospital Discharge, Total Hip Replacement (hypothetical)
Cost vs. Efficiency Hospital Efficiency Measure: Quality-Adjusted Median Charge per Hospital Discharge, Total Hip Replacement (hypothetical)
Payment Models Needing New Performance Measures • Global payment • ACO shared savings • Medical home • Bundled payment • Hospital-physician gainsharing • Payment for coordination • Hospital pay-for-performance • Physician pay-for-performance • Payment for shared decision-making
Summary of New Measure Types Needed to Support Payment Reform Models • Health outcomes • Functional status & safety outcomes • Care coordination • Transitions • Patient and caregiver engagement with care • Medical homes, shared decision-making • Structure • ACOs, decision aids • Efficiency • Hospital and Physician P4P
Some Anticipated Consequences • Potentially large increase in performance measure submissions to NQMC as federally-funded projects complete measure development • New types of measures? • Potential increase in the variability of “measure quality” • Purposes for measures • Evidence used • Protocols used to develop measures • Validity and reliability testing • How can NQMC adequately convey distinctions among these attributes of measures?
Performance Measures and Health Reform: Issues for the Future • Evolution in delivery organizations (medical homes, ACOs) • New expectations about necessary evidence base • Heightened concern about conflicts of interest • New federal resources for quality measure development, selection and endorsement • E-Specifications for traditional performance measures • New types of performance measures leveraging EHR • New performance measures to assess HIT and HIE
NQMC Going Forward • Audience Q and A