300 likes | 429 Views
Who’s Keeping Score? Changes in the Vital Records and Statistics Infrastructure in the Computer Age. Daniel J. Friedman The NAPHSIS/NCHS Collaboration— Past Successes and Future Challenges Salt Lake City 4 June 2007. Topics. Purpose Definitions Historical perspective Methods Findings
E N D
Who’s Keeping Score? Changes in theVital Records and Statistics Infrastructure in the Computer Age Daniel J. Friedman The NAPHSIS/NCHS Collaboration— Past Successes and Future Challenges Salt Lake City 4 June 2007
Topics • Purpose • Definitions • Historical perspective • Methods • Findings • Reflections
But first, thanks to. . . • NAPHSIS executive committee • Advisory committee • NAPHSIS membership • NCHS • Former NCHS and NAPHSIS seniors
Purpose To assess changes in the vital records and statistics infrastructure at state and national levels since ~1980 • Performance • Uses • Resources Focus primarily upon public health statistics applications of birth and death records, not civil registration
Definitions • Vital records functions include: • Registration • Certification • Issuance • Corrections • Amendments • Quality control and information systems activities directly supporting vital records
Definitions • Vital statistics functions include: • Statistical analysis • Compilation of vital records data • Quality control and information systems activities directly supporting vital statistics Other health statistics functions not included
Definitions • “States”=52 jurisdictions • 50 states • New York City and Washington, D.C.
Historical perspective Stages of U.S. vital records and statistics infrastructure • Colonial mandating of reporting (1632) • Central state collection (1842) • National establishment of registration areas (1880) • Integral component of public health structure
Historical perspective • Increased computerization and cooperation (1968) • Computerization • ACME (1968) • Computer tapes to NCHS (1971) • Changing relationship between NCHS and states • VSCP (1973) • Enhanced emphasis on analysis • State centers for health statistics (1969) • Expanded use for administrative purposes • SSA EAB (1987)
Methods--Indicators • Quantitative • State and national levels • Selection via D-S-L indicator decision funnel
D-S-L indicator decision funnel #1. Potential indicators #2. Indicators with data available #3. Indicators with data available and meaningful a. valid b. inter-state consistency c. over-time consistency d. actionable #4. Ratio of meaningfulness to data collection effort #5. Final selected indicators
Methods—Data sources • National Center for Health Statistics • Published data • Unpublished data • National Library of Medicine—PubMed • New York Times archives • Delphi survey
Methods—Data sources • Web surveys of state vital records and statistics offices • Survey #1 • Assess if states provide or estimate data • 73 indicators • 1980-2005 for six selected years • 28 responding jurisdictions • Survey #2 • States provide or estimate data • 31 indicators • 1980-2005, with selected years varying among questions • 31 responding jurisdictions
Methods--Limitations • Gap between needed potential indicators and indicators with data available • Varying • Data sources • Data quality • Some self-reported • Actual data • Estimated data • Sample sizes and generalizability • Start dates
Findings—Central themes • Computerization improved performance for both vital records and vital statistics • EBC has helped to improve births performance much more than deaths • National system threatened by dramatic decline in implementation of revised standard certificates • Administrative and research uses greatly increased • Huge increase in uses not accompanied by concomitant increases in resources
Reflections • U.S. vital records • Essential • Ubiquitous • U.S. vital statistics • Essential • Ubiquitous
Reflections • BUT. . . minimal attention to health and well-being of vital records and vital statistics infrastructure
Reflections • Our colleagues in infrastructure improvement • Henry Chadwick (1824-1908) • W. Edwards Deming (1900-1993) • “There is no substitute for knowledge” • “You can expect what you inspect” • “A system must be managed. It will not manage itself.” • “The problem is at the top; management is the problem.”
Reflections HELP WANTED . . . A few good metrics