250 likes | 316 Views
State Data Quality Review Program Improving the Quality of State Crash and Inspection Data Uploaded to MCMIS. State Data Quality Review Program: Components. Select state Preanalysis On-site visit Post Visit Document data reporting processes, observations and recommendations
E N D
State Data Quality Review Program Improving the Quality of State Crash and Inspection Data Uploaded to MCMIS
State Data Quality Review Program: Components • Select state • Preanalysis • On-site visit • Post Visit • Document data reporting processes, observations and recommendations • State selects which recommendations to pursue • FMCSA technical assistance is available
State Data Quality Program: Components • Select a state • Preanalysis • On-site visit • Post Visit • Document data reporting processes, observations and recommendations • State selects which recommendations to pursue • FMCSA technical assistance is available
State Selection Methodology • State Safety Data Quality (SSDQ) Results • Contribution to the Nation’s data quality performance • State’s willingness to participate
Crash Accuracy SSDQ Results: June 2006 Crash Timeliness 18% 13% 9% 13% 5% 5%
State Data Quality Program: Components • Select state • Preanalysis • On-site visit • Post Visit • Document data reporting processes, observations and recommendations • State selects which recommendations to pursue • FMCSA technical assistance is available
Preanalysis Completed Before the On-Site Visit • SSDQ results (A&I On-Line) • Crash statistics (A&I On-Line) • Ad hoc MCMIS reports • Crash form analysis
State Data Quality Program: Components • Select state • Preanalysis • On-site visit • Post Visit • Document data reporting processes, observations and recommendations • State selects which recommendations to pursue • FMCSA technical assistance is available
Who Participates in an On-Site Visit? • Federal team • HQ representation (when possible) • MCMIS crash and inspection data • Crash form • Collection & reporting process • SafetyNet use • State managers and support staff • Crash and inspection data • Collection, reporting, training
What HappensDuring an On-Site Visit? • Talk to managers • Talk to support staff • Use as series of questions to guide the group through the discussions • Define collection and reporting process • Identify bottlenecks and practices resulting in compromised data quality • Last day Federal team provides draft list of observations
On-Site Visit: Covers Entire Crash Process Input to State System Crash Event Data Collected Upload/ Input To SNET Upload to MCMIS
Observation: Crash Collection Process Compromises Data Accuracy Input to State System Complete Crash Form Data Collected Upload/ Input To SNET Upload to MCMIS
Observation: Crash Collection Process Compromises Data Accuracy • No distinction between interstate and intrastate trucks on crash form • Crash reports sent to the State with common errors (USDOT#, GVWR, cargo body types) • Prior versions of the crash form used
Observation: Crash Reporting Process Compromises Data Accuracy Input to State System Complete Crash Form Data Collected Upload/ Input To SNET Upload to MCMIS
Observation: Crash Reporting Process Compromises Data Accuracy • Missing data filled-in with incorrect information • Conversion of State data elements to SafetyNet elements
Observation: Some Practices and Procedures at the MCSAP Office Compromise Data Quality Input to State System Complete Crash Form Data Collected Upload/ Input To SNET Upload to MCMIS
Observation: Some Practices and Procedures at the MCSAP Office Compromise Data Quality • SafetyNet carrier match process not being used before sending data to MCMIS • Infrequent census updates to SafetyNet • MCSAP office uploads from SafetyNet to MCMIS occurring infrequently
Observation: Not all FMCSA Reportable Crashes are Uploaded to MCMIS Input to State System Complete Crash Form Data Collected Upload/ Input To SNET Upload to MCMIS
Observation: Not all FMCSA Reportable Crashes are Uploaded to MCMIS • State and FMCSA CMV definitions do not match • Officers trained to identify FMCSA reportable crashes according to State’s definition. • State’s definition used to extract FMCSA reportable crashes from State’s database.
State Data Quality Program: Components • Select state • Preanalysis • On-site visit • After the on-site visit • Document data process flows, observations and recommendations • State selects which recommendations to pursue • FMCSA technical assistance is available
After the On-Site Visit: The State is in Control • State decides which recommendations to pursue • FMCSA Technical Assistance is Available • Crash form design to capture FMCSA data elements • Officer training for crash form completion • SafetyNet training
FMCSA Learns Too • Opportunity for the state to give feedback to FMCSA • Improve SafetyNet and MCMIS activity log formats • SafetyNet training course needed for new user
For more information, please contact:Betsy BenkowskiFMCSA, Analysis Division202-366-5387Beth DeysherUSDOT, Volpe Center617-494-2570