270 likes | 415 Views
Tune-Up on Data Quality and Cleaning. Rita A. Adkins, M.P.A. Jean Campbell, Ph.D. Missouri Institute of Mental Health madkinr@mimh.edu.
E N D
Tune-Up on Data Quality and Cleaning Rita A. Adkins, M.P.A. Jean Campbell, Ph.D.Missouri Institute of Mental Healthmadkinr@mimh.edu This project was funded in part by the US Dept of Health & Human Services, Public Health Service, Substance Abuse and Mental Health Services Administration, Community Support Programs Branch, Center for Mental Health Services - Grant No. 6 UD1 SM52328-01-1
Interviewer Standards • Each respondent is exposed to the same question experience • All answers are recorded in the same manner • Any differences in answers should be directly attributable to differences between respondents, not to differences in the process that produced that answer
Interviewing Errors • Failure to ask all questions • Failure to probe • Skipping pages or not following skip patterns • Omitting an answer • Recording the wrong answer code • Circling more than one answer or entering more than one number
Interviewer Errors (Con’t) • Writing illegibly • Using abbreviations that are not recognizable by the data entry staff • Failure to record comments, situations and judgement calls on protocol • Incorrect usage of Q by Q
Corrective Actions: Interviewing • Schedule a full Interviewer Training Session • Submit to CC audio tape of practice interview from each interviewer • Provide each interviewer with updated FUP Q by Q, and review use • Interviewer Coordinator should observe and evaluate Interviewer performance • Interviewer Alerts distributed weekly
Editing the Interview • Make sure every question has been answered • Correct errors made in coding • Make sure notations are clearly written in the proper place on the questionnaire
Editing Deficiencies • Missing data, such as Date of Birth • Inconsistent data, such as age of hospitalization and Date of Birth • Inconsistency in use of “No” and “NASK” responses • Failure to give feedback to interviewer on identified errors • Failure to document editing decisions directly on the protocol
Corrective Actions: Editing • Interviewer is to review and clean up questionnaire immediately following interview • Each interview is to be edited by the Interviewer Coordinator or other supervisory staff • Editing should precede data entry
Issues in Data Entry • In Quality Monitoring Checks, issues identified: • Differences between the protocol response and entry in the data entry program • Incorrectly entered responses • Responses on protocol but data not entered • Entries in program where no response indicated on protocol • Qualitative responses truncated
Issues in Data Entry (Con’t) • Inconsistency in numeric formatting • “8” years is entered as “8” and “08” • Failure to correctly enter response • Response of 2-1/2 years entered as “2” years and “99” months • Response of “no” entered as “NASK”, and vice versa • Occurrences of gender coded as “9”
Data Cleaning Issues • Data entry program prevented out-of-range errors • Records not completed and verified
Consumer Operated Services Program C O S P Presentation Summary • Final Baseline Numbers! • Monthly Flash Report • Tracking Follow-Up Interviews
Enrollment, Engagement & Follow-Up Rates Rita A. Adkins, M.P.A. Missouri Institute of Mental Healthmadkinr@mimh.edu This project was funded in part by the US Dept of Health & Human Services, Public Health Service, Substance Abuse and Mental Health Services Administration, Community Support Programs Branch, Center for Mental Health Services - Grant No. 6 UD1 SM52328-01-1
Final Enrollment Numbers • CA • 151 Baselines • CT • 101 Baselines • FL • 258 Baselines • IL • 185 Baselines • ME • 212 Baselines • MO • 243 Baselines • PA • 128 Baselines • TN • 655 Baselines
Total Multisite Enrollment • Total Enrollment for Study: • 1,933 Baselines
Good News: No more Weekly Flash Reports Bad News: Will still have to submit Monthly and Quarterly Reports Some Good & Bad News
Quarterly Follow-Ups Figures • F/U Rates calculated on Date of Baseline Interview • 4 Month FUP range: 90-153 days • 8 Month FUP range: 210-275 days • 12 Month FUP range: 330-397 days • These date ranges are subject to change by looking at distributions at project’s end
Summary of Tracking Reports • Monthly Flash Report • Quarterly Report • Quantitative reporting on recruitment, enrollment, and attrition • Cost Report • Narrative on site accomplishments, problems encountered, and goals