E N D
McKinney-Vento Education for Homeless Children and Youth Program (EHCY)Improving the Quality of LEA Level DataFebruary 28, 2013Prepared for:Office of Elementary and Secondary Education, U.S. Department of EducationPrepared under the Data Quality Initiative contract (ED-PEP-11-C-0062) for Policy and Program Studies Service, U.S. Department of Education
Presentation Overview • The Data Quality Initiative • Purpose and Approach of the Data Quality Review • Data Quality Review Topics • Sample Data Review • Next steps
The Data Quality Initiative (DQI)…. • Provides assistance to the U.S. Department of Education PK-12 programs and grantees to improve the quality and use of program performance data for GPRA reporting and performance management, • Is overseen by the U.S. Department of Education’s Policy and Program Studies Service (PPSS) in the Office of Planning, Evaluation and Policy Development (OPEPD), • Is conducted by Westat and Compass Evaluation and Research.
Purpose and Approach of the Data Quality Review Focus on LEA-level data Identify potential data problems (e.g., outliers) Develop guidance and TA to allow states to conduct data analyses Inform target monitoring and assistance to LEAs Improve quality of LEA data
Purpose and Approach of the Data Quality Review Data Sources • Analysis based on data that states already report: • The Consolidated State Performance Report (CSPR), and • The Common Core of Data (CCD) submitted through EDFacts.
Purpose and Approach of the Data Quality Review Data Checks • Inconsistent data • Data for primary nighttime residence vs. enrolled (do totals match, are the same grades reported?) • Incomplete data • Do all Local Education Agencies (LEAs) report data? • Inaccurate data • Typos: numbers transposed or wrong numbers entered • Number of students instead of number of subgrants
Data Quality Review Topics • Do LEAs with similar characteristics report similar numbers and percentages of homeless students enrolled in their schools? • Do LEAs with similar characteristics report similar numbers and percentages of homeless students served by McKinney-Vento? • Do LEAs with similar characteristics report similar rates of academic proficiency among their homeless students? How do these rates compare to the student body as a whole? • Do LEAs with similar levels of certain characteristics report similar rates of academic proficiency among their homeless students? How do these rates compare to the student body as a whole?
Sample Data Review Do LEAs with similar characteristics report similar numbers and percentages of homeless students enrolled in their schools? • LEA Characteristics • LEA size (student population), • Locale (city, suburban, town, or rural), • Poverty (percent Free and Reduced-Price Lunch (FRPL) eligible), and • Geography (state and region). • Topics for Analysis • The number of homeless students enrolled in each LEA, and • The percentage of total enrollment that is homeless.
Sample Data Review • The next five slides contain • Sample results of a data review, • Showing the composition of homelessness at the national, state, and LEA level. • These slides will examine data in different characteristics, to provide context to the outlier analysis.
Sample Data Review: Geography (across nation, by Census regions)
Sample Data Review: Geography(across states, within a region)
Sample Data Review: Poverty State F average
Sample Data Review: Locale State F average
Next steps • Continue the data quality review, • Identify common issues, and • Develop technical assistance to help states, including: • Report templates for SEA staff to use with LEA data (Sept. 2013) • Training to help states review and analyze LEA data (future) • Additional tools for reviewing data across years (future) • Work with you to identify and address existing and future data issues.
Questions? • Comments? • Suggestions?
For additional information, please contact: Brad Keller Data Quality Initiative Westat bradkeller@westat.com