Developing and Using P-20W Longitudinal Reports

1. Developing and Using P-20W Longitudinal Reports • Monday, October 29, 2012 • Carol Jenner, Washington State Education Research and Data Center • Charles McGrew, Kentucky P-20 Data Collaborative • Neal Gibson, Arkansas Department of Education Arkansas Research Center

2. Overview Arkansas: The Arkansas Research Center (ARC) Kentucky P-20: A Collaborative Approach Washington: Washington State Education Research and Data Center

3. The Arkansas • Research Center • (ARC)

4. Arkansas research Center

5. Request Form

6. Responsibilities K12 Higher Education Workforce/CTE Early Learning Web Development

7. AEER Report

8. Graduate Wages

9. Economic Success Measures

10. Lottery Scholarship

11. Early Learning Feedback

12. On-Time College Graduation

13. UAMS Neonatal Research

14. Kentucky P-20: A Collaborative Approach

15. How are Reports Developed KY P-20 Data Collaborative Research Agenda • P-20 staff compile a list of potential ongoing production and special report topics for the governance group based on feedback from various constituents, analyzing legislative topics, etc. • Governance reviews and approves an annual reporting and research agenda.

16. How are Reports Developed KY Planned Development Process • Audiences are identified and contacted for feedback or assembled as focus groups before the reports are created. • Mock-up reports are developed for feedback and data are analyzed to ensure they are appropriate. • Target audience iteratively review drafts. • Final reports released for vetting. • Reports released publicly.

17. How are Reports Developed KY Ad Hoc Development Process • Report or research request is made or proposed • Approval process • Requests from state entities are automatically approved within reason • External requests are evaluated on merit, work required, and funding • Initial reports are developed • Abbreviated vetting and approval process • Reports released

18. Current and Near-Future Reports KY Reports available at http://kentuckyp20.ky.gov

19. Data Presentation and Use KY Pitfalls • Know your audience. What do they need to know and what format will best communicate it to them? • Don’t waste people’s time with data for data sake. Does it have usable meaning? • Just the facts. Don’t interpret data based on a political agenda. If you present it clearly people can make their own interpretations • People don’t like surprises – vet for accuracy as much as to prepare people

20. Washington State • Education Research • and Data Center

21. Background The Education Research & Data Center • Centralized P-20W data warehouse in development • Longitudinal reports are designed and produced now • Many reports have companion data sets • Reports will eventually be data warehouse products • P-20 reports for high schools and school districts website: www.erdcdata.wa.gov • Plans for additional P-20W longitudinal reports for higher education and early learning sectors

22. Report Development Identify and involve stakeholders (for specific reports) • SEA staff, district administrators, school counselors • Higher education institutional researchers • State agencies, including P-20W partners • Legislators and legislative staff • Allow for stakeholder review before public release Other considerations • Maximize data available while maintaining student privacy • Incorporate federal- and state-mandated elements when possible

23. Access to reports Public access at www.erdcdata.wa.gov • Interactive, online reports based on de-identified data sets generated from the data warehouse (plus companion data sets for download) Incorporation into SEA reporting (planned) • Some elements will be provided to SEA for reporting to administrators and for public website Directly from the data warehouse • By ERDC staff

24. What types of reports are produced? Focus on “Feedback” reports • P-20 Reports for high schools and districts • Postsecondary enrollment by student characteristics • Pre-college (“remedial”) course-taking • P-20W Reports for baccalaureate institutions • De-identified data files to institutional researchers now – detail file plus longitudinal summary • Employment while enrolled and after graduation (annual earnings, industry of employment)

25. Avoiding Pitfalls Employ effective data governance Communication between agency decision-makers, data stewards and custodians, and research coordinators Promote a P-20W data culture (“Think P-20”) Establish definitions appropriate for P-20W Recognize that counts in P-20W reports may not exactly match those in individual sector reports Recognize that P-20W data provides richer information and presents new ways of analyzing old questions

26. Contacts & Additional Resources Contact information: Carol Jenner, carol.jenner@ofm.wa.gov Charles McGrew, Charles.McGrew@ky.gov Neal Gibson, neal.gibson@arkansas.gov Keith Brown, keithbrown@sst-slds.org

27. Contacts & Additional Resources For more information on developing and using P-20W longitudinal reports: Data Use Issue Brief: Techniques for Analyzing Longitudinal Administrative Data: http://nces.ed.gov/programs/slds/pdf/Data-Use-Issue-Brief-4_Analysis-Techniques.pdf Data Use Issue Brief: Turning Administrative Data into Research-Ready Longitudinal Data Sets:http://nces.ed.gov/programs/slds/pdf/Data-Use-Issue-Brief-3_Research-Ready-Datasets.pdf