Data Analysis and Research

1. Data Analysis and Research Nebraska’s 2012 State Longitudinal Data System Grant Institute of Education Sciences NE Data Analysis and Research

2. Goal 1 Provide a data analysis tool for districts that uses multiple local and state data sources to produce reports for local decision makers. • Deliverable: • 1.1 A Data Analysis and Reporting Tool (DART) • Process: • Build or buy decision on the data dashboard tool • Develop or customize with several pilot districts • Expand throughout the state NE Data Analysis and Research

3. Goal 2 Provide a statewide system of professional development training for data analysis that reaches every district. • Deliverables: • 2.1 Training materials • 2.2 Delivery of training to every district • 2.3 Monitoring and evaluation of training NE Data Analysis and Research

4. Goal 2 Process • Tier 1 – The Data Analysis Cadre would train the 35-40 professional developers in the data analysis framework and training materials • Tier 2 – The Professional Developers and Data Analysis Cadre would train teams of educators from multiple school districts to provide training at their respective schools • Tier 3 – The Professional Developers, Data Analysis Cadre and district staff, trained under Tier 2, will facilitate data analysis sessions for staff from entire school buildings and/or districts • Tier 4 – The Data Analysis Cadre and Professional Developers will provide ongoing support to schools in the effective use of data NE Data Analysis and Research

5. Goal 3 Build a research and evaluation operation in NDE collaboratively with the research community. • Deliverables: • 3.1 Training for NDE program staff • 3.2 Disseminating data, research and analysis findings NE Data Analysis and Research

6. Goal 4 Expand and enhance the SLDS for sustainability. • Deliverables: • 4.1 Customer Relationship Management • 4.2 Data Governance Plan Components • 4.2.1 Data dictionary aligned with CEDS • 4.2.2 Data model • 4.2.3 Metadata • 4.3 Interstate Locator • 4.4 Enrollment data support NE Data Analysis and Research

7. Stakeholder Involvement • Policy Advisory Committee • Similar to the previous reporting advisory group • Provide input into the overall implementation of grant activities • Goal 1 • Build or buy decision • Districts to pilot dashboards • Monitor progress through quarterly meetings • Assist with the evaluation plan NE Data Analysis and Research

8. District Data Collections Group • Data stewards from across the state • Support for the technical side of data collections • Conference calls on issues • Provide feedback to changes in NSSRS • Advice on how to assist districts • Requesting volunteers to expand this group NE Data Analysis and Research

9. Professional Development Group • ESU Data Analysis Cadre • 6 – 8 professional development staff from ESU and NDE Research and Evaluation team • Develop curriculum for data analysis training • Incorporate work trainers have been doing wherever possible • Train the ESU professional developers • By year 3, provide training to every district NE Data Analysis and Research

10. Research and Evaluation Team • No external stakeholder group identified in the grant • Research and Evaluation team will be an ongoing cross-team group • Trainers (Russ Masco, Ben Baumfalk, Matt Heusman, Rachael LaBounty) • NDE staff with experience, expertise or interest in program evaluation and research • Research Review Board • Data Access and Use Policy and Procedures • Approve research proposals • Not in grant but a P-20 Data advisory group for postsecondary NE Data Analysis and Research

11. Data Governance Plan (Goal 4) • Identifies the processes, groups and components involved in data collection and use in NDE • Includes • Nebraska Student and Staff Record System (NSSRS) • Consolidated Data Collection (CDC) • Teacher Certification system (TCS) • Nutrition Services (Coylar System) • Grants Management System (GMS) • P-20 postsecondary NE Data Analysis and Research

12. Components of Data Governance Plan • Policy (ultimate authority) • Leader of each system • Advisory Groups • Management Team and Technical Team • Data access policies and procedures • Metadata Standards • Reporting • Data Quality • Security • Contingency Planning NE Data Analysis and Research

13. Example: NSSRS Component Existing • Policy • Leader • Advisory Group • Data Access • Commissioner • DRE Leadership Council • NSSRS Exec • Data Access and Use Policy and Procedures • Research Review Board • Admin Memo #711 • New admin memo on data quality NE Data Analysis and Research

14. NSSRS continued Component Existing • Metadata Standards • Reporting • Data dictionary • Business rules • Instructions for reporting • Program guidance • Forms review and approval process (Admin Memo 709) • State of the Schools Report • Data Reporting System NE Data Analysis and Research

15. NSSRS continued Component Existing • Data Quality • Security • Contingency Planning • New admin memo that identifies responsibilities for data quality • Trainers • Tools such as verification reports and validations • Levels of Access • FERPA and Privacy Act • Backup systems NE Data Analysis and Research

16. Goal 4 Sustainability • Data Dictionary aligned with CEDS - Common Education Data Standards • Data Dictionary is a document identifying every data element collected • Characteristics and definitions • NDE had a data dictionary when NSSRS began but it has not been maintained and does not contain information on personally identifiable information (PII) as required for FERPA (Family Education Rights and Privacy Act) NE Data Analysis and Research

17. CEDS • The Common Education Data Standards (CEDS) is a specified set of the most commonly used education data elements to support the effective exchange of data within and across states, as students transition between educational sectors and levels, and for federal reporting. • The standards are being developed by NCES with the assistance of a CEDS Stakeholder Group • SLDS grant uses an external stakeholder group for developing the data dictionary aligned with CEDs NE Data Analysis and Research

18. Goal 4 – Other activities • Customer Relations Management (CRM) • Support the Helpdesk with ticket management • Create a directory of Agency staff responsible for reporting that could include -- • Superintendents • Data Stewards • Human Resources directors • Special Education directors • District Assessment Coordinators • Proposed software can do much more so still exploring possibilities NE Data Analysis and Research

19. Data Model and Metadata • Includes the guidance, instructions, business rules and formulas for using the data • Currently some exist but in multiple formats and locations • Does NOT attempt to put everything into one document but to serve as a resource • And to ensure that the components exist NE Data Analysis and Research

20. Interstate Locator • Nebraska and neighboring states (Iowa, Kansas and Missouri) all use eScholar’s templates for student data • Interstate locator would enable Nebraska districts to check a central location to determine if a student that left a district in one state (without forwarding district information), could be found in one of the other states • NDE was involved in original proposal and has been working with the other states to develop an MOU that would allow this • Funds were approved but still want this to be reviewed by the Policy Advisory Committee NE Data Analysis and Research

21. Enrollment Data Support • Grant provides additional Data Analyst to support • NDE Student ID • Resolve duplication issues, assist public and nonpublic staff with assigning IDs, etc. • Student and staff data • Cohort Graduation Data NE Data Analysis and Research

22. Data Dashboards – Goal 1 Dashboards • Compile key metrics in a simple and easy to interpret interface • Present data so one can quickly and visually see status or progress, etc. • Combine data from various streams, including state and local, to present a clear and comprehensive picture NE Data Analysis and Research

23. Description in Approved Grant • Connects data from multiple sources including state (NSSRS), assessment vendors, and local student information systems, etc.; • Stores the local data in a holding box at the NDE that is separated from all other NDE data; • Allows districts to upload and download data to and from the holding box as often as desired; • Displays in a dashboard the most commonly used analysis in response to questions about factors affecting student performance; • Is IT neutral, that is a non-technical person can use the system with little difficulty; and • Has secure access down to the teacher level. NE Data Analysis and Research

24. Data Reporting System • NDE’s DRS is a dashboard • Multiple programs • Student and staff data • Program information • State data • Aggregated (privacy protected) • Only data NDE collects • Allows analysis and comparisons at the state and district levels NE Data Analysis and Research

25. NE Data Analysis and Research

26. NE Data Analysis and Research

27. NE Data Analysis and Research

28. Other Examples • U. S. Department of Education • www.dashboard.ed.gov/dashboard.aspx • States • www.doe.K12.de.us • Districts • www.data-dashboard.birmingham.k12.mi.us NE Data Analysis and Research

29. Evaluation Plan for Grant • Monthly calls to monitor implementation progress • Evaluation Plan • Measure degree of implementation • Effectiveness of plan • Impact whenever possible • Policy Advisory Committee will have input into the Evaluation Plan NE Data Analysis and Research

30. Funding About 4.4 million dollars over three years for -- • Additional staff to support goals and activities • Equipment and software • Contracts with vendors for Customer Relations Management and Interstate Locator • Contracts with pilot districts for dashboard • Support for ESU and district training for professional development NE Data Analysis and Research