Using DataDirector Assessments to Increase Use of Feedback to Students and Teachers

1. Using DataDirector Assessments to Increase Use of Feedback to Students and Teachers Stan Masters Coordinator of Instructional Data Services Lenawee Intermediate School District Adrian, Michigan Michigan Digital Learning Conference November 13, 2013

2. Data Warehousing Talking Points WE MUST UTILIZE AN INQUIRY APPROACH TO DATA ANALYSIS WE MUST USE MULTIPLE SOURCES OF DATA We need a data warehouse for our 21st century schools WE MUST FOCUS ON DATA TO INCREASE STUDENT ACHIEVEMENT

3. Data Dialogues

4. Conversation Deliberation Ways of Talking Dialogue Discussion Norms of Collaboration Outcome: Deep Understanding Outcome: Decisions That Stick Culture of Collaboration The Center for Adaptive Schools www.adaptiveschools.com

5. Data Driven Dialogue Predictions Observations Adapted from Deb Clancy, Washtenaw ISD, 2008, based upon the work of Nancy Love, “Using Data/Getting Results” (2002) Inferences

6. Feedback Source: Marzano, R. J., Pickering, D. J. and Pollock, J. E. Classroom Instruction That Works: Research-Based Strategies for Increasing Student Achievement (2001). Alexandria, VA: ASCD • Best gains in student achievement involve description: • Corrective in nature • Timely in nature • Specific to a criterion • Including students in the feedback

7. Common Assessments A common assessment is an assessment typically created collaboratively by a team of teachers responsible for the same grade level, course, or content area.

8. Implementing Assessments with DataDirector Common Formative and Summative Assessments Aligned to Expectations and Delivered Online Through DataDirector Common Classroom Summative and Formative Assessments Aligned to Expectations Classroom Summative and Formative Tests Aligned to Expectations Existing Summative and Formative Classroom Tests Not Aligned with Expectations Adapted from St. Clair RESA

9. Making It Formative • Get the scores into the students’ hands • Develop multiple worksheet Excel file • Data feeds into form with student names • Students identify “simple mistakes” and “need help” with wrong answers

10. Sample Report

11. College and Career Readiness

12. ACT Subject Area Test EXPLORE PLAN ACT English English Composition 13 15 18 Reading Social Sciences 15 17 22 Math Algebra 17 19 22 Science Biology 20 21 23 College Course(s) ACT’s College Readiness Benchmark Scores

14. Predictions UsingEXPLORE to PLAN to ACTSource: http://www.act.org/research/policymakers/pdf/ReasonableGrowth.pdf

15. Item Analysis of EXPLORE and PLAN • Robert Hanvey at SCCRESA developed program that pulls raw data from files • File format allows DataDirector to “read” data like an Answer Sheet Assessment • Answer sheet organized by sections aligned to test’s content areas and subscores

17. Where do we go? Present State Future State

18. Schools are celebrating with SMART goals • More measurable outcomes related to content expectations • More use of assessment for learning • More strategic use of resources to help students who are not meeting expectations • Making continual school improvement more meaningful

19. Suggested Next Steps • Move from scores to criteria around the scores • Move from existing rubric/scoring guides to more concise rubric/scoring guides • Move from individual analysis to team analysis

20. Words of encouragement from other assessments miners… • All assessments are finite resources • Having a variety of tools makes your mining experience more worthwhile • It is better to work together while in the mines!

21. Continue the Conversation Stan Masters Coordinator of Instructional Data Services Lenawee Intermediate School District Fireside Building 4107 N. Adrian Highway Adrian, Michigan 49921 517-265-1606 (phone) 517-265-7079 (fax) stan.masters@lisd.us • http://www.lisd.us/instructional-services/curriculum-assessment--instruction/data-warehousing/ • http://www.lisd.us/instructional-services/curriculum-assessment--instruction/classroom-assessment/