NECAP Mathematics and Reading Data Workshop

1. Office of Instruction, Assessment and Curriculum Rhode Island Department of Education 1 NECAP Mathematics and Reading Data Workshop

2. Types of Assessment 2 Formative Assessments the processes used by teachers and students during instruction that provide feedback to adjust ongoing teaching and learning to improve students� achievement of intended instructional outcomes; Interim Assessments the assessments that fall between formative and summative assessment and are used to evaluate students� knowledge and skills relative to a specific set of academic goals Summative Assessments assessments generally given at the end of some unit of time such as the semester or school year to evaluate students� performance against a defined set of content standards(Achieve/Aspen Center for Achievement) BEP 2009

3. Some Prep Before We Begin 3 Materials needed: Principal username and password Legend for the Item Analysis Report- Reading or Math ATLAS protocol worksheets Describing Interpreting Action Steps Laptop- one per group

4. 4 Access to individual student results is restricted to: the student the student�s parents/guardians authorized school personnel Authorized school personnel shall have access to the records of students to whom they are providing services when such access is required in the performance of their official duties. FERPA website: http://www.ed.gov/policy/gen/guid/fpco/ferpa/index.html

5. Measured Progress Web tool Introduction New web-based data reporting tool Levels of access for district administration, principals, and teachers Found at: http://iservices.measuredprogress.org

6. Measured Progress Web tool Introduction IT IS: Space to create custom reports New access for teachers and principals Unique tool to aid school level data analysis work IT IS NOT: Data mining software Updated in real-time The only tool that should be used to look at data in schools The only student level tool to be used for conclusions or decisions about programming

7. Types of Reports Static/traditional District data slice (in excel) District /School level reports (MP generated) Interactive Can be filtered or sorted Includes: Item analysis reports Achievement level summary Released items summary data Longitudinal data Filtering vs. sorting explanation- make sure to say Longitudnal data piece is not operational due to lack of dataFiltering vs. sorting explanation- make sure to say Longitudnal data piece is not operational due to lack of data

8. Any questions before we begin??? 8

9. ATLAS PROTOCOL From National School Reform Faculty (http://schoolreforminitiative.org) Purpose: to brainstorm around data in order to create action steps Four Major Steps: 1) Describing 2) Interpreting 3) Implications 4) Reflecting 9

10. Norms for Protocol 10 Be as objective as possible- use data to support statements Remember this is sensitive information. Respect talk time. Dig as deep as you can! Take time for this�. Get group agreement Mention the parking lot questions- large sticky notes on chart paper to be answered later Take time for this�. Get group agreement Mention the parking lot questions- large sticky notes on chart paper to be answered later

11. Describing- Math Data

12. Describing- Reading Data

13. Logging In 13 Go to: http:// iservices.measuredprogress.org Select : New England Common Assessment Program Select: NECAP reporting Select: Rhode Island (state icon) Enter : username and password (case sensitive)

14. Describing the Data:Group Selection 14 First, choose group you will be working with: Select Year- 2009-10 (should be prefilled) Select Administration- (Fall 2009) Check District- (prefilled) Check School � (prefilled) Select Test - (choose the test your group will study) Scroll down to Filter By Group- choose testing If you were to look at class information or other user created groups, they would appear in this drop down menu.

15. Describing the Data: Choosing Parameters for Study 15 Let�s all select the same parameters to begin with: Maximize Advanced Filtering Advanced Filtering Options: Male IEP, Ethnicity, SES and LEP should all be set to: All Students If you need to refresh your population, be sure to Submit the new information Export in PDF format Fill in the information on males in each section of the chart Set new Advanced Filtering Options, Submit, Export in PDF format, Record information Repeat as needed

16. Describing the Data 16 Together with your group: Make sure to not make judgments or draw conclusions. Use your worksheet to guide your research. No interpretation- just data! Emphasize that! No interpretation- just data! Emphasize that!

17. Describing the Data: Released Items Summary Data (for CR Analysis) 17 Select Interactive tab Select Released Items Summary Data from drop-down Check year, district and school information for accuracy Select Test that you are working on Select Testing from Filter by Group

18. Interpreting the Data 18 Questions we will ask: Is this addressed in our curriculum? Is this an item type issue? Is this a depth of knowledge (DOK) problem? Is this a teaching issue? Content knowledge Misconceptions Do we need to do more research? Make sure to also take a step back from the chart� Are there patterns? Themes? Interesting observations?

19. Interpreting the Data 19 For reading- need to find the passages online b/c not in item analysis report magnifier Examples for other: resources, special situations in schools For reading- need to find the passages online b/c not in item analysis report magnifier Examples for other: resources, special situations in schools

20. Implications and Action Steps 20 Together with your group: Record this on your worksheet.

21. 21

22. Reflecting With your group: What did you learn from your colleagues that was interesting or surprising? What new perspectives did your colleagues provide? How will you pursue these questions further?

23. Any last questions? 23

24. Additional Resources 24 For general NECAP information: http://www.ride.ri.gov/assessment/NECAP.aspx For NECAP Test Support materials (and released items): http://www.ride.ri.gov/assessment/necapReleasedItems.aspx For technical issues with the webtool: Call: NECAP Service Center 1.877.632.7774 Between the hours of 8 AM and 4 PM, Monday through Friday

25. Contact Information and Resources 25 Dr. Phyllis Lynch Director of the Office of Instruction, Assessment and Curriculum Phyllis.lynch@ride.ri.gov 401-222-4693 Dr. Kevon Tucker�Seeley NECAP Coordinator/Assessment Specialist Kevon.tucker-seeley@ride.ri.gov 401-222-8494 Ana Karantonis Assessment Specialist Ana.karantonis@ride.ri.gov 401-222-8940 Kate Nigh Science and Technology Specialist Kate.nigh@ride.ri.gov 401-222-8489 Peter McLaren Science and Technology Specialist Peter.mclaren@ride.ri.gov 401-222-8454 Colleen O�Brien Literacy Specialist Colleen.obrien@ride.ri.gov 401-222-8474 Diane Girard Literacy Specialist Diane.girard@ride.ri.gov 401-222-8479 Heather Johnson Mathematics Specialist Heather.johnson@ride.ri.gov 401-222-8078 Patty Carnevale Mathematics Specialist Patricia.carnevale@ride.ri.gov 401-222-8458

26. Thank you! 26