Math and Biology COE Webinar

1. Math and Biology COE Webinar Gearing Up for the June Submission April 22, 2014 Scott Killough, COE Science Specialist Kim Andersen, COE Mathematics Specialist Cindy Jouper, ESD 113 COE Program Director

2. Topics to be Covered • Reviewing Student Work • Appropriate Feedback • Irregularity Policy • Ensuring Sufficiency • Submissions

3. Reviewing student work: Mathematics • Paper based tasks kept in secure location available only to district staff. • Instructor provides no specific “feedback” to students but uses information to guide instruction around the standards. • Instructor carefully considers possible tier 1,2,and 3 interventions for students based on data. • Instructor considers academic vocabulary and/or contextual understanding

4. Please refer to http://www.coe.k12.wa.us/Page/271

5. Reviewing Student Work in Biology • The teacher may always review student work. • Once in the COE online system, open up a group, select a student, and then select one of their tasks. • Task will appear with the student’s responses. • This will provide the necessary information for re-teaching the student and/or the group.

6. Reviewing Student Work cont. • Student has checked the “completed” box. • Teacher might request the student consider the possibility of revisions. • The student will then un-check the “completed” box. • The teacher may need to change the task from on-demand to extended time, depending on the status of the particular task. • Student makes appropriate changes, and re-checks the “completed” box.

7. Reviewing Student Work cont. • Appropriate Feedback from the Instructor. • Instruct students to answer all questions. • Instructor may make mental notes of continued difficulties with standards. • Re-teach, review those standards with the individual or the group. • No direct reference can be made by the instructor to a specific question or task.

8. Please refer to http://www.coe.k12.wa.us/Page/312

9. Test Irregularities

10. Irregularities occur when: • Identical Work–Although many students will solve a problem using the same strategies, two or more students from the same school may have identical work or work that might suggest a single source. • Inappropriate Assistance –Student’s task indicates perceptible changes which result from inappropriate assistance.

11. How Irregularities are alerted: • Scorers receive training on the score floor regarding irregularities • Tasks are burst scored and come to the floor one task at a time • Tasks usually come at once from a district and school • Scorers alert score floor directors to a potential irregularity

12. Processing Irregularities: • Once alerted on score floor irregularities go to the score floor director and assistants. • Score floor assistants investigate irregularities pulling tasks as needed from individuals in the same school. • Decisions made and sent to score floor director • Score floor director reviews investigation and makes recommendation to OSPI irregularity review panel.

13. Irregularity Process continued • Irregularities reviewed by OSPI panel. Scores held if irregularity is confirmed. • District Assessment Coordinator contacted with guidance for district investigation. • Districts conduct investigation • Result of district investigation reported back to OSPI. • OSPI makes final determination on state assessment score: release or invalidate.

14. Avoiding Irregularities • Ways to ensure authentic student work and reduce potential irregularities and invalidation of scores: • Monitor all work done on tasks. • Review the student’s work to help guide instruction. • Know the student’s style. (Is this work authentic?) • Spot-check student’s knowledge – use other engagements to verify measured skills.

15. Avoiding Irregularities continued • Provide opportunities to start fresh. (Changing on-demand tasks to extended time; add and delete tasks from collection) • Proctoring with diligence at all times during an assessment. • Remove (if possible) and /or restrict student’s access to the internet to ensure no internet access by students. • Clarify with student if authenticity of work is in doubt.

16. Ensuring Sufficiency and Submissions

17. Ensuring Sufficiency • Have the student submit eight tasks. • Have the student submit more than the minimum of two on-demand tasks. • Make sure all questions are answered. • Every task • Every response box has an answer • Double check that the work is truly their own.

18. Submission • Recommended review on June 4th. • Have each student review their collection and send it to the teacher for final review. • The teacher reviews each student’s collection. • Provides one week for revisions/corrections. • Submission date on June 11th • Collections must be submitted by 5:00 pm.

19. Submitting Biology COE • Teacher assigns work, either on-demand or extended time • Student completes work and marks it complete. • Student chooses task(s) to include in collection. • Teacher approves task or sends for revision. • When submission opens, student clicks “submit for teacher approval” button. • Teacher approves collection. • Principal approves collection. • If diagrams were included, a work sample documentation form prints. • Ship WSDF and student diagrams to scoring center.

20. Submitting Biology COE continued • The Biology Task Response Labeled Diagram is available for download from several locations: • In the blue announcements box on the front page of the COE website, http://www.esd113.org • In the section labeled “Completing a work sample” on this page: http://www.coe.k12.wa.us/Page/188 • At the top of the page in the “Manage Groups” section of the online biology COE pages

21. Biology COE Diagram Form • Be sure that: • All fields on the form are completed • Forms are kept in a secure location in school until time for submission • Student has marked the checkbox for “diagram included”

22. Work Sample Documentation Form • Diagrams are optional. • If students have not indicated that they will include diagrams, the submission is fully electronic. There will be nothing to print and ship to the scoring center. • If students indicate that they will include diagrams, the teacher will print a work sample documentation form (WSDF) as part of the submission process and ship it to the scoring center with the student work. • Only the WSDF and diagram forms should be shipped; do not print out the electronic student work.

23. Biology Groups: Manage Group Action buttons Select checkbox View link (to see individual student) Student name and login, reset password button Overall collection status Detailed collection status

24. Managing the group • In order to use the action buttons, click the select checkbox to choose students • To select all students, click the select button at the top of the screen • Student name and log-in appear in the Student section. • If students forget password, click “Reset Password to ‘coestudent’ button. • Student will need to reset password on first log-in.

25. Understanding the detailed view Current status and date last modified – status buttons change color to indicate current status Diagrammed questions – if the student has selected the “include diagram” checkbox the question number will appear here to remind the student to include the diagram OD in this column indicates an on-demand task. The number of questions in each strand for each task. Use these numbers to calculate sufficiency.

26. Completing and including tasks The buttons in the student view allow you to perform actions on the collection. Assign task form(s) to student – assign additional tasks to this student Include Selected in COE/Uninclude Selected from COE Set Selected as On Demand/UnSet Selected as on Demand Return to Group

27. Approving tasks • Tasks can either be approved as students complete them (a task at a time) or all at once before submission. • Once a student has marked a task as complete and selected it to include, teacher can see the approve button. • Status button changes to green circle with check mark once the teacher has approved

28. Questions?

29. Contacts • COE OSPI: • Math: Kim Andersen • 360-725-6237 • Kim.andersen@k12.wa.us • Biology: Scott Killough • 360-725-6216 • Scott.killough@k12.wa.us • Technical Assistance: • COE Tech Support • 360-464-6708 • coe@esd113.org