HIGH SCHOOLS THAT WORK

1. HIGH SCHOOLS THAT WORK Assessment 2010

2. Assessment Administration Materials • Downloaded and printed fromwww.sreb.org • Tasks and Timelines • Random sampling instructions • Student roster form • Checklist for test coordinators • Information for sites bulletin • Test description & sample questions • Test Administration guide • Downloaded and printed from WVDE • Course matching chart • Concentration chart

3. Purpose This assessment is an important tool for linking students’ academic performance with school and classroom practices

4. Components of the Assessment • Student Survey • Questions concerning student perceptions about academic and career/technical experiences • Transcript of courses taken and credits acquired • Academic Assessments that contain multiple choice and open-ended questions • Reading • Mathematics • Science

5. Assessment Window The window for the 2010 HSTW Assessment is January 29 - February 19, 2010 Plan ahead to get the best results!

6. Student Participation • Each regular HSTW site will assess up to sixty seniors • High school seniors are chosen, according to the sampling plan selected SUGGESTION: Begin the testing roster with students who will have completed four (4) credits in a career/technical concentration by graduation • Each 21st century HSTW site will assess all seniors

7. Random Sampling of Students • Option 1- Using Random Number Table • Option 2 – Using Excel Spreadsheet

8. Student Participation • Students with Disabilities • Students participating under non-standard test conditions will code an F-9 on their answer document • English language learners • Career Technical students will be tested in their “home” high school • Code E-1 on their answer document • Ensure all test takers complete all components of the assessment

9. Student Roster Form • A list of all students to be assessed, gender and homeroom locator information • List of the 6-digit answer document ID number of each student • Copy to be sent to the WV Department of Education • School keeps a copy for five years to use for the follow-up study • Recommend including an email address for follow-up ease and/or identification of awards

10. Make the 2010 Assessment a Success! • Encourage all students to do their best. • Promote the HSTW Award of Educational Achievement (407 WV students received this in 2008) • Explain the new student readiness reports and how it can help with their resumes • Build enthusiasm • Be honest – explain how this helps the school and future students • Make students feel special for participating in the assessment and thank them for their participation • Recognize those who receive the HSTW Award of Educational Achievement 13

11. Make the 2010 Assessment a Success! • Communication • Letters to students and their parents • Announcements to faculty and staff • Cooperation • Importance of the assessment to the school’s improvement goals • Importance of students, administration and faculty taking it seriously • Handling make-up work • Cooperation from teachers whose classes might be interrupted by the assessment; set testing dates early! 14

12. Scheduling the Assessment Session(s) • Select dates and makeup dates now, early in the test window • Divide large numbers of students into several assessment groups • Schedule at least two days for the assessment • Find a location suitable for testing • Select a time that does not conflict with other activities • Notify students ahead of time To ensure your school receives a report, it is critical that all students complete all four components of the assessment.

13. Completing the Transcript StudyStudent Survey, Section 1 • Please DO NOT have students fill out this section of the assessment without direct adult guidance and supervision. • It is strongly advised this section be filled out prior to test day.

14. Completing the Transcript Study You will need: • A copy of each student’s transcript • Each student’s current schedule • The Course Matching Chart • Use the completed WV Course Matching Chart to match each course students have taken or are currently enrolled to the SREB course title • The CTE Concentration Chart • Use the completed WV Career/Technical Concentration Chart to determine the appropriate concentration for each student

15. Administering the Assessment Place order • Order window • September 1 – October 30, 2009 • Orders must be placed online on SREB website • WVDE will only order for the 21st Century HSTW sites; all others will order directly from SREB • All communication and materials will be sent to contact person listed on order form

16. Information needed to place order • If your school has previously participated in an assessment • Name, email address and phone number of contact person (will receive all materials and communication via mail and email) • Complete shipping address (no P.O. boxes) • Principal name, email address and phone number • Sampling method and number of students to be assessed • Payment information and billing address • Dates the school plans to assess within window • Number of teacher surveys needed

17. Payment Information • For all regular HSTW sites paying for the assessment, a purchase order is due to SREB by October 30, 2009to confirm your order (send copy to Marian Covey, WVDE) • Final payment is due to SREB by April 30, 2010 • SREB will accept payments beginning immediately (call Fran Mathis at 404-879-5611 to request an early invoice)

18. Testing Materials • Procedure for Checking Materials • Check materials as soon as possible after they arrive Safeguard materials • Save the boxes in which materials arrived • Contact ETS immediately if • Your counts do not match the totals given on the shipping notice • You are missing any of the materials listed on the shipping notice • You do not have enough books for all of your participating students; books come in packages of 10

19. Procedure for assigning books • Find the six-digit Student ID number located in the upper right corner of the answer document • Assign the answer document to the first student by writing the student’s name on the answer document and by writing the six-digit Student ID number in column D of the Student Roster Form. • Do not use labels on the answer document • Complete the box under the student name with your school’s name and state • Be sure to write your site code number on the answer document and bubble in #

20. HSTW Student Survey • Students must complete Section 2 of student survey of Book 1 • This section can be completed before testing begins (during academic advisory, homeroom, common core class, etc.) • If this section is not completed, the students’ test will not be scored. The accuracy of the data on you instructional practices depends on student responses on this survey.

21. Administering the Assessment • Assemble materials and set up the room • Supervise student check-in • Supervise the session using the administration scripts • Collect the materials • Schedule makeup sessions for students who are absent

22. Conducting the Assessment • The test administrator should have the following materials in the room • Administration guide with script • Completed student roster form • Pre-assigned answer documents • State ID number (WVEIS student ID number) • No. 2 pencils with erasers • Reliable watch or timer • Scientific or graphing calculators for math session only

23. Conducting the Assessment • Prohibited items in testing room • Checking in students • Verify each student’s name on the Student Roster Form • Check to see that a 6-digit student ID number has been entered in Column D • Note absent students in the proper column on the roster in pencil • Defective Test Materials

24. Supervising the Assessment • Test Administration Irregularities • Group irregularities • Individual irregularities • Test Administration Scripts • Answer Document Information

25. Collecting the Materials • After each assessment session • Collect and count the books and answer documents • Complete the SCHOOL USE ONLY (Assessment Status Box) by filling in the appropriate code • 1 - Completed book • 2 - Absent • 3 - Other

26. Packing and Returning Used Answer documents • Verifying information on the answer documents • Used and unused answer document and assessment materials return • The Guide sent with your test materials will include these instructions.

27. Dates to Remember • Receive Testing Materials and Teacher Surveys from ETS • By January 20, 2010 • Administer the Assessment • January 29-February 19, 2010 • Ship materials back to ETS • No Later Than February 19, 2010 • Keep the receipt and tracking numbers Schools that return materials after the deadline will risk not receiving their results or awards!

28. Test Content • Reading – focus on informational texts; 90 minutes; 80 percent informational texts; 20 percent literary nonfiction • Mathematics – topics through Algebra II and some pre-calculus; 70 minutes; calculators permitted in two sections; no questions will advantage or disadvantage users of scientific vs. graphing calculators • Science – life, physical and earth science; 70 minutes; 40 percent life science; 40 percent physical science; 20 percent earth and space science

29. Test Strategies • Constructed response items carry more weight than multiple choice. • Students should attempt all open-ended questions; even a response not showing mastery is likely to earn more points than a correctly answered multiple-choice question. • No points are subtracted for answering multiple-choice questions incorrectly; guessing cannot lower a student’s score and may improve it!

30. HSTW Assessment Reports • School-level report • “3-minute” report – One page including implementation summary; percent at each proficiency level; percent meeting readiness goals; quadrant for state data • “30-minute” report – Slightly longer summary including mean scores; proficiency levels; readiness goals; completion of recommended curriculum; indices • “3-hour” report – Tables breaking out achievement by experiences; teacher survey results

31. HSTW Assessment Reports • Individual Student Readiness Report • Performance level on reading, mathematics and science tests • Progress toward meeting the HSTW-Recommended Curriculum • Progress toward completing a concentration (CT, humanities, mathematics/science) • Award status for the HSTW Award of Educational Achievement • Useful for résumés, college and job applications • Will be mailed to schools by April 30, 2010

32. Important Dates to Remember • Order window • September 1 – October 30, 2009 • Administration materials available online • September 1, 2009 • Test materials arrive at sites • January 20, 2010 • Student and teacher administration window • January 29 – February 19, 2010 • Final return deadline • February 19, 2010 • Awards and student reports mailed to sites • April 30, 2010 • Payment due to SREB • April 30, 2010 • School reports mailed to sites • June 30, 2010

33. Contact Information • WVDE • Marian Covey • (304) 957-9833 ext. 53517 • mecovey@access.k12.wv.us • Paula Staley • pstaley@access.k12.wv.us

34. For More Information… Go to SREB’s Web pages on assessment for more ideas and information! http://www.sreb.org/programs/hstw/Assessment/assessindex.asp **Please note SREB will be launching a new web site this fall. The assessment direct link will be different but the new website will be easier to navigate. Allison Timberlake, Director of Assessment and Evaluation allison.timberlake@sreb.org (404) 879-5575 Fran Mathis, Research Assistant fran.mathis@sreb.org (404) 879-5611

35. Thank You!