1 / 74

Preparing for the 2012 HSTW Assessment

Preparing for the 2012 HSTW Assessment. Mike Ross Consultant, HSTW & MMGW S.W. Ohio Susanne Davis HSTW Assessment Coordinator, Ohio. What is the HSTW Assessment? Administration Nuts & Bolts Best Practices for Successful Assessments. Topics Covered. What is the HSTW Assessment?.

maree
Download Presentation

Preparing for the 2012 HSTW Assessment

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Preparing for the2012HSTW Assessment Mike Ross Consultant, HSTW & MMGW S.W. Ohio Susanne Davis HSTW Assessment Coordinator, Ohio

  2. What is the HSTW Assessment? Administration Nuts & Bolts Best Practices for Successful Assessments Topics Covered

  3. What is the HSTW Assessment? • Required in even-numbered years • Subject tests in reading, mathematics and science based on NAEP frameworks • Student Survey • Course-taking patterns • School and classroom experiences • Teacher Survey • Provides schools with comprehensive school-level data breaking out student achievement by experiences

  4. Examples of How Schools Use the Results • Identify improvement needs • Gain support for school improvement • Engage the entire faculty in school improvement • Set priorities and goals for school improvement • Improve classroom practices • Lobby for state actions to support school improvement

  5. New in 2012 • Teacher Survey will be online. • Constructed response items have been eliminated. • Overall testing time has been shortened by 20 minutes.

  6. Testing Times 20102012 • Reading 90 min. 75 min. • Mathematics 70 min. 80 min. • Science 70 min.55 min. Total time 230 min. 210 min.

  7. Test Content • Used 2009 NAEP frameworks as a starting point • Modified to reflect college and career readiness goals • Reading – focus on informational texts • Math – topics through Algebra II and some pre-calculus • Science – life, physical and earth science

  8. Reading Test • 75 minutes • 80% informational texts; 20% literary nonfiction • Includes meaning vocabulary • Includes paired texts (to assess critical analysis) • Does not include literary fiction or poetry

  9. Reading Test • Passage length: 500-1500 words • Cognitive targets • 15% locate/recall • 55% integrate/interpret • 30% critique/evaluate

  10. Mathematics Test • 80 minutes • Scientific or graphing calculators permitted for one section • Type of calculator will neither advantage nor disadvantage student • Topics • Pre-algebra through Pre-calculus, including Algebra II

  11. Mathematics Test • Content • 10% - Number Properties and Operations • 30% - Measurement/Geometry • 25% - Data Analysis, Statistics and Probability • 35% - Algebra

  12. Mathematics Test • Cognitive Targets • 50% - Low Complexity recall routine procedures • 45% - Moderate Complexity make connections within mathematics or between mathematics and real world • 5% - High Complexity analyze a problem mathematically

  13. Science Test • 55 minutes • Content • 40% - Life science • 40% - Physical science • 20% - Earth and space science

  14. Science Test • Science Practices • 70% • Identifying science principles • Using science principles • 30% • Using scientific inquiry • Using technological design

  15. Student Survey • Section 1– Course Experience • Staff member completes this section for each student • Based on Course Matching and Transcript Analysis • Section 2 – School Experience • Students complete this section • School and classroom experiences • Based on HSTW key practices • Section 3 – General Information • Students complete this section

  16. Teacher Survey • New for 2012: online survey! • School and classroom experiences • School mission • High expectations and extra help • Guiding and supporting students • Curriculum content and engaging students in learning • Transitions • Leadership and professional growth

  17. Results Reporting • School Report (late-June, 2012) PDF file on CD • Student Reports (late-April, 2012) • HSTW Award of Educational Achievement (late-April, 2012)

  18. HSTW Assessment Report • Mailed to schools late-June, 2012 • Executive Summary -“3-minute report” • One page summary of performance and implementation • Overview -“30-minute report” • Slightly longer summary • Full report -“3-hour report” • Tables breaking out achievement by experiences • Teacher survey results

  19. School Report • Executive Summary • One-page snapshot • Graphs and charts • Includes: • Implementation summary • Percentage of students meeting readiness goals: 250, 257, 258 • Percentage of students at each proficiency level • Blank quadrant for state data

  20. School Report • The Overview • Approximately 15 pages • Graphs and charts • Includes: • Mean scores • Percent meeting readiness goals • Percent at each proficiency level • Performance on HSTW indices • More detailed implementation summary

  21. School Reports • Full report • All those tables! • Student achievement broken out by survey questions • Teacher survey results

  22. Student Reports • Mailed to schools late-April, 2012 • Includes: • Performance level on reading, mathematics and science tests • Completion of recommended curriculum and concentration (C/T, humanities, math/science) • Award status • Useful for resumes, college applications, job applications

  23. HSTW Award of Educational Achievement • Award certificates mailed to schools late-April, 2012 • Awarded to students who: • Meet all three readiness goals (reading 250, math 257, science 258) • Complete at least 2 of 3 HSTW recommended curriculum goals • English/language arts, mathematics, science • Complete a concentration • Career/technical, mathematics/science, humanities

  24. HSTW Award of Educational Achievement

  25. Award of Educational Achievement Opportunities for High Schools • Local community colleges • Local employers • Additional incentives for students

  26. HSTW Assessment AdministrationNuts & Bolts

  27. 2012 Student Assessment and Teacher Survey Window January 27– February 17 (3 weeks) Plan ahead to get the best results!

  28. Conducting the Assessment Process • Ordering • Preparing • Administering • Returning materials

  29. Ordering the Assessment • Submit orders to your Regional Office by September 30, 2011 • Do NOT order online! Do NOT send order to SREB! The good news : There is nocost to your school! HSTW SWO pays for the entire Assessment!

  30. Ordering Information Needed from You • Previous participation in an assessment • Name, phone and email for the assessment contact person (will be receiving materials for a year!) • Complete shipping address (no P.O. boxes) • Principal’s name, phone and email • Number of students to be tested and sampling method • SWO Region pays for 60 seniors at your site. You must pay for any additional students beyond 60 or special composites. • Week you plan to administer the assessment • Number of teachers to be surveyed

  31. Other Ordering Information • Unless there are special reasons, we encourage you to test no more than 60 students. • You will receive extra test sets. However, when submitting scan sheets to be scored, do not exceed the number ordered! • Schools testing more than 60 must pay for each additional student: $34 per student. • A cancellation fee of $13 per student may be charged if you cancel testing or miss the return deadline.

  32. Administration Materials Online at www.sreb.org • Test Administration Guide • Sampling Instructions • Student Roster Form • Checklist • Test Description and Sample Question Booklet • Tasks and Timelines • Course Description Guide • Course Matching Chart

  33. Preparing for the Assessment • Administration materials are now available online at: www.sreb.org • Booklets & scan sheets will arrive by January 23, 2012

  34. Sample Timeline

  35. Preparing for the Assessment Identify Students for the Assessment • Select one of two possible selection methods: • RANDOM SAMPLE of 60 (or more) seniors - OR - • ALL SENIORS • Select a true random sample by using the instructions provided. You must also select fivealternates at random.

  36. Other Tips for Selecting Students • Only include currently enrolled seniors. • Only exclude students if their IEP exempts them from state assessments. • Same accommodations provided for state assessments should be provided for this assessment.

  37. Other Tips for Selecting Students • Administrator Guide will contain suggested accommodations for English-language learners. • Contact ETS by October 31 to request large-print or audio CD versions . • Be reasonably assured that all students can complete ALL 4 components – reading, math, science, AND student survey.

  38. Random Sampling Options • What is a “random sample”? • How do you draw a random sample? Two options available: • a random number table OR • Excel (to generate random numbers)

  39. Random Sampling • Simple random sample - every time a selection is made, every student on the list has an equalchance of being the one selected. • Selection Bias – anything that contaminates or distorts the process.

  40. Group ActivityRandom Sampling Procedures: Option #1 – Random Number Table • Develop a list of all eligible students (delete names of students who moved or have IEP’s stating they may not participate). • Number the remaining names of students on the list • Use the random number sheet to select students, starting with column one and working down. • The table provided works for classes of up to 350. For larger classes, obtain a larger random number table from SREB. • Add student names to the roster until you have the appropriate number.

  41. Random Sampling Demonstration: Option #2 – Excel • Develop a list of all eligible students (delete names of students who moved or have IEP’s stating they may not participate). • Number the remaining names of students on the list. • Copy your student list into Excel. • Type =RAND() into each cell of the column to the right of the student names. This command will insert a random number in that cell. • Use the Excel sort function to sort your list into random order.

  42. OHIO CAREER CENTERS – Identifying Students When Home Schools Are Also Participating • Career Center selects random sample. • Home School selects random sample. • Center and home school should compare lists to see if any students were double-selected. • If no students were double-selected, proceed as usual. • If students were double-selected, students should assess at the school where they take their senior academic courses. • Call ETS (Lisa Rion – 609-734-5646) to obtain a special code. • Enter that special code on all double-selected students’ answer documents. Their results will go into both reports.

  43. Preparing for the Assessment Complete the Student Roster - VERY IMPORTANT!! • Fully complete form including assessment answer document ID numbers. • File with school testing records for five years! Also give one copy to principal. • You will need this fully completed roster form in Spring 2013 to conduct the follow-up survey of graduates • Also needed to identify students who fail to include their names (for student reports and awards)

  44. Student Roster

  45. Preparing for the Assessment Notification • Notify students, parents and teachers • Provide information on assessment and/or schedule informational meeting • Refer to your Board of Education policy where applicable Scheduling • Schedule time and place (SREB recommends administering over 2-3 days) • Include make-up sessions • Identify assistants (follow recommended ratios)

  46. Preparing for the Assessment Course-Taking Preparation • Work with department chairs to complete course-matching chart (may update previous work) • Prepare student transcripts (including Fall grades and Spring schedule)

More Related