1 / 71

Preparing for the 2014 HSTW Assessment

Preparing for the 2014 HSTW Assessment. Diane Jamieson & Karen Johnson HSTW Northeast Ohio. What is the HSTW Assessment? Administration Nuts & Bolts Best Practices for Successful Assessments. Topics Covered. What is the HSTW Assessment?. Required in even-numbered years

loe
Download Presentation

Preparing for the 2014 HSTW Assessment

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Preparing for the2014HSTW Assessment Diane Jamieson & Karen Johnson HSTW Northeast Ohio

  2. What is the HSTW Assessment? Administration Nuts & Bolts Best Practices for Successful Assessments Topics Covered

  3. What is the HSTW Assessment? • Required in even-numbered years • Subject tests in Reading, Mathematics and Science based on NAEP frameworks • Student Survey • Course-taking patterns • School and classroom experiences • Teacher Survey • Provides schools with comprehensive school-level data breaking out student achievement by experiences

  4. Examples of How Schools Use the Results • Identify improvement needs • Serves as basis for Site Review Process (SRP) • Gain support for school improvement • Engage the entire faculty in school improvement • Set priorities and goals for school improvement • Improve classroom practices

  5. New for 2014 • There will be no individual Student Reports!

  6. Five Components • Reading test • Mathematics test • Science test • Student survey • Course-taking patterns • School and classroom experiences • Teacher survey (online)

  7. Testing Times • Reading 75 min. • Mathematics 80 min. • Science 55 min. Total 3.5 hours • Student Survey Section 1 - staff person completes Sections 2 & 3 - untimed (about 35-45 min.)

  8. Test Content • Used 2009 NAEP frameworks as a starting point • Modified to reflect college and career readiness goals • Reading – focus on informational texts • Mathematics – topics through Algebra II and some pre-calculus • Science – life, physical and earth science

  9. Reading Test • 75 minutes • 80% informational texts; 20% literary nonfiction • Includes meaning vocabulary • Includes paired texts (to assess critical analysis) • Does not include literary fiction or poetry

  10. Reading Test • Passage length: 500-1500 words • Cognitive targets • 15% locate/recall • 55% integrate/interpret • 30% critique/evaluate

  11. Mathematics Test • 80 minutes • Scientific or graphing calculators permitted for one section • Type of calculator will neither advantage nor disadvantage student • Topics • Pre-algebra through Pre-calculus, including Algebra II

  12. Mathematics Test • Content • 11% - Number Properties and Operations • 29% - Measurement/Geometry • 24% - Data Analysis, Statistics and Probability • 36% - Algebra

  13. Mathematics Test • Cognitive Targets • 50% - Low Complexity recall routine procedures • 45% - Moderate Complexity make connections within mathematics or between mathematics and real world • 5% - High Complexity analyze a problem mathematically

  14. Science Test • 55 minutes • Content • 43% - Life science • 42% - Physical science • 15% - Earth and space science

  15. Science Test • Science Practices • 70% • Identifying science principles • Using science principles • 30% • Using scientific inquiry • Using technological design

  16. Student Survey • Section 1– Course Experience • Staff member should complete this section for each student • Based on Course Matching and Transcript Analysis • Section 2 – School Experience • Students complete this section • School and classroom experiences • Based on HSTW key practices • Section 3 – General Information • Students complete this section

  17. Teacher Survey Online survey! School and classroom experiences • School mission • High expectations and extra help • Guiding and supporting students • Curriculum content and engaging students in learning • Transitions • Leadership and professional growth

  18. Results Reporting • School Report (June, 2014) PDF file on CD • HSTW Award of Educational Achievement (by May 2, 2014) • Student Reports - Discontinued

  19. HSTW Assessment Report Mailed to schools June, 2014 Executive Summary -“3-minute report” • One page summary of performance and implementation Overview -“30-minute report” • Slightly longer summary Full report -“3-hour report” • Tables breaking out achievement by experiences • Teacher survey results

  20. School Report • Executive Summary • One-page snapshot • Graphs and charts • Includes: • Implementation summary • Percentage of students meeting readiness goals: 250, 257, 258 • Percentage of students at each proficiency level • Blank quadrant for state data

  21. School Report • The Overview • Approximately 15 pages • Graphs and charts • Includes: • Mean scores • Percent meeting readiness goals • Percent at each proficiency level • Performance on HSTW indices • More detailed implementation summary

  22. School Reports • Full report • All those tables! • Student achievement broken out by survey questions • Teacher survey results

  23. HSTW Award of Educational Achievement • Award certificates mailed to schools by May 2, 2014 • Awarded to students who: • Meet all three readiness goals (reading 250, math 257, science 258) • Complete at least 2 of 3 HSTW recommended curriculum goals • English/language arts, mathematics, science • Complete a concentration • Career/technical, mathematics/science, humanities

  24. HSTW Award of Educational Achievement

  25. Award of Educational Achievement Opportunities for High Schools • Local community colleges • Local employers • Additional incentives for students

  26. HSTW Assessment AdministrationNuts & Bolts

  27. 2014 Student Assessment and Teacher Survey Window January 24– February 14 (3 weeks) Plan ahead to get the best results!

  28. Conducting the Assessment Process • Ordering – Completed! • Preparing • Administering • Returning materials

  29. Other Ordering Information • You have ordered and will test no more than 60 students. • You will receive extra test sets. However, when submitting scan sheets to be scored, do not exceed the number ordered! • Schools testing more than 60 must pay for each additional student: $44 per student. • A cancellation fee may be charged if you cancel testing or miss the return deadline.

  30. Administration Materials Onlinewww.sreb.org • Test Administration Guide • Sampling Instructions • Student Roster Form • Checklist • Test Description and Sample Question Booklet • Tasks and Timelines • Course Description Guide • Course Matching Chart

  31. Preparing for the Assessment • Administration materials are now available online at: www.sreb.org • Booklets & scan sheets will arrive by January 17, 2014

  32. Tasks & Timeline

  33. Preparing for the Assessment Identify Students for the Assessment • Select one of two options: • RANDOM SAMPLE OF 60 SENIORS - OR - • ALL SENIORS (ENTIRE CLASS) • Select a true random sample by using the instructions provided. You must also select fivealternates at random.

  34. Other Tips for Selecting Students • Only include currently enrolled seniors. • Only exclude students if their IEP exempts them from state assessments. • Same accommodations provided for state assessments should be provided for this assessment.

  35. Other Tips for Selecting Students • Administrator Guide will contain suggested accommodations for English-language learners. • Contact ETS by October 25 to request large-print or audio CD versions . • Be reasonably assured that all students can complete ALL 4 components – reading, math, science, AND student survey.

  36. Random Sampling Options • What is a “random sample”? • What is the easiest way to draw a random sample? • How to use random number tables

  37. Random Sampling • Simple random sample - every time a selection is made, every student on the list has an equalchance of being the one selected. • Selection Bias – anything that contaminates or distorts the process.

  38. What’s the easiest way to select a random sample? • Draw names from a hat, box, bowl, or drum! • Draw until you have selected 60 + 5 names!

  39. Group ActivityRandom Sampling Procedures: Random Number Table • Develop a list of all eligible students (delete names of students who moved or have IEP’s stating they may not participate). • Number the remaining names of students on the list • Use the random number sheet to select students, starting with column one and working down. • The table provided works for classes of up to 350. For larger classes, obtain a larger random number table from SREB. • Add student names to the roster until you have the appropriate number.

  40. CAREER CENTERS and HOME SCHOOLS: How to handle “double-selected” students • Career Center selects random sample. • Home School selects random sample. • Center and home school should compare lists to see if any students were “double-selected” (i.e., randomly selected by BOTH schools). • If a student is double-selected, test the student at the site where he/she takes senior academic courses. • Contact ETS (Lisa Rion – lrion@ets.org 609-734-5646) to obtain a special student code. • Enter that special code on the double-selected student’s answer document. That student’s results will go into both reports.

  41. Preparing for the Assessment Complete the Student Roster - VERY IMPORTANT!! • Fully complete form including assessment answer document ID numbers. • File with school testing records for five years! Also give one copy to principal. • You will need this fully completed roster form in Spring 2015 to conduct the follow-up survey of graduates • Also needed to identify students who fail to include their names (for student reports and awards)

  42. Student Roster

  43. Preparing for the Assessment Notification • Notify students, parents and teachers • Provide information on assessment and/or schedule informational meeting • Refer to your Board of Education policy where applicable Scheduling • Schedule time and place (SREB recommends administering over 2-3 days) • Include make-up sessions • Identify assistants (follow recommended ratios)

  44. Preparing for the Assessment Course-Taking Preparation • Work with department chairs to complete course-matching chart (may update previous work) • Prepare student transcripts (including Fall grades and Spring schedule)

  45. Other Tips for Course-Matching • Get each department head for English, math and science to help with this process. • Include any courses the seniors have taken from grades 9-12 within English, math, science or career-technical areas. • Using the course description guide, match each course from your school’s master schedule to the SREB course title on the course-matching chart. Example from the course-matching guide Regular, Advanced, or College Prep Algebra I: “Algebra I courses include the study of properties and operations of the real number system, evaluating rational algebraic expressions …”

  46. Preparing for the Assessment Receive Assessment Materials • Booklets & scan sheets arrive at site • by January 17, 2014 • Verify contents according to instructions • Keep materials secure (locked)

More Related