Guide to Using the 2006 NECAP & NH-Alternate Reports: Companion PowerPoint Presentation

1. New Hampshire Alternate Assessment New Hampshire Statewide Assessment Guide to Using the 2006 NECAP & NH-Alternate Reports: Companion PowerPoint Presentation February 2007

2. Agenda • Introductions • NHDoE Updates • Background • NH-Alternate Assessment Reporting • Short break • NECAP Reporting

3. New Hampshire Alternate Assessment Welcome & Introductions

4. New Hampshire Alternate Assessment Welcome & Introductions Measured Progress Service Center: 1-877-632-7774 Measured Progress Offices: 1-800-431-8901

5. Tim Kurtz Director of Curriculum and Assessment Phone: (603) 271-3846 E-Mail: TKurtz@ed.state.nh.us Gaye Fedorchak Alternate Assessment Coordinator Phone: (603) 271-7383 E-Mail: GFedorchak@ed.state.nh.us Susan Morgan - ELL Access Specialist Phone: (603) 271-3719 E-Mail: SMorgan@ed.state.nh.us Carol Angowski Assessment Program Specialist Phone: (603) 271-8392 E-mail: CAngowski@ed.state.nh.us Linda Stimson - ELA Coordinator Phone: (603) 271-2035 E-mail: LStimson@ed.state.nh.us Rich Andrusiak - Mathematics Coordinator Phone: (603) 271-3844 E-Mail: RAndrusiak@ed.state.nh.us Jan McLaughlin - Science Coordinator Phone: (603) 271-3856 E-Mail: JMcLaughlin@ed.state.nh.us Ken Relihan - Social Studies Coordinator Phone: (603) 271-6151 E-mail: KRelihan@ed.state.nh.us Deb Fleurant - Bias and Sensitivity and Title I Phone: (603) 271-3838 E-mail: DFleurant@ed.state.nh.us New Hampshire Alternate Assessment NHDoE Contacts http://www.ed.state.nh.us/assessment

6. Update: High School Assessment Assessment NECAP Piloted Reading, Math, and Writing in November No student, school, or district scores will be produced First operational test – October 2007 NH-Alt 2006-2007 Grade 10 portfolios in Reading, Mathematics, and Writing 2007-2008 In addition to above, Grade 11 portfolios in science Accountability Schools – AYP based on Graduation rate only Districts – AYP based on May 2006 NHEIAP and 2005-2006 Alt

7. Update: Science Assessment Assessment NECAP Pilot Science May 14-24, 2007 Two Sessions – about 90 minutes each No student, school, or district scores will be produced First operational test (three sessions) – May 2008 Workshops during the week of April 30 – May 4 NH-Alt Grade 11 Science Portfolios will be added in school year 2007-2008 Accountability None at this time, but NCLB reauthorization proposals include it starting in school year 2007-2008.

8. Update: Student Demographic & Assessment Data i.4.see Workbench • Hub for district submitted student level data • Many new build-it checks on submitted data i.4.see Dashboard • Check summative student demographic files that affect AYP • Ability to change incorrect data • Notice will go to Superintendents, Special Education Directors, i.4.see coordinators, and Principals • Hope to go live on Monday, February 12, 2007 • Deadline on changes has not been set yet Follow the Child Assistance Center • Phase I – April/May • Phase 2 – early summer New

9. Updates Any questions about Updates?

10. New Hampshire Alternate Assessment Purpose of the Workshop • To assist schools and districts in using • the variety of NH Statewide Assessment • reports and support material in conjunction • with the release of results • To provide school and district personnel an • opportunity to ask questions regarding the • reports and support materials

11. New Hampshire Alternate Assessment Local Educator Involvement • Development of Grade Level Expectations (NECAP) • Development of Alternate Achievement Standards Linked to Grade Level Expectations (NH-Alt) • Test Item Review Committees (NECAP) • Bias and Sensitivity Review Committees (NECAP) • Classroom Teacher Judgment Data (NECAP) • Standard Setting Panelists (NECAP and NH-Alt) • Technical Advisory Committee (NECAP and NH-Alt) • NH-Alt Advisory Task Force (NH-Alt)

12. New Hampshire Alternate Assessment Test Basics When: • NECAP: Oct 2006 • NH-Alternate: School year 2005-2006 What: • Reading and Mathematics – • NECAP: Grades 3-8 (tests previous year’s GLEs) • NH-Alt : Grades 2-7, 10 (tested during instruction last year) • Writing – • NECAP: Grades 5 & 8 (tests previous year’s GLEs) • NH-Alt: Grades 4 & 7 (tested during instruction last year)

13. New Hampshire Alternate Assessment Basics of Test Design NECAP Variety of Item Types • Reading: multiple choice and constructed response • Mathematics: multiple choice, short answer 1 point, short answer 2 points, and constructed response • Writing: multiple choice, constructed response, and extended response Common and Matrix Items • Common items used to generate student scores • Matrix items used for equating and field testing

14. New Hampshire Alternate Assessment Basics of Test Design NH Alternate Portfolio Assessment: What is an “Item” in NH-Alt? • In each content area, two standards-based targeted skills are identified that address student learning needs • Baseline data are collected for each targeted skill • Work samples are gathered over the course of the year to show how the student is progressing on these two targeted skills • The collection of work samples and data presented in the portfolio are scored as a single item • Progress data and student work samples are collected across the school year (Sept – April) on each targeted skill as the student is learning the skill. Reading: 2 Targeted Skills Mathematics: 2 Targeted Skills, Writing: 2 Targeted Skills

15. New Hampshire Alternate Assessment Basics of Test Design NH Alternate Portfolio Assessment Targeted skills are represented by a variety of work samples collected over the course of the year. • Collections include multiple samples of actual student work, which typically show the student solving problems in many ways, i.e. multiple choice responses, short answer responses, and longer responses that look similar to constructed response problems. Responses often involve use of manipulatives, communication systems, or other instructional technology. • Authentic classroom constructed response and short answer tasks provide the best methods for allowing students with severe disabilities to show their work in the way they are able to produce it. • Provides richer evidence of access to standards-based content and student progress.

16. New Hampshire Alternate Assessment Types of Educational Tests • Norm-Referenced: What is the student’s status or rank in a designated group? • Criterion-Referenced (Standards-Based): Has the student learned the skills or achieved the standard? Both NECAP and NH Alternate Assessments are Criterion-Referenced Tests.

17. New Hampshire Alternate Assessment Questions and Answers Questions about the purpose of the workshop or NECAP or NH-Alternate background?

18. New Hampshire Alternate Assessment Basics of Test Design • Student Report (Confidential) with Information for Parents and Report Interpretation Guide • Student Roster Report (Confidential)School and District levels by student • District Student Level Data Files (Confidential) • Disaggregated Results by Content Area: (Public) School, District, & State reported separately for each grade • State Summary Reports (Public) • NH-Alt Students included in NECAP reports as “NT-Approved”

19. New Hampshire Alternate Assessment

23. New Hampshire Alternate Assessment NH-Alt Achievement Levels • Names of Achievement Levels are the same as in NECAP - Level 4: Proficient with Distinction Level 3: Proficient Level 2: Partially Proficient Level 1: Substantially Below Proficient • But - describe performance of grade-linked standards-based skills reduced in depth, breadth, and complexity for the student.

24. New Hampshire Alternate Assessment NH-Alt: Two Scoring Dimensions • 1. The Performance Dimension – • Most heavily weighted in score and includes: • Student Progress (from start of year baseline) • Connections and Access to the General Curriculum (Student work samples must show linkage to grade-level content at reduced level of depth, breadth, complexity)

25. New Hampshire Alternate Assessment NH-Alt: Two Scoring Dimensions • The Program Dimension - • Less heavily weighted in scoring, and includes: • Generalized Performance (Student uses skill across different settings and situations) • Self-Determination (Student attempts to self direct and monitor work) • Supports (Does level of assistance provided support growth of independence and match student need?)

26. New Hampshire Alternate Assessment Sample Portfolio Score Calculation

27. New Hampshire Alternate Assessment Raw Score To Achievement Level Conversion Chart

28. New Hampshire Alternate Assessment Questions and Answers Questions about NH-Alternate Reporting?

29. NECAP: Types of Reports • Student Report • Item Analysis Report • School/District Results Report • School/District Summary Report • District Student Level Data Files

30. Family Educational Rights and Privacy Act The Family Educational Rights and Privacy Act (FERPA) • Access to individual student results is restricted to: • the student • the student’s parents/guardians • authorized school personnel • Superintendents and principals are responsible for maintaining the privacy and security of all student records. • Authorized school personnel shall have access to the records of students to whom they are providing services when such access is required in the performance of their official duties. • FERPA website: http://www.ed.gov/policy/gen/guid/fpco/ferpa/index.html

31. National Council on Measurement in Education www.ncme.org

32. Student Report • Two copies mailed to the school (February 7) • color copy for parents/guardians • black and white copy for local use • Dual sided: Parent Letter & Student Report • Spanish version of Parent Letter and Student Report shell available for NECAP (available at: http://www.ed.state.nh.us/NECAP)

37. Questions and Answers Questions about the Student Report?

38. Teaching School vs. Testing School • Rationale • Inclusion of students in “Teaching Year” reports

39. Teaching School vs. Testing School Schools Can View Reports for Testing Year (2006-07)

40. Teaching School vs. Testing School Or Teaching Year(2005-06)

41. Teaching Year Testing Year

42. http://iservices.measuredprogress.org

43. Please note: You must always log in through this page to view confidential reports and data New this year

47. Item Analysis Report • Available at the school level via password protected website (User ID and passwords sent to Principals and Superintendents in January) • One report for each content area/grade level combination • Issued in both Testing Year and Teaching Year formats • Use in conjunction with Released Items documents