640 likes | 770 Views
New England Common Assessment Program. Guide to Using the October, 2006 NECAP Reports: Companion PowerPoint Presentation February 2007. Welcome and Introductions. Mary Ann Snider Director of Assessment and Accountability RI Department of Education. Welcome and Introductions.
E N D
New England Common Assessment Program Guide to Using the October, 2006 NECAP Reports: Companion PowerPoint Presentation February 2007
Welcome and Introductions Mary Ann Snider Director of Assessment and Accountability RI Department of Education
Welcome and Introductions Measured Progress Service Center: 1-877-632-7774
Purpose of the Workshop • To assist schools and districts in using the variety of reports and support material issued by the NECAP states in conjunction with the release of results • To provide school and district personnel an opportunity to ask questions regarding the reports and support materials
Involvement of Local Educators • Development of Grade Level Expectations • Test Item Review Committees • Bias and Sensitivity Review Committees • Classroom Teacher Judgment data • Standard Setting Panelists • Technical Advisory Committee
Basics of Test Design • Fall test – previous year’s GLEs • Reading and Mathematics – grades 3-8 • Writing – grades 5 and 8 • Variety of Item Types • Reading: multiple choice and constructed response • Mathematics: multiple choice, short answer (one point), short answer (two points), and constructed response • Writing: multiple choice, constructed response, and extended response • Common and Matrix Items
Two Basic Types of Educational Tests • Norm-Referenced: What is the student’s status or rank in a designated group? • Criterion or Standards-Referenced: Has the student learned the skills or achieved the standard? NECAP is a Standards-Referenced Test
Family Educational Rights and Privacy Act The Family Educational Rights and Privacy Act (FERPA) • Access to individual student results is restricted to: • the student • the student’s parents/guardians • authorized school personnel • Superintendents and principals are responsible for maintaining the privacy and security of all student records. • Authorized school personnel shall have access to the records of students to whom they are providing services when such access is required in the performance of their official duties. • FERPA website: http://www.ed.gov/policy/gen/guid/fpco/ferpa/index.html
National Council on Measurement in Education www.ncme.org
Questions and Answers Questions about the purpose of the workshop and/or NECAP background?
Rhode Island Results Suburban Urban Fringe Urban
Rhode Island Results * Indicates that gain exceeds the gain made by all students
Types of Reports • Student Report • Item Analysis Report • School/District Results Report • School/District Summary Report • District Student Level Data Files
Student Report • Two copies mailed to the school: • color copy for parents/guardians • black and white copy for local use • Dual sided: text side and data side • Spanish version of the student report available on the RIDE website for the Office of Assessment and Accountability
Fun with Student Level Reports! • Review to be sure you have a student report for every student tested in October, 2006. • Prepare a letter to provide your interpretation of the results for your school and/or district. • Be sure teachers are prepared and comfortable discussing individual student results with families; including any instructional interventions. • Use your district data file to analyze growth between students you had last year and this year.
Questions and Answers Questions about the Student Report?
Teaching School vs. Testing School • Rationale • Inclusion of students in “Teaching Year” reports
Teaching School vs. Testing School Schools Can View Reports for Testing Year (2006-07)
Teaching School vs. Testing School Or Teaching Year(2005-06)
Teaching Year (accountability) Testing Year(released this month)
Item Analysis Report • Available to schools and districts on-line • These reports are confidential and the website is password-protected. • One per content area • Use in conjunction with Released Items documents
Grade 5 2006 Released Mathematics Item DOK: 3 GLE: DSP 4.1
Grade 5 Practice Test Item (page 4) DOK: 2 GLE: DSP 4.1
Fun with Released Support Materials! • Build practice tests • Share writing samples as models • Mock scoring sessions to calibrate teacher judgments • Compare released items (GLE and DOK) with classroom instruction and assessments and student work. • Map instruction and scaffolding practices to items based on student performance.
Released Item Documents • RIDE website at: http://www.ride.ri.gov/assessment/NECAP.aspx • New information provided in the Released Item Support Materials documents includes: • For all content areas, providing the multiple-choice items and the GLE code and text that each item is linked to • For math, indicating which items were included in session 1 of the math test by adding a “no calculator” symbol above the items • For reading, listing the passage name and type of text • For writing, listing passage name and mode of writing
Questions and Answers Questions about the Item Analysis Report or the Released Item documents?
School/District Results Report • Available on-line at the Measured Progress website • Separate report for each grade level tested • District report contains no individual school data
Please note: You must always log in through this page to view confidential reports and data New this year
Grade Level Summary Report • Page 2 of the NECAP School/District Results Report • Summary of participation and results
Fun with Grade Level Summaries! • Review last year’s grade level summary report with this year’s • If gains were made, identify what strategies, interventions, and programs may have worked • If no progress was made, hypothesize why and what can be done at the school or district level to help students make progress • Identify where your results differ from the district and state results. Hypothesize why they may differ
Questions and Answers Questions about the Grade Level Summary Page?
Historical Data • Data is included for two years and is combined in the Cumulative Total row • In the Cumulative Total row for the achievement level columns: • The N columns are summed • The % columns are found by dividing the total number of students in the level by the total number of students tested • The Mean Scaled Score column is a weighted average
Comparisons of NECAP Scores Across Years • School and District-Level Scaled Scores and Achievement Levels • Student-Level Scaled Scores and Achievement Levels • Content Area Subscores
Content Area Results • Pages 3, 5, and 7 of the NECAP School/District Results Report • Provides information about achievement in subtopics of tested content areas