640 likes | 647 Views
This guide provides information on utilizing NECAP reports and support materials to enhance educational outcomes. It covers involvement of local educators, basics of test design, educational rights, types of reports, and fun activities with student level reports. Access helpful resources online!
E N D
New England Common Assessment Program Guide to Using the October, 2006 NECAP Reports: Companion PowerPoint Presentation February 2007
Welcome and Introductions Mary Ann Snider Director of Assessment and Accountability RI Department of Education
Welcome and Introductions Measured Progress Service Center: 1-877-632-7774
Purpose of the Workshop • To assist schools and districts in using the variety of reports and support material issued by the NECAP states in conjunction with the release of results • To provide school and district personnel an opportunity to ask questions regarding the reports and support materials
Involvement of Local Educators • Development of Grade Level Expectations • Test Item Review Committees • Bias and Sensitivity Review Committees • Classroom Teacher Judgment data • Standard Setting Panelists • Technical Advisory Committee
Basics of Test Design • Fall test – previous year’s GLEs • Reading and Mathematics – grades 3-8 • Writing – grades 5 and 8 • Variety of Item Types • Reading: multiple choice and constructed response • Mathematics: multiple choice, short answer (one point), short answer (two points), and constructed response • Writing: multiple choice, constructed response, and extended response • Common and Matrix Items
Two Basic Types of Educational Tests • Norm-Referenced: What is the student’s status or rank in a designated group? • Criterion or Standards-Referenced: Has the student learned the skills or achieved the standard? NECAP is a Standards-Referenced Test
Family Educational Rights and Privacy Act The Family Educational Rights and Privacy Act (FERPA) • Access to individual student results is restricted to: • the student • the student’s parents/guardians • authorized school personnel • Superintendents and principals are responsible for maintaining the privacy and security of all student records. • Authorized school personnel shall have access to the records of students to whom they are providing services when such access is required in the performance of their official duties. • FERPA website: http://www.ed.gov/policy/gen/guid/fpco/ferpa/index.html
National Council on Measurement in Education www.ncme.org
Questions and Answers Questions about the purpose of the workshop and/or NECAP background?
Rhode Island Results Suburban Urban Fringe Urban
Rhode Island Results * Indicates that gain exceeds the gain made by all students
Types of Reports • Student Report • Item Analysis Report • School/District Results Report • School/District Summary Report • District Student Level Data Files
Student Report • Two copies mailed to the school: • color copy for parents/guardians • black and white copy for local use • Dual sided: text side and data side • Spanish version of the student report available on the RIDE website for the Office of Assessment and Accountability
Fun with Student Level Reports! • Review to be sure you have a student report for every student tested in October, 2006. • Prepare a letter to provide your interpretation of the results for your school and/or district. • Be sure teachers are prepared and comfortable discussing individual student results with families; including any instructional interventions. • Use your district data file to analyze growth between students you had last year and this year.
Questions and Answers Questions about the Student Report?
Teaching School vs. Testing School • Rationale • Inclusion of students in “Teaching Year” reports
Teaching School vs. Testing School Schools Can View Reports for Testing Year (2006-07)
Teaching School vs. Testing School Or Teaching Year(2005-06)
Teaching Year (accountability) Testing Year(released this month)
Item Analysis Report • Available to schools and districts on-line • These reports are confidential and the website is password-protected. • One per content area • Use in conjunction with Released Items documents
Grade 5 2006 Released Mathematics Item DOK: 3 GLE: DSP 4.1
Grade 5 Practice Test Item (page 4) DOK: 2 GLE: DSP 4.1
Fun with Released Support Materials! • Build practice tests • Share writing samples as models • Mock scoring sessions to calibrate teacher judgments • Compare released items (GLE and DOK) with classroom instruction and assessments and student work. • Map instruction and scaffolding practices to items based on student performance.
Released Item Documents • RIDE website at: http://www.ride.ri.gov/assessment/NECAP.aspx • New information provided in the Released Item Support Materials documents includes: • For all content areas, providing the multiple-choice items and the GLE code and text that each item is linked to • For math, indicating which items were included in session 1 of the math test by adding a “no calculator” symbol above the items • For reading, listing the passage name and type of text • For writing, listing passage name and mode of writing
Questions and Answers Questions about the Item Analysis Report or the Released Item documents?
School/District Results Report • Available on-line at the Measured Progress website • Separate report for each grade level tested • District report contains no individual school data
Please note: You must always log in through this page to view confidential reports and data New this year
Grade Level Summary Report • Page 2 of the NECAP School/District Results Report • Summary of participation and results
Fun with Grade Level Summaries! • Review last year’s grade level summary report with this year’s • If gains were made, identify what strategies, interventions, and programs may have worked • If no progress was made, hypothesize why and what can be done at the school or district level to help students make progress • Identify where your results differ from the district and state results. Hypothesize why they may differ
Questions and Answers Questions about the Grade Level Summary Page?
Historical Data • Data is included for two years and is combined in the Cumulative Total row • In the Cumulative Total row for the achievement level columns: • The N columns are summed • The % columns are found by dividing the total number of students in the level by the total number of students tested • The Mean Scaled Score column is a weighted average
Comparisons of NECAP Scores Across Years • School and District-Level Scaled Scores and Achievement Levels • Student-Level Scaled Scores and Achievement Levels • Content Area Subscores
Content Area Results • Pages 3, 5, and 7 of the NECAP School/District Results Report • Provides information about achievement in subtopics of tested content areas