Utah Performance Assessment System for Students U-PASS Accountability Plan

1. Utah Performance Assessment System for StudentsU-PASS Accountability Plan Judy W. Park Assessment & Accountability Director Utah State Office of Education November 1, 2005

2. U-PASS • Product of Utah Code 53A-1-605, establishing an accountability system for Utah public schools • Uses multiple measures to determine acceptable levels of school performance • Focus is on individual student progress • Includes total school and subgroup accountability • Electronic Report • Disaggregated Assessments & Indicators • Additional Information • Previous U-PASS Report Elements

3. U-PASS Legislation 53A-1-605 (1) …develop a plan to analyze the results of the U-PASS scores for all grade levels and courses required under Section 53A-1-603 and the student behavior indicators referred to in Subsection 53A-1-602 (3) (e).

4. U-PASS Legislation 53A-1-605 2(b) …identify schools not achieving state established acceptable levels of student performance in order to assist those schools in raising their student performance levels.

5. U-PASSAccountability Plan • Student Participation on Assessments • Status Scores • Percentage of students proficient on the collection of assessments and other indicators • Progress Scores • Longitudinal measure based on comparing the achievement levels of the same student from one year to the next

6. U-PASSAccountability Plan • Student Participation • 95% • Acceptable Status Score • 75% • Progress Score • Low 0 – 184 • Medium 185 - 214 • High 215 - 400

7. Schools will be identified as: • Achieved State Level of Performance • Participation is 95% and • Total School Status is acceptable or progress is medium or high AND • Subgroup Status is acceptable or progress is medium or high • Needs assistance • Participation is less than 95% or • Total School Status is not acceptable and progress is low OR • Subgroup Status is not acceptable and progress is low

8. Achieved State Level of Performance

9. U-PASS Accountability Plan • Multiple Assessments & Indicators • English language arts CRT • Math CRT • Science CRT • Direct Writing Assessment • Utah Basic Skills Reading Assessment • Utah Basic Skills Writing Assessment • Utah Basic Skills Math Assessment • UALPA • UAA • Attendance • Graduation Rate

10. Language Arts (35%) ELA CRT (35%) Or ELA CRT (30%) & DWA 5% Science (20%) Science CRT Math (35%) Math CRT Attendance (10%) Elementary/Middle Status and Progress Score

11. Language Arts (30%) ELA CRT (60%) Or CRT 50% & DWA 10% UBSCT reading (25%) UBSCT write (15%) Science (25%) All Science CRT Mathematics (25%) Math CRT & Courses (50%) UBSCT math (50%) Attendance (10%) Graduation rate (10%) High School Status and Progress Score

12. Progress Value Table

13. U-PASSAccountability Plan • Student Participation • 95% • Acceptable Status Score • 75% • Progress Score • Low 0 – 184 • Medium 185 - 214 • High 215 - 400

14. U-PASS Accountability Plan • English Language Learners • Students focus on learning academic English skills first (up to 3 years) • After three years, or when students achieve language proficiency, they become accountable for proficiency on U-PASS assessments

15. ELL Students • 2005 • ELL students (level A and B) in country less than 3 years, CRT and DWA proficiency in U-PASS Accountability Plan • 2006 • ELL students (level A or B) in country less than 3 years, their proficiency on CRT and DWA will be substituted for proficiency on UALPA

16. ELL for U-PASS & NCLB

17. U-PASS Accountability Plan • Students with Disabilities • Five participation options • Standard administration • Accommodations • Modifications • Utah Alternate Assessment – 1% • Additional flexibility – 2% ?

18. U-PASS Accountability Plan Extensive subgroup reporting • Economically disadvantaged • Students with Disabilities • Ethnicity • African American • American Indian • Asian • Caucasian • Hispanic • Pacific Islander • Total Group • ELL proficiency levels A,B,C,D,E • Gender • Migrant • Mobility • Students without Disabilities

19. U-PASS Accountability Plan • Aggregate Subgroup Accountability • Every student who belongs to a subgroup other than white • Individual student proficiencies are added together and divided by the number of students to determine the subgroup proficiency level • Any individual subgroup not meeting proficiency will appear on the front page of the report

20. U-PASS Accountability Plan • Subgroup Status Accountability • Allows greater accountability • Students in a subgroup with less than 10 are now included in the aggregate calculation • Students are more fairly represented • Each student only counts once, regardless of the number of subgroups in which the student qualifies. • Increased reliability • We are evaluating a larger group • More students and more schools are represented • Increased validity • We do not overweight small populations. • This lifts the burden of one subgroup being the sole determinant of unacceptable status of the school.

21. U-PASS Timeline 2004-2006 • 2004 CRT established baseline • 2005 CRT begins progress score • 2005 Status & Progress for all but High School and ELL • UBSCT in effect for 2006 • UALPA implemented 2006 • 2006 Status & Progress for all but HS and ELL progress • UBSCT implemented 2006, progress 2007 • UALPA implemented 2006, progress 2007 • 2007 Status & Progress for all

22. Previous U-PASS Report Elements • School summary information • Student summary information • NRT results by State, District and School • CRTs for the past two years by District and School

23. Previous U-PASS Report Elements

24. Previous U-PASS Report Elements

25. Previous U-PASS Report Elements

26. The 2005 U-PASS Report • Web-based report format • An increased amount of information available on each school • Allows for “drill-down” information

28. 1

29. 2

30. 3

31. Must achieve both criteria

32. Final Result

33. Subgroups Needing Assistance

34. Status “Drill Down”

35. Second Level “Drill Down”

36. Third Level “Drill Down”

37. Progress “Drill Down”

38. Second Level “Drill Down”

39. Additional Reports

40. U-PASS • Additional Information: • NRT • ACT/SAT • AP • Concurrent Enrollment • School Summary Information • Student Summary Information • Percent of student reading on grade level • (reported for grades 1-10) • Dropout Rate (disaggregated by ’08) • Disciplinary Action • Course Taking Patterns and Trends

41. AYP Reports

42. Timeline for U-PASS • December ’05 • U-PASS report available on secure site for 30 day review

43. Timeline for U-PASS • January ’06 • Electronic Report available to the public • 2006 U-PASS Report • Available with AYP?

44. Questions?