Points & Rating System Recommendations May 2012

1. Points & Rating System RecommendationsMay 2012 Prepared by Samuel A. Stephens Center for Assessment and Policy Development

2. The Charge • Recommend points and rating system for QUALITYstarsNY • Principles: • Differentiate levels of quality • Be equitable across settings • Allow all settings to demonstrate strengths • Encourage participation • Achieve higher ratings with reasonable effort • Be easily interpreted

3. Considerations & Assumptions • Stars reflect levels of quality interpreted as: • One star = “meeting minimum standards” • Two stars = “achieving satisfactory quality” • Three stars = “achieving good quality” • Four stars = “achieving very good quality” • Five stars = “achieving excellent quality”

4. Minimum Requirements • To apply to be in QUALITYstarsNY: • Hold valid current license • Operated/Contracted by public school district • Applicants automatically assigned Star 1 • To be rated: • Application for rating/self-study submitted • To be at Star 3 or above: • Sufficient points to be provisionally rated at Star 3 level • ERS score of 4.25 or above

5. Special Conditions • National accreditation: • Be exempted from equivalent standards based on crosswalk between QSNY and accreditation requirements • Head Start/Early Head Start: • If in full compliance with Performance Standards, be exempted from equivalent standards

6. Special Conditions • Sites serving specific population groups or having other special conditions: • Age groups (infants, toddlers, preschoolers) • Children whose home language is not English • Children with special needs • Sites with none of these conditions would need to earn the base number of points (290) before ERS points • Sites with these conditions would be working toward a greater number of total possible points (up to 310) before ERS points

7. Possible Points • Total of 360 possible points • 290 possible points for all sites, before ERS points • Up to 50 possible points based on ERS scores • Up to 20 possible points depending on applicable conditions

8. Distribution of Points by Category

9. Distribution of Points within Categories • Same in all settings: • Learning Environment • Management & Leadership • Different by setting: • Family Engagement • Qualifications & Experience

10. Distribution of Pointsin Learning Environment Category

11. Distribution of Pointsin Family Engagement Category

12. Distribution of Pointsin Qualifications & Experience Category – Management/Administration

13. Distribution of Pointsin Qualifications & Experience Category – Provider & Assistant/Teaching Staff

14. Distribution of Pointsin Management & Leadership Category

15. Conversion of Points to Stars • Star One Level • Valid license or operated by public school • Did not apply for rating OR • Less than minimum points in each category (30 points total) • Star Two Level • Up to 39% of total possible points without ERS OR • 40% or more of total possible points without ERS but ERS < 4.25 • Star Three Level • 40% to 59% of total possible points with ERS and ERS = or > 4.25 • Star Four Level • 60% to 84% of total possible points with ERS and ERS = or > 4.25 • Star Five Level • 85% of total possible points and above with ERS and ERS = or > 4.2

16. Rating Process STEP 3a: If status confirmed, site is assigned to Star 1 level STEP 1a: Site applies to be assigned a Star 1 rating STEP 2a: Site licensure or public school status is confirmed STEP 4: Application for rating is reviewed & number of points in each standards category is computed DECISION POINTS BASED ON REVIEW OF APPLICATION & CALCULATION OF POINTS Site earns at least minimum points needed in all categories STEP 1b: Site applies to begin self-study process; provides information to determine which standards apply including accreditation or HS/EHS compliance status OR Site does not earn minimum points needed in all categories STEP 3b: Site submits application for rating with supporting documents STEP 2b: Site is provided with # points needed at each star level, based on specific conditions Site does not earn sufficient points for provisional Star 3 status or above Site earns sufficient points for provisional Star 3 level or above OR STEP 5a: Site is assigned to Star 1 level STEP 7: Site is assigned to Star 3, 4, or 5 level, based on total points earned STEP 6a: Site develops improvement plans for ERS areas with low scores Site ERS score is 4.25 or higher DECISION POINT BASED ON ERS SCORES STEP 5b: ERS observations are conducted at site STEP 5c: Site is assigned to Star 2 level OR Site ERS score is less than 4.25 STEP 6b: Site is assigned to Star 2 level

17. Recommended Procedures • Application • Confirm licensure status • Confirm total points possible, based on specific conditions • Confirm exempted standards based on accreditation or HS/EHS compliance status • Self-study • Compile documentation re standards • Submit evidence of accreditation, HS/EHS compliance if appropriate

18. Recommended Procedures • Initial review • Determine whether meets minimum points • Determine whether at “provisional” star 3 level • Sites at “provisional” star 3 level • Independent ERS observations conducted • Scores computed • Sites with ERS score at or above 4.25 • Compute total points, including ERS points • Assign to final star level

19. Results from Scenarios • If minimum points in one category & minimum ERS points, but maximum points in all others – sites would be rated at Star 4 level • If minimum points in one category, but maximum points in all others and maximum ERS points – sites would be rated at Star 4 or Star 5 level, depending on which category received minimum points

20. Results from Scenarios • If minimum points in one category, 50% points in all others & minimum ERS points – sites would be rated at Star 3 level • If 50% points in all categories and any number of ERS points (minimum, midpoint, maximum) – sites would be rated at Star 3 level

21. Results from Scenarios • Centers earning 85% of possible points in LE + FE + M&L categories, by combinations of staff qualifications: • BA teacher, CDA assistant: Star 5 • AA teacher, CDA assistant: Star 5 • AA teacher, assistant w/ no credentials: Star 4 • Teacher with NYS certificate, assistant w/ no credentials: Star 4 • CDA teacher, assistant w/ no credentials: Star 4

22. Results from Scenarios • Centers earning 50% of possible points in LE + FE + M&L categories, by combinations of staff qualifications: • BA teacher, CDA assistant: Star 4 • AA teacher, CDA assistant: Star 3 • AA teacher, assistant w/ no credentials: Star 3 • Teacher with NYS certificate, assistant w/ no credentials: Star 3 • CDA teacher, assistant w/ no credentials: Star 3