Teacher Effectiveness

1. Teacher Effectiveness Emma Klimek Emma Klimek 2012

2. To download to your device: Emma Klimek 2012

3. Housekeeping • Parking • Breaks and Lunch • Non-Smoking policy • Fire exits and emergencies Emma Klimek 2012

4. Updates and news • APPR must be approved by the Commissioner of Education Emma Klimek 2012

5. HEDI Criteria: Post “agreement” HEDI Criteria: Previous to “agreement” Emma Klimek 2012

6. Assessments changes • It is no longer required to use a 3rd party assessment for 6-8 social studies and science • “Individual teacher developed” assessments are not permitted • All assessments, including State assessments, are permitted for the “2nd 20%” or local assessment portion of the APPR, but they must be used differently (a different metric) Emma Klimek 2012

7. Other • It is not permissible to use “school wide/group or department wide” for 6-8 science or social studies or any course in the high school with a Regents. • Classroom observations must be at least 31 out of 60 points; previously it was 40 out of 60 points Emma Klimek 2012

8. Other information • For the 2nd 20 percent group/team/school wide measures may use third party assessments or a district/BOCES/regional assessment unlike the 1st 20% • The growth percentile that the state provides may be combined across grades and subjects for the teacher and principal. • Student population for SLOs are set on BEDS day Emma Klimek 2012

9. A third party assessment that is not on the SED approved list may not be used for the purpose of APPR even if a District is willing to certify to its comparability and rigor Emma Klimek 2012

10. Attendance You may NOT use attendance as a factor in your SLO. All enrolled students must be included in the calculation. All students in the course sections subject to an SLO must be included in the SLO. Students may not be excluded from a course they are enrolled in based on poor attendance (this applies to both State Growth and locally-selected measures). Emma Klimek 2012

11. http://www.governor.ny.gov/BuildingaNewNY/TeacherEvaluationTrackerhttp://www.governor.ny.gov/BuildingaNewNY/TeacherEvaluationTracker Emma Klimek 2012

12. Examining Examples of SLOs Emma Klimek 2012

13. Activity 1: Examine examples • There are 5 examples of SLOs • Spanish exemplar • One reading specialists • One Special Education • One grade 1 math • 9th grade Social Studies Rubric • Please complete the reflection guide for two samples at each table Emma Klimek 2012

14. Measurement Options Emma Klimek 2012

15. Measurement Options for Assessments • Raw Score • Assumes that the pre test and the post test have a relatively equal distribution of item difficulty • Easy to calculate • Scale Score/Percentiles/Stanines • Not an equal interval unit • Does not lend itself to arithmetic operations • Can use as a target point • Percentages • Assumes that the pre and post assessments are comparable Emma Klimek 2012

16. Measurement options for Assessment • Cut points/benchmarks/levels of proficiency • Should be research based • May need to identify these points Emma Klimek 2012

17. Examples of Metrics Locate the examples of metrics Emma Klimek 2012

18. Raw Score to Raw Score • DIBELS Oral Reading Fluency grade 1 to DIBELS Oral Reading Fluency grade 2 • Score at end of grade 1 = 35 words per minute • Score at end of grade 2 = 90 words per minute • District/Regional/BOCES developed assessment for Social Studies grade 7 and 8 • Social Studies Grade 7 = 45 raw score points (from short answer and DBQ rubrics etc.) • Social Studies Grade 8 = 65 raw score points Emma Klimek 2012

19. Percentile • AIMSweb for Math • Grade 1 = 50th percentile • Grade 3 = 55th percentile Emma Klimek 2012

20. Percentage • District/Regional/ BOCES developed assessment for science grade 6 and grade 7 • Grade 6= 75% • Grade 7 = 80% Emma Klimek 2012

21. Scale Score • Stanford Achievement Test • Grade 6 science= 568 • Grade 7 science= 650 • State Assessment in Science • Grade 8 State Science Assessment= 670 scale score • Living Environment Regents = 80 scale score Emma Klimek 2012

22. Vendor Driven Scaling • Fountas and Pinnell Book Level Scales • First Grade = G • Second Grade = M Emma Klimek 2012

23. Practice on Metrics Emma Klimek 2012

24. Practice on Converting to HEDI and 0-20 • Locate the practice sheet “Measurement 1 Problem” • At your tables discuss where you might begin to solve this problem • The group will solve this problem together Emma Klimek 2012

25. Activity: Scaling a Metric • Grades 1 and 2 use Percentile Metric for measuring math (use handout “Grade 1 scores”) • Determine the targets • Determine the HEDI criteria for grade 2 • Determine the 0-20 points for grade 2 • Use HEDI scoring sheet Emma Klimek 2012

26. Activity: Scaling a Metric • Grades 6 and 7 use a “percent correct” assessment for social studies • Here are the scores for grades 6: • Student 1= 55 Student 2=65 Student 3=74 • Student 4= 72 Student 5=77 Student 6=82 • Student 7=77 Student 8=88 Student 9=84 • Student 10- 67 Student 11=76 Student 12=89 • Student 13=92 Student 14=83 Student 15= 86 • Student 16= 73 Student 17= 94 Student 18=99 • Student 19=81 Student 20= 87 Student 21=77 • Determine a target • Determine HEDI and 0-21 scoring for grade 7 target • Use HEDI scoring sheet Emma Klimek 2012

27. Lunch Emma Klimek 2012

28. The “Second 20%” • How can you use the same assessments in a different way? • What are the ways to measure student achievement” • Growth • Individual student growth • Group growth • Status • Percent achieving a certain status • Mean or median group calculation Emma Klimek 2012

29. Activity: Different ways to measure student achievement • As a table, construct a scenario where individual student growth is measured • As a table, construct a scenario where group growth is measured • Use Science 8 to Living Environment Emma Klimek 2012

30. Planning Chart Emma Klimek 2012

31. Where do I start? • Planning chart • Determine the groups you have (teacher assignment groups) • Then complete district assessment inventory chart so that you can determine which assessments you need and/or purchase or develop • Determine the metrics to be used • Then analyze HISTORIC data so that rigorous but achievable targets are set • Determine HEDI • Determine 0-20 • Consider what to propose for the “second 20%” Emma Klimek 2012

32. True North Logic: Software to collect observation evidence linked to a rubric Emma Klimek 2012

33. TLS Evidence Rubric Element 2 Emma Klimek 2012

34. Evidence is a Factual Reporting of EventsElement 2 • It includes teacher and student actions and/or behaviors • Teacher presented the content from the front of room. • It includes statements made and questions posed by the teacher and the students • “Bring your white boards, markers and erasers to the carpet and sit on your square.” • It includes artifacts prepared by the teacher, students, or others. • Task cards, journals, lesson plans, etc.] • It includes quantifiable information about time, student participation, resource use, etc. • 9:14 – 9:29- Warm-up. 8 of 22 Ss finished at 9:20, sat still until 9:29 • It includes an observed aspect of the environment • Desks were arranged in groups of four Emma Klimek 2012

35. Rubric Priorities: Part IElement 4 • All rubrics have priorities – the foundational concepts upon which the criteria are built • Understanding the priorities of the approved rubric to evaluate teacher practice is essential to the observation process. • Review the Priorities of NYSED Approved Rubrics document • What are the priorities of the rubric chosen by your district? Emma Klimek 2012

36. Training Platform • For training purposes we will be using a platform developed by True North Logic • Please log on to the following site: • http://engage.truenorthlogic.com Emma Klimek 2012

37. Log-In Enter your user name Click to Log-In Enter your password Emma Klimek 2012

38. Welcome to the Home Page Select “Observations:” Emma Klimek 2012

39. Starting the Observation Select the rubric Select the teacher Emma Klimek 2012

40. Emma Klimek 2012

41. Emma Klimek 2012

42. Thank you eklimek@optonline.net Emma Klimek 2012