Illinois report cards Advisory Committee Meeting

1. Illinois report cards Advisory Committee Meeting July 11, 2011

2. Agenda • Review "one-pager" report card • Share update on focus groups – schedule, coverage • Discuss additional areas for development of report card • Align on next steps

3. Kicking off the refinement and validation phase March -June July-August September-October Development Refinement and validation Legislation preparation Define report card vision, approach Evaluate link to education strategy and inputs for any evolution of strategy Input to legislation Strategic approach Analysis and benchmarking Assess current IL evaluations and map data sources Benchmark report cards across country, research best practices Develop calculation rubrics Cost benefit analysis1 Stakeholder engagement 1-1 and small group discussions with Advisory Comm. members, other stakeholders in education community2 Principal, teacher, administration focus groups Family, community, student focus groups Implementation support Plan for implementation (roll out schedule, comm. plan) & use to improve school perf. Outline potential research to assess usage, impact of report card Deliverables Beta version of report card Input to legislation Calculation rubrics Implementation plan Report card vision Link to education strategy Alpha version of report card P-20 ACM P-20 Legislature Key meetings 1. For new metrics. 2. List of interviewees included in appendix We are here

4. Report cards Recap: Three guiding questions for report cards to address 1 Are students achieving quality outcomes? Are students making progress toward quality outcomes? Is the school/district environment conducive to enabling quality outcomes and progress? 2 3

5. Report cards Alpha version of high school report card developed for testing in focus groups To be pulled from climate survey 1. Metrics being considered – ACT/SAT scores, undergrad university caliber, in-field teaching, emergency/provisionally certified

6. Report cards Alpha version of middle school report card developed for testing in focus groups To be pulled from climate survey 1. Metrics being considered – ACT/SAT scores, undergrad university caliber, in-field teaching, emergency/provisionally certified

7. Report cards Alpha version of elementary school report card developed for testing in focus groups To be pulled from climate survey 1. While under construction, recommend including '% of Kindergarteners who experienced preschool' on elementary school report card cover page as a context characteristic. 2. Metrics being considered – ACT/SAT scores, undergrad university caliber, in-field teaching, emergency/provisionally certified

8. Agenda • Review "one-pager" report card • Share update on focus groups – schedule, coverage • Discuss additional areas for development of report card • Align on next steps

9. Focus groups Focus groups being held across IL with various stakeholders Targeting principals, administrators, teachers in July; Families, community, students in August Focus group approach • Aiming for broad geographic representation • Targeting North, South and Central Illinois • Ensuring inclusion of different locales – i.e. rural, suburban and urban • Staggered start of stakeholder groups • Will refine report card prior to parent focus groups based on principal, administrator, teacher input • Focus group structure • Ideal focus group size is 5-8 participants (maximum of 10-12 participants) Principals, administrators July Principals, administrators Principals, administrators, teachers Principals, administrators, teachers Families, community, students Families, community, students August Families, community, students List of facilitator materials in appendix; Facilitator trainings in progress, weekly timings offered

10. Focus groups Planned focus groups provide broad geographic coverageContact focus group lead team to volunteer to lead additional discussions Focus group lead team • Principals and administrators • Mike Jacoby • Max McGee • Teachers • Amy Alsop • Larry Frank • Sue Walter • Families, parents and community • Kathy Ryg • Deb Strauss • Students • Through schools: • Mike Jacoby, Max McGee • Through community groups: Kathy Ryg, Deb Strauss Administrators/Principals Families/Communities Teacher focus group planning in progress – aiming to provide broad geographic representation Families, parents and community group planning to target student.

11. Focus groups Focus group discussion aimed at gathering detailed feedback from key stakeholders Focus group design based on commercial client experience from BCG Center for Consumer Insight.

12. Agenda • Review "one-pager" report card • Share update on focus groups – schedule, coverage • Discuss additional areas for development of report card • Align on next steps

13. Several activities running concurrent with focus groups Ongoing activities Path forward • Report card rubrics • Analysis for peer sets and teacher qualification metric • District report card • Detailed report • Cost benefit analysis • To be discussed today • Developing sample peer sets based on geography and demographic characteristics • Analyzing teacher characteristics (e.g. ACT/SAT, undergrad university, in-field teaching, emergency/provisional certification) vs. school growth measures1 • To be discussed today • Gathering and prioritizing metrics based on committee discussions, interviewees and benchmarking • Interviewing data, platform experts on feasibility of potential design • Performing analysis for metrics currently not available to ISBE 1. Utilizing CPS value-add data for analysis.

14. Report card rubrics Given varied purposes of rubrics, recommend legend and calculation methodology for each report card Primary audience Purpose Definition Families Data analysts, administrators and teachers • Aid comprehension of report card • Detail metric calculations so metrics are: • Reported consistently across schools • Fully understood by those using/ interpreting data • Defines metric with words in simple way • Explains why metric is important • 1 page in total • Defines math calculation (i.e. equation) • Provides details on inclusions/ exclusions • Lists source and any other important notes • 1 page per metric Report card legend Calculation methodology For ACM discussion: Any metrics of particular interest for focus group feedback?

15. Report card rubrics For discussion: High school report card legend (I)Any metrics of particular interest for focus group feedback?

16. Report card rubrics For discussion: High school report card legend (II)Any metrics of particular interest for focus group feedback?

17. District report cards Suggest four guiding questions for the district report card 1 • Are students achieving quality outcomes? • Are students making progress toward quality outcomes? • Is the school/district environment conducive to enabling quality outcomes and progress? • Is the district providing resources and leadership to enable quality outcomes and progress? 2 3 4 New question Do you agree with the additional guiding question?

18. District report cards District report card v0 includes 19 metricsElementary, high school district cards will be school level roll-up and 'Resources & Leadership' 1. Interim metric until results from Kindergarten Individual Development Survey ('KIDS') available. Note: In 2010, there were 389 unit districts, 379 elementary districts, and 100 high school districts. Bold = adjusted or new metrics

19. District report cards District report card v0 excludes some metricsFrom student/ teacher attendance and middle and elementary report cards Do you agree with these exclusions? 1. Made explicit decision to include 3rd grade math / reading state test performance as district 'on track' metric given research supports metric as key indicator of future success.

20. Agenda • Review "one-pager" report card • Share update on focus groups – schedule, coverage • Discuss additional areas for development of report card • Align on next steps

21. Way forward • The next Steering Committee meeting is on August 17th from 9am to 11am • Discuss focus group feedback • Align on teacher qualification metric and peer sets • Align on detailed report • Discuss cost benefit analysis • Next steps • Refine report cards and legends with focus group input • Continue calculation methodology development • Continue detailed report development • Analysis: Peer comparison, teacher qualification, cost benefit • Conduct check-ins with Focus Group Lead Team as needed • Prepare P-20 Council meeting presentation