Supported by the National Science Foundation under Grant No. EHR-0315060

1. Taking Stock of Our Reform Efforts Are we making a difference and how do we know? Supported by the National Science Foundation under Grant No. EHR-0315060

2. Welcome

3. Why District Action Plans? • A chance for all of us to learn about what works. • Provide data to NCOSP so we can tailor our support to you based on your District Action Plans • Foster ownership and accountability for leading a change effort • Document our work and maintain “audit trail”

4. Take a few minutes to talk in your group about this. How do we know we’re being effective in our work?

5. For Today • Use evaluation of District Action Plans to generate data that will inform us. • Learn: • Link between goals and actions • How to apply simple evaluation strategies • Learn what other districts are doing – share successes/seek support

6. You will come to look at your District Action Plan through the lens of evaluation. • The partnership is looking at the District Action Plans as a way of collecting data on the excellent work you are doing. • So we can actually collect this data, please fill out the Report Form.

7. Roles • Assign • Facilitator • Timekeeper • 2 recorders • One for Chart • One for report form

8. Where are we now? D-YTD-? (The Adaptive School page 116) On Chart Paper and on Report Form: 1) Write one goal that has activities listed to be performed between September and December 2) As a group, complete D-YTD-? columns with activities

9. Work time - Taking Stock • As a group, identify one or two actions that are of greatest importance. • You have two minutes

10. Knowledge, Skills, and Attitudes Goal: Increase teacher and administrator understanding of the findings from How People Learn.

20. Individual Reflection:(4 minutes)What are the underlying Knowledge, Skills, or Attitudes you hope your activities will develop?

21. Work time • Reflect as a group and write the Knowledge, Skills and Attitudes you hope to influence with your activities. • Record your work on chart paper and the Report Form.

22. What is the “right work”? • Clarity of knowledge, skills, and attitudes we hope to affect. • With this clarity, we can make sure our goals define the “right work” (Garmston). • Once we know the “right work”, we can develop monitoring and evaluation efforts that collect the “right data”

23. Does your Goal express what you hope the sum of your Actions will achieve?

24. For example:

25. For example:

26. For example:

27. For example:

28. For example:

29. Work time – Revisit goals • Adjust and apply this work to your goals as necessary. • Please enter on your chart paper and on your Report Form

30. Evaluating our performance • Acknowledging the link between KSA and Evaluation

31. Tools for evaluating effectiveness of District Action Plans • Five methods of data collection • Surveys • Interviews • Observations • Tests • Documentation Reviews

32. How do you decide which method to use? • Points to consider: • What evidence is embedded in your project? • How will you measure change? • Who will comprise your sample? • Triangulation of methods and sources.

34. Work Time • What methodologies are best suited to meeting your goal? • Record on chart paper as well as on Report Form

35. Getting the data you need Developing Good Questions 1) Be clear on the underlying purpose of the question 2) Make sure the questions themselves are clear

36. Clear Purpose • Example Goal: Increase teacher and administrator understanding of the findings from How People Learn. • What data do we want to collect? • Teacher and administrator understanding of the principles • Change in practice

37. Clear Question? “How satisfied are you with the PD on How People Learn and with the amount of prep-time you get during the school day?” AVOID “double barreled” questions!

38. Clear Question! Instead, ask, • How satisfied are you with the PD on How People Learn? • How satisfied are you with the amount of prep-time you get during the school day?

39. Clear Question? "How many science projects did you assign to your students over the past six months?" Avoid ambiguous wording!

40. Clear Question! Instead, ask, “Circle how many of the following project types you assigned to your students over the past six months.”

41. Clear Question? “To what extent are you knowledgeable about common student misconceptions related to phases of the Moon?”

42. Clear Question! “To what extent are you knowledgeable about common student misconceptions related to phases of the Moon?” This is an appropriately worded question.

43. Clear Question? "What have you done to get more teachers in your building to integrate the learning principles from HPL in their classes?" Avoid “Leading questions”

44. Clear Questions Instead, ask, “Have you taken an active role in encouraging your teachers to integrate the learning principles from HPL in their classes?” “If yes, what practices have you employed to bring that end about?”

45. Work time • Choose one method you have identified for collecting data. • Develop one or two good questions to use in that method • Record on chart paper as well as on Report Form.

46. Gallery Walk • Find a district with similar KSA to yours • Identify actions they are taking • Identify evaluation strategies • Find someone from that district and talk with them about commonalities/ differences • What support can you give one another? • Use this chance to enhance your professional learning community

47. Work time • Continue the work from this morning – apply to the other goal(s) in your District Action Plan

48. Evaluating today • Next Learning Community Forum is December 8th