Self Assessment & Standards Training

1. Self Assessment & Standards Training June 29, July 11 2007

2. Today’s Objectives • Highlight Self Assessment changes • Show how Self Assessment items relate to Standards indicators • Feature key findings from previous Self Assessments and Standards reviews.

3. Traditional Self Assessment Uses • To account for collaborative and strategy implementation. • To guide decision-making. • To answer stakeholders’ questions about collaborative and strategy implementation. • To publicize the work of collaboratives.

4. To guide decision making:Key sectors on collaborative board

5. To answer stakeholders’ questions:Collaborative Governance Type

6. To publicize the work of collaboratives:Dollars leveraged by collaboratives

7. New Self Assessment Uses • To provide data for FCP “outcome” analyses.

8. 77 75 73 HS Graduation (%) Collaborative 71 Formation 1993 69 Collaborative Formation 2002 67 65 1998 1999 2000 2001 2002 2003 2004 2005 Year of Measurement To provide data for FCP “outcome” analyses: High School Graduation Rates Among Early- and Late-Forming Collaboratives

9. New Self Assessment Uses • To provide data to determine collaborative performance in relation to “Family Connection Standards for Excellence in Collaboration and Community Decision-Making.”

10. Why We Have Standards • They are guideposts against which your progress toward full collaboration can be compared: • To help you and your partners acknowledge and celebrate achievements and • To help you and your partners identify areas for potential growth or needing improvement. This benefit is predicated on your earnest appraisal of collaborative accomplishments.

11. Why We Have Standards • They provide evidence that we hold ourselves accountable for implementing core collaboration practices across the state to: • state and local board members, • legislators and • policy makers, to name a few. This benefit is predicated on our ability to make a compelling case that assessments of collaborative performance are credible.

12. “Earnest” & “Credible” • The Self Assessment is a “self-report.” • FCP staff do not systematically monitor collaborative activities so there is no way for us to correct Self Assessment mistakes (aside from site visit findings, to be discussed later.) We do not correct Self Assessment mistakes! • What you submit, including any typos or other inaccuracies, is what will be in the FCP database. We suggest you print and double check your Self Assessment entries before you hit the “submit” button in CIMS.

13. Standards Workgroup Composition • One collaborative coordinator from each region, selected by the region. • FCP staff. • FCP consultants.

14. Standards Workgroup Role Role: To develop and implement the Standards and related documents and procedures. For example, based on Workgroup recommendations: • Standards indicators have been added, deleted or modified. • Self Assessment items have been added, deleted or modified. • The Self Assessment due date was changed from August 15 to August 31, starting with FY 07 report.

15. Self Assessment – Standards Facts & Figures • Just over two-thirds (69%) of the 45 meets Standards indicators are measured by the Self Assessment. • The remainder (31%) are measured by plan and report reviews by FCP, and number of member surveys submitted.

16. Self Assessment – Standards Facts & Figures • Nine (20%) of the 44 proficient indicators are measured by the Self Assessment. • The other 35 (80%) are measured by plan and report reviews, member survey content, and a portfolio of specified collaborative documents.

17. Findings from ‘Meets Standards’ Reviews

18. Findings from Initial ‘Proficient’ Screening, Spring 2007

19. Major Self Assessment Changes This Year • New due date of August 31. • New and modified questions about collaborative development and family engagement. • New question about Medicaid outreach. • New items throughout other Self Assessment questions.

20. Modified Collaborative Development and Family Engagement Question ‘Stems’Self Assessment questions 1a & 3a (p. 7 & 13) • Which collaborative [family engagement] protocols, activities and structures: • werepresent and in useas of June 30, 2007? (NOTE: Does not have to be conducted or updated every year, but must be valid for present year.) • have beenconducted or updated at least once during your collaborative’s current 3-Year Strategic Plan implementation period?

21. Modified Collaborative Development and Family Engagement Question ‘Stems’Self Assessment question 1c (p. 10 & 14) • Which collaborative administration and operation [family engagement] activities occurred at least once or during a portion of the period from July 1, 2006 through June 30, 2007?

22. Modified Collaborative Development ItemsSelf Assessment question 1a (p. 7) • CA27: Fiscal agent(s) with written procedures for: (check all that apply) • compensation & benefits. • purchasing. • contracting. • reimbursement of travel and other expenses. • internal controls. • CA28: Collaborative members know how to access [Family Connection] fiscal agent’s written procedures (see CA27.)

23. Modified Collaborative Development ItemsSelf Assessment questions 1b & 1c (p. 8 & 10) • CA51: Annual/strategic planning committee (or equivalent) with multiple members met regularly. • CA101: Annual/strategic planning (or equivalent) with multiple members occurred in a retreat or other planning session(s).

24. Modified Family Engagement ItemSelf Assessment question 3 (p. 13) • FE1: Assessment of collaborative family support and engagement using a tool such as a survey or focus group.

25. New Question about Medicaid OutreachSelf Assessment question 7 (p. 25) 7. Check the “Medicaid Outreach” activities, if any, conducted in your county and in which your collaborative participated from July 1, 2006 through June 30, 2007. Also indicate the level of collaborative resources allocated for the activities. Use the following codes to complete the “collaborative resources allocated” column below:

26. New items throughout other Self Assessment QuestionsSelf Assessment question 6 (p. 22) • PH8: Health event (examples: health fair, health walk/run)

27. Site Visits Overview • To support credibility of findings we will conduct site visits every year to verify responses. In FY 08, sixteen collaboratives (10% of all collaboratives) will be selected randomly from throughout the state, rather than one from each region as in the past. • The following collaboratives are exempted from consideration this year: • The 24 collaboratives selected for site visits in December 2005 and December 2006. • All collaboratives awarded proficient status in Fiscal Year 2007.

28. Site Visits Overview • All other collaboratives are eligible for selection. Site visits will be conducted by two-person teams composed of one Family Connection Partnership (FCP) representative and one Family Connection Collaborative Coordinator from a different region, both of whom are members of the Standards Workgroup. • For the first time, site visit findings will over-ride Self Assessment entries and the FCP database will be adjusted accordingly. • Site visits will occur in December 2007.

29. Documents Used in Standards Reviews

30. For more information… • For questions on the Self Assessment, contact eval@gafcp.org • For questions on the Standards, contact standards@gafcp.org • For input on the Standards, contact your regional PTPN representative on the standards workgroup.