Before we begin, a caution…

1. 2014 Self-Study WorkshopSession VCharacteristics ofGood Self-Study ReportsTom TannerATS Commission Staff

2. Before we begin, a caution… If you’re going to work that hard, do the right car… ATS Commission on Accrediting: 2014 Self-Study Workshop

3. Characteristics of Good Self-Study Reports Five things to remember to do the “right” report: • The 4 purposes of the report • The 3 qualities of the report • The 5 features of good/weak reports • The 4 parts of the report • The 3 last things to remember 3 2 4 1 5 ATS Commission on Accrediting: 2014 Self-Study Workshop

4. Characteristics of Good Self-Study Reports Five things to remember to do the “right” report: • The 4 purposes of the report • The 3 qualities of the report • The 5 features of good/weak reports • The 4 parts of the report • The 3 last things to remember 1 ATS Commission on Accrediting: 2014 Self-Study Workshop

5. Characteristics of Good Self-Study Reports • The 4 purposes of the report (www.ats.edu) ATS Commission on Accrediting: 2014 Self-Study Workshop

6. Characteristics of Good Self-Study Reports • The 4 purposes of the report • Demonstrate ability to analyze institution’s own effectiveness • Develop plans for improvement • Provide evidence of meeting standards • Form basis for external review ATS Commission on Accrediting: 2014 Self-Study Workshop

7. Characteristics of Good Self-Study Reports • The 4 purposes of the report • Demonstrate ability to analyze institution’s own effectiveness Good long look in the mirror The mirror has two faces: • School’s own mission • ATS Commission standards ATS Commission on Accrediting: 2014 Self-Study Workshop

8. Characteristics of Good Self-Study Reports • The 4 purposes of the report • Develop plans for improvement Report must not only “look around” but “look ahead” Assessment (self-study) should show ATS Commission on Accrediting: 2014 Self-Study Workshop

9. Characteristics of Good Self-Study Reports • The 4 purposes of the report • Provide evidence of meeting standards Weak report: “Our seminary clearly meets this standard.” Good report: “Evidence of how our seminary meets this standard may be summarized in these three ways. First,…” ATS Commission on Accrediting: 2014 Self-Study Workshop

10. Characteristics of Good Self-Study Reports • The 4 purposes of the report • Form basis for external review The self-study report is yourstory… but told to strangers (so don’t assume) who are sympathetic, but objective so you must present and persuade ATS Commission on Accrediting: 2014 Self-Study Workshop

11. Characteristics of Good Self-Study Reports Five things to remember to do the “right” report: • The 4 purposes of the report • The 3 qualities of the report • The 5 features of good/weak reports • The 4 parts of the report • The 3 last things to remember 2 ATS Commission on Accrediting: 2014 Self-Study Workshop

12. Characteristics of Good Self-Study Reports • The 3 qualities of the report* • Provide sufficient description • Document appropriate evaluation • Identify strategic recommendations * Page 7 of Section Two of the Handbook NOTE: Under heading “General Characteristics” ATS Commission on Accrediting: 2014 Self-Study Workshop

13. Characteristics of Good Self-Study Reports • The 3 qualities of the report • Provide sufficient description Weak report:“We have sufficient faculty, and they are all sufficiently qualified.” Goodreport:“We have seven full-time faculty; six have PhD degrees and one has a DMin (see Appendix 5.A: Faculty Credentialsfor a detailed list).” ATS Commission on Accrediting: 2014 Self-Study Workshop

14. Characteristics of Good Self-Study Reports • The 3 qualities of the report • Provide sufficientdescription Weak report: “Our SLAP efforts have produced significant improvements.” Goodreport:“Our Student Learning Assessment Program (affectionately called SLAP by students) has produced these three improvements in student learning this past year. First,...” ATS Commission on Accrediting: 2014 Self-Study Workshop

15. Characteristics of Good Self-Study Reports • The 3 qualities of the report • Provide sufficient description • Document appropriate evaluation • Identify strategic recommendations ATS Commission on Accrediting: 2014 Self-Study Workshop

16. Characteristics of Good Self-Study Reports • The 3 qualities of the report • Document appropriate evaluation Weak report:“Our MDiv program addresses the ‘cultural context’ requirement (Degree Program Standard A, section A.2.3) fairly well, but could use improvement.” Goodreport:“We evaluate the ‘cultural context’ component of our MDiv program in two ways: (1) a cultural awareness survey (an indirect measure) and (2) a cultural engagement project (a direct measure). The results for these two assessments are provided in Table A.2 below, followed by a discussion of how those results have been used to improve our MDiv students’ learning in this critical area.” ATS Commission on Accrediting: 2014 Self-Study Workshop

17. Characteristics of Good Self-Study Reports • The 3 qualities of the report • Document appropriate evaluation Weak report:“We try hard not to spend more than we take in.” Goodreport:“The seminary has balanced its budget four of the last five years, as Table 8.6 below demonstrates. The deficit of $74,892 in FY12 represented only a 2.5% overage due to an unexpected need to replace a furnace. We have since established a ‘contingency fund’ for such emergencies, with a line-item budget of $50,000 per year.” ATS Commission on Accrediting: 2014 Self-Study Workshop

18. Characteristics of Good Self-Study Reports • The 3 qualities of the report • Provide sufficient description • Document appropriate evaluation • Identify strategic recommendations ATS Commission on Accrediting: 2014 Self-Study Workshop

19. Characteristics of Good Self-Study Reports • The 3 qualities of the report • Identify strategic recommendations Weak report:“We know more should be done to address our lack of board diversity, and we are working on that.” Goodreport:“Given our global mission and given that one fourth of our students and staff are ethnic minorities, while no one on the board is, our trustees have set a goal of recruiting one new ethnic trustee each year for the next five years until our board more fairly represents our constituency and our mission. Our first African American trustee will begin her term this fall.” ATS Commission on Accrediting: 2014 Self-Study Workshop

20. Characteristics of Good Self-Study Reports • The 3 qualities of the report • Identify strategic recommendations Weak report:“As you will see scattered throughout this report, we have identified dozens and dozens of different areas to improve.” Goodreport:“We have organized each chapter of the report (one per standard) into four parts: (1) a brief description of that area, (2) a critical evaluation of that area, (3) a list of strengths in that area, and (4) a set of two or three strategic recommendations per area to address key concerns identified. All recommendations are summarized and prioritized in the last chapter.” ATS Commission on Accrediting: 2014 Self-Study Workshop

21. Characteristics of Good Self-Study Reports Five things to remember to do the “right” report: • The 4 purposes of the report • The 3 qualities of the report • The 5 features of good/weak reports • The 4 parts of the report • The 3 last things to remember 3 ATS Commission on Accrediting: 2014 Self-Study Workshop

22. Characteristics of Good Self-Study Reports • The 5 features of good [vs. weak]reports • Are organized coherently • Describe the self-study process • Present the data crucial to understanding • Comprehensive as necessary; brief as possible • Demonstrate objectivity and honesty ATS Commission on Accrediting: 2014 Self-Study Workshop

23. Characteristics of Good Self-Study Reports • The 5 features of good/weak reports • Are organized coherently Must be organized by the standards • If joint visit with one report, must have detailed “cross walk” [Consult with Commission staff about joint visits] Must also have Introduction and Conclusion • Will discuss later under “The 4 parts of the report” ATS Commission on Accrediting: 2014 Self-Study Workshop

24. Characteristics of Good Self-Study Reports • The 5 features of good/weak reports • Describe the self-study process Introduction describes process Process engages the community Reflected in report and interviews Caution: Summarize process in 1-2 pages If use people’s names, use titles too ATS Commission on Accrediting: 2014 Self-Study Workshop

25. Characteristics of Good Self-Study Reports • The 5 features of good/weak reports • Present the data crucial to understanding Be clear and concise with data Use qualitative and quantitative data Use tables and charts to support narrative Caution: Put extensive data in appendices/links But include summary data in text When using links, make easy to use Clearly label each item ATS Commission on Accrediting: 2014 Self-Study Workshop

26. Characteristics of Good Self-Study Reports • The 5 features of good/weak reports • Present the data crucial to understanding ATS Commission on Accrediting: 2014 Self-Study Workshop

27. Characteristics of Good Self-Study Reports • The 5 features of good/weak reports • Present the data crucial to understanding Weak report:“Our students are very diverse.” Goodreport:“Our 150 students, whose ages range from 24 to 64 (with most in their 30s), are 45% female, and 30% ethnic minorities, with a dozen different denominations represented (see Table 6.3 below for demographic details). This is what one recent graduate said about her experience here regarding diversity: ‘[quote].’” ATS Commission on Accrediting: 2014 Self-Study Workshop

28. Characteristics of Good Self-Study Reports • The 5 features of good/weak reports • Present the data crucial to understanding Weak report:“Most of our MDiv students are placed.” Goodreport:“Over the last five years our MDiv graduates have averaged a 90% placement rate, with a steady increase each year, as the table below shows.” ATS Commission on Accrediting: 2014 Self-Study Workshop

29. Characteristics of Good Self-Study Reports • The 5 features of good/weak reports • Present the data crucial to understanding Weak report:“We evaluated our student services through a survey last year; see data in Appendix 6.” Goodreport:“Faculty and staff reviewed the results of a recent student survey (found in Appendix 6. Student Survey for 2013) and drew these four conclusions regarding student services…” ATS Commission on Accrediting: 2014 Self-Study Workshop

30. Characteristics of Good Self-Study Reports • The 5 features of good/weak reports • Comprehensive as necessary; brief as possible Weak reports: • Missing standards (e.g., Degree Program Standards) • Too few pages: 50 pages won’t cover the standards • Too many pages: 175+ pages overwhelm reviewers • Printed incorrectly: Single-sided/double-spaced reports double the length and the weight (remember your traveling readers) ATS Commission on Accrediting: 2014 Self-Study Workshop

31. Characteristics of Good Self-Study Reports • The 5 features of good/weak reports • Comprehensive as necessary; brief as possible Good reports: • 100-135 pages is “ideal range” • 5-10 page Introduction • 75ish pages for General Institutional Standards (1-8) • 15-40 pages for Educational and Degree Program Standards • 5-10 page Conclusion • Don’t overwhelm text with supplemental information • Put lengthy information in appendices or links ATS Commission on Accrediting: 2014 Self-Study Workshop

32. Characteristics of Good Self-Study Reports • The 5 features of good/weak reports • Demonstrate objectivity and honesty Weak report:“Morale on campus is much better.” Goodreport: “Three years ago faculty morale hit a low point when a doctrinal controversy led to the dismissal of a popular professor. The seminary followed its procedures (documented in our personnel files), but it was a very difficult time. Since then, the board and administration have worked hard to rebuild unity, with significant success—as noted in the recent faculty survey (see Appendix 5.4: Faculty Survey, item #8).” ATS Commission on Accrediting: 2014 Self-Study Workshop

33. Characteristics of Good Self-Study Reports • The 5 features of good/weak reports • Demonstrate objectivity and honesty Weak report:“The seminary has experienced some administrative turnover since the last visit.” Goodreport: “We have had three presidents and four deans in the last decade. These turnovers have occurred for various reasons and with varying results. We will summarize those reasons and results here, but the evaluation committee is also encouraged to ask about this during their on-site interviews to have a more nuanced understanding of this issue.” ATS Commission on Accrediting: 2014 Self-Study Workshop

34. Characteristics of Good Self-Study Reports • The 5 features of good/weak reports • Demonstrate objectivity and honesty Weak report:[no mention of recent public controversy] Goodreport: “Just prior to submitting this self-study report to our trustees for their review, five students filed a complaint against a faculty member alleging sexual harassment. Unfortunately, portions of that complaint have surfaced recently in social media. We have initiated our formal complaint process, and we will inform the evaluation committee of any significant developments that we are permitted legally and ethically to share.” NOTE: Boards are to “receive” self-study reports (Section Two, p. 7) ATS Commission on Accrediting: 2014 Self-Study Workshop

35. Characteristics of Good Self-Study Reports Five things to remember to do the “right” report: • The 4 purposes of the report • The 3 qualities of the report • The 5 features of good/weak reports • The 4 parts of the report • The 3 last things to remember 4 ATS Commission on Accrediting: 2014 Self-Study Workshop

36. Characteristics of Good Self-Study Reports • The 4 parts of the report* • Introduction • Main Narrative • Conclusion • Appendices (usually oneseparate volume) * Pages 8-9 of Section Two of the Handbook [NOTE: These 4 parts were discussed, in part, earlier] Reminder: Copies are to be single-spaced, double-sided, coil-bound ATS Commission on Accrediting: 2014 Self-Study Workshop

37. Characteristics of Good Self-Study Reports • The 4 parts of the report • Introduction • Main Narrative • Conclusion • Appendices ATS Commission on Accrediting: 2014 Self-Study Workshop

38. Characteristics of Good Self-Study Reports • The 4 parts of the report • Introduction(5-10 pages) • Introduce the school (mission/history) • Review accreditation history (since last visit) • Give overview of the self-study process • Identify any special features of the report • Summarize any major changes (since last visit) • Orient readers to any unique school issues ATS Commission on Accrediting: 2014 Self-Study Workshop

39. Characteristics of Good Self-Study Reports • The 4 parts of the report • Main Narrative(90-115 pages) Part 1: General Institutional Standards (75 pp.) Standards 1-8—must cover each one Part 2: Educational and Degree Program Standards (15-40 pp.) Educational Standard—cover only applicable sections Degree Programs Standards—cover only applicable standards NOTE: Can cover assessment under ES.6 or under section 1 of each DPS ATS Commission on Accrediting: 2014 Self-Study Workshop

40. Characteristics of Good Self-Study Reports • The 4 parts of the report • Main Narrative(90-115 pages) One suggested structure per chapter (per earlier slide): • brief description of school’s resources for that standard • critical evaluation of school’s alignment with standard • list of strengths of the school in terms of that standard • strategic recommendations to improve in that standard NOTE: If not meeting standard, must describe plans to do so. * Do not need to cover every subsection in every standard: group things. ATS Commission on Accrediting: 2014 Self-Study Workshop

41. Characteristics of Good Self-Study Reports Standard 4 Library (as example) Weak Report: Discuss each of 10 subsections Good Report: Discuss each of 3 sections ATS Commission on Accrediting: 2014 Self-Study Workshop

42. Characteristics of Good Self-Study Reports • The 4 parts of the report • Conclusion(5-10 pages) • Summarize overall findings of self-study • Organize and prioritize strengths • Organize and prioritize concerns • Organize and prioritize recommendations • Conclude with desired action (optional) ATS Commission on Accrediting: 2014 Self-Study Workshop

43. Characteristics of Good Self-Study Reports • The 4 parts of the report • Appendices(lengths vary, but try to keep under 250 pages) • Required appendix materials (in print and PDF on USB) 1)Current budget 4) Assessment summaries 2) Recent audit and letter 5) Catalog* 3) Handbooks*6) Targeted Issues Checklist * Could be electronic only, if too long to print (ask staff liaison) ** May also need Word version of TIC for committee to complete Each item must be clearly labeled (e.g., Appendix 8.3 Budget) Include each item separately on flash drive; if combine, “bookmark” ** ATS Commission on Accrediting: 2014 Self-Study Workshop

44. Characteristics of Good Self-Study Reports • The 4 parts of the report ATS Commission on Accrediting: 2014 Self-Study Workshop

45. Characteristics of Good Self-Study Reports • The 4 parts of the report ATS Commission on Accrediting: 2014 Self-Study Workshop

46. Characteristics of Good Self-Study Reports • The 4 parts of the report • Appendices • Required materials (in print and PDF on USB); see prior 6 items • Optional materials that may be in appendices (examples): Standard 1: Strategic Plan, Doctrinal Statement Standard 2: Charter, Bylaws Standard 3: Curricular Goals, Academic Freedom Policy Standard 4: Library Policies, Circulation Data Standard 5: List of Faculty Credentials, List of Adjuncts Standard 6: List of Student Personnel, Placement Data Standard 7: List of Trustees with Basic Data (gender, job, etc.) Standard 8: Multi-Year Financial Summary, Proposed Budget Educational Standard: Assessment Plan and Summary Results ATS Commission on Accrediting: 2014 Self-Study Workshop

47. Characteristics of Good Self-Study Reports • The 4 parts of the report Documents Room (pp. 9-10 of Section Three of Handbook) “Historically, schools … have been required to provide paper copies of various documents in a Documents Room… Increasingly, schools are asking if some or all of those documents could be provided instead electronically… AVirtual Documents Room is acceptable, provided these five conditions are met…” [listed on pp. 9-10 of Section Three] KEY: Easily accessible and clearly marked ATS Commission on Accrediting: 2014 Self-Study Workshop

48. Characteristics of Good Self-Study Reports Five things to remember to do the “right” report: • The 4 purposes of the report • The 3 qualities of the report • The 5 features of good/weak reports • The 4 parts of the report • The 3 last things to remember 5 ATS Commission on Accrediting: 2014 Self-Study Workshop

49. Characteristics of Good Self-Study Reports 5. The 3 last things to remember Tell your story in light of the standards to improve your students and school Where will this journey take you? ATS Commission on Accrediting: 2014 Self-Study Workshop