Quality Assessment for Institutional Effectiveness

1. Dr. Gino Pasquariello 2011 Annual TRACS Conference Quality Assessment for Institutional Effectiveness

2. Session Overview • The Purpose of this workshop is to provide you with a clear pathway to institutional assessment that results in • Better Data Collection and Analysis • Better Planning • Better Reporting • Provides you with a professionally developed system • Topics will cover • The steps of an effective assessment cycle • The characteristics of a quality assessment instruments • Maximizing the effectiveness of assessment data and findings

3. Institutional Assessment Basics • Is there a Documented and Approved Assessment Plan? • Include instruments and schedules • Department and Program reviews • Assess Student and Program Learning Outcomes • Is the Assessment Plan Implemented? • Evidence of data collection and analysis • Evidence of dissemination and reporting • Is the Assessment Data Utilized? • Reviews • Planning • Budgeting

4. A Culture of Assessment • In Theological Education, we are on the cusp of a revolution, but it requires a shift toward a Culture of Assessment! •  80% of assumptions are not substantiated by data (anecdotal, gut, emotion, personal preference, etc..) •  Improve Alignment between Assessment, Strategic Planning, and Budgeting

5. Ensuring Assessment Alignment • Alignment is Critical! • What are you Assessing? • Why are you Assessing it? • How are you Assessing it?

6. Ensuring Assessment Alignment • Alignment is Critical! • Institutional Mission and Objectives • Institutional Effectiveness • Program and Student Learning Outcomes • Accreditation Standards • Institutional Benchmarks • External Agencies • Best Practices

7. Providing Assessment Reporting • Executive Administration • Departments • Accreditation • Annual Operational Report • Quality Compliance Review (QCR) • Self-Study Documentation • Transparency, Reality, ROI

8. The Need for Core Institutional Assessment Instruments • A Complete Suite of Core Institutional Assessment Instruments • Entering Student Inventory (ESI) • Seminary Experience Inventory (SEI) • Graduating Student Inventory (GSI) • Alumni Inventory (AI) • Faculty Satisfaction Inventory (FSI)

9. Maximizing the Effectiveness of the Core Instruments • Three Key Areas • Quality of Instruments (Design and Development) • Timeliness of Reporting (Analysis and Dissemination) • Implementation of Findings (Closing the Loop)

10. Maximizing Effectiveness • Quality of Instruments • Alignment • Validity and Reliability • Filtering and Analysis • Assurance of Confidentiality

11. Maximizing Effectiveness • Timeliness of Reporting • Year-round, documented, and systematic cycle of assessment • Time to Reporting • Review • Planning • Budgeting

12. Maximizing Effectiveness • Implementation of Findings • Useful Formatting • Summary information • Strategic Recommendations • Departmental Action and Improvement • Developing SWOT Analysis Data

13. Core Institutional Assessment Instruments • Core Online Assessment Instruments • Entering Student Inventory (ESI) • Seminary Experience Inventory (SEI) • Graduating Student Inventory (GSI) • Alumni Inventory (AI) • Faculty Satisfaction Inventory (FSI)

14. Core Institutional Assessment Instruments • Professional Features • Provide an Annual Documented System of Administration, Analysis and Reporting of Institutional Assessment • Designed according to higher education Best Practices and the unique context of the Christian education environment (Validity and Reliability) • Alignment with Accreditation Reporting • Provides Timely reporting of assessment findings • Facilitates data-driven decision-making for Strategic Planning • Provides Benchmarking Data for Institutional Effectiveness

15. Participating Schools • Participating Schools Include: • Bethel Theological Seminary • Phoenix Seminary • Denver Seminary • Multnomah University • Ashland Seminary • Columbia University • The Goal is to provide TRACS institutions with these assessment instruments and to also provide all-schools data for benchmarking and reporting

16. Quality Assessment for Institutional Effectiveness Blessings and Thanks! • Contact Information: Dr. Gino Pasquariello Director of Institutional Research Southern California Seminary El Cajon, CA 92019 Office: 619-201-8965 Cell: 619-804-0990 gpasquariello@socalsem.edu