Institutional Learning Outcomes Gen Ed: A Model for Local Assessment

1. 1 Institutional Learning Outcomes & Gen Ed:A Model for Local Assessment Michael L. “Mike” Droll, Ph.D. Interim Director, Hampton Center Assessment and Special Projects Central Florida Community College Presentation to FAIR - February 3, 2006

2. 2 Agenda Commitment to our Profession CFCC Facts SACS References The Process - Chronology Pilot Test 2006 Implementation Plans Assessments & Tools The Product: Use of Results

3. 3 Commitment to our Profession A friendly reminder… Dr. Jones’ quotation about… P R O C E S S and P R O D U C T

4. 4 CFCC Facts…Central Florida Community College Established in 1957 Serves Tri-County Area of Marion, Citrus, and Levy Counties Unduplicated Headcount: 19,272 (2004-05) Five Major Campuses/Centers: Ocala Campus Appleton Museum of Art Citrus County Campus The Hampton Center Levy County Center

5. 5 SACS Principles of Accreditation: Core Requirement 2.5 The institution engages in ongoing, integrated, and institution-wide research-based planning and evaluation processes that incorporate a systematic review of programs and services that… (a) results in continuing improvement, and (b) demonstrates that the institution is effectively accomplishing its mission. (Institutional Effectiveness) [separated and underlined for emphasis]

6. 6 SACS Principles of Accreditation: Comprehensive Standard 3.3.1 The institution… identifies expected outcomes for its educational programs and its administrative and educational support services; assesses whether it achieves these outcomes; and provides evidence of improvement based on analysis of those results. [separated and underlined for emphasis]

7. 7 The Process - Chronology of Institutional Learning Outcomes 1998: Faculty Focus Groups 1999: Faculty Volunteers Met 2000: Prof. Dev. Workshop, Action Plan 2001: Outcomes Matrix and Rubrics 2002-03: Curriculum Committee Review 2004: Board of Trustees Approved- New Gen Ed Requirements; Local Instruments Developed 2005: Pilot Test 2006: Full Implementation and Evaluation

8. 8 1999: Issues Surfaced by Faculty Volunteer Group What Outcomes Do CFCC Students Acquire as Part of the College Experience On What Goals Do We Build Our Educational Program? How Do We Measure the Learning Outcomes that have been Developed? Do We Re-structure Our Curriculum or will We Need to in the Future?

9. 9 1999: References on Learning Outcomes * Cross and Angelo- Teaching Goals Inventory Flynn’s article- Rethinking Teaching and Learning Office of Instruction White Paper- Background & Definition of Terms * All Faculty Completed Teaching Goals Inventory

10. 10 1999: Professional Development Day Presented on Top 10 Results of Teaching Goals Inventory Brainstormed Additions/Revisions Embraced 16 Goals Solicited Student/Employer Input Refined to 8 Outcomes/Goals Top Student Goal: Self-Direction

11. 11 1999/2000: Outside Consultant Dr. Jeff Seybert, Director of IR at Johnson Co. Community College Operational Definitions for Outcomes: Communication Math Skills Technology Skills Critical Thinking & Problem-Solving Interpersonal Skills Self-Direction

12. 12 2001-2004: Outcomes-to-Courses-to-Approval Faculty Confirmed Outcomes in Courses (Matrix of Outcomes) Technical Skills re-titled, “Computer and Information Skills” Integrated Outcomes with General Education Requirements Approved by Board of Trustees

13. 13 2004-2005: Plan-to-Pilot-to-Product Initiated Assessment Plan Cross-Sectional Design Locally-Developed Instruments Faculty Volunteered Classes Included Entering/Exiting Students Pilot Test Administered by LOATF

14. 14 2004-2005: Plan-to-Pilot-to-Product Product: Final Task Force Report with Observations, Results, and Conclusions about… Process Student Scores Qualitative…with numbers….

15. 15 2006 Implementation Plans Refinements based on Pilot Test… Revised Math Outcomes & Rubric Embedded Speech Component Pursuing CIS simulation software Assessment Cycle of 2-3 Years

16. 16 2006 Assessment Live Administration Math Skills Speech Component (Communication) Critical Thinking & Problem Solving RFP/Demo SAM and ETS (ICT)

17. 17 Live Administration Convenience Sample 59 Course Sections Volunteered Approximately 1,200 Students # of College Level Credit Hours Earned (CLCH) >30 CLCH Self-Identify as “Second Year” or “Exiting” Students <29 CLCH Self-Identify as “First Year” or “Entering” Students

18. 18 Assessments and Tools Math Skills and Critical Thinking & Problem Solving Correlations: Measure Relationship Between Assessment Scores and CLCH Earned Other?