1 / 65

How a Culture of Inquiry Can Help Catalyze Completion Efforts

How a Culture of Inquiry Can Help Catalyze Completion Efforts. Dr. Rob Johnstone Cabrillo College Visioning Day Aptos, CA February 7, 2014. Acknowledgements.

raven
Download Presentation

How a Culture of Inquiry Can Help Catalyze Completion Efforts

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. How a Culture of Inquiry Can Help Catalyze Completion Efforts Dr. Rob Johnstone Cabrillo College Visioning Day Aptos, CA February 7, 2014

  2. An Applied Inquiry Framework for Student Completion – April 2013 Acknowledgements • Much of the content in this presentation in conjunction with national projects such as Completion by Design, the Aspen Prize for CC Excellence, and Bridging Research, Information & Cultures (BRIC) • Content has also been developed by and with a host of national partners, including: • Community College Research Center (CCRC) • Jobs for the Future • JBL Associates • Public Agenda • The Research & Planning (RP) Group • WestEd • Infographics were primarily designed by Greg Stoup

  3. April 2013 The Student Experience An Applied Inquiry Framework for Student Completion

  4. April 2013 A Culture of Inquiry & Action A RESOURCE for INSTITUTIONAL change

  5. What is a Culture of Inquiry? Institutional capacity for supporting open, honest and collaborative dialogfocused on strengtheningthe institution and the outcomesof its students.

  6. Culture of Inquiry: Features • Widespread access to user-friendly information on student outcomes • Encouraging more people to ask a wider collection of questions and use their evidence and conclusions to enhance decision making • Reflective and dynamic discussions across constituency groups

  7. Culture of Inquiry: More Features • Continuous feedback so adjustments can be made along the way and processes can be adapted • A sense of ownership over improving student outcomes – not blaming the student • Using insight generated from inquiry to act at varying levels of the institution to create the conditions to improve outcomes

  8. Applied Inquiry Framework for Student CompletionDeveloped for Completion by Design A Resource for Institutional Change

  9. An Applied Inquiry Framework for Student Completion • Stage 1 – Explore how to improve outcomes • Stage 2 – Gather meaningful evidence • Stage 3 – Discuss evidence broadly • Stage 4 – Use evidence to inform change • Stage 5 – Measure the impact of change

  10. Explore how to improve student outcomes STAGE 1 Focus inquiry on designing approaches that improve student outcomes

  11. Key Questions • When was the last time you sat in a standing committee meeting on your campus that used evidence to explore a key student success outcome for more than 20 minutes? • What types of questions do we spend most of our organizational resources answering?

  12. Gather meaningful evidence STAGE 2 Collect high-quality, meaningful evidence at the student support, classroom, program, and institutional levels

  13. When gathering evidence, make sure you are focusing on the right data…

  14. 20 year trend for California CCcourse success & persistence rates Persistence Rate Success Rate What does that tell us about the usefulness of these metrics in setting institutional strategies? 1989 2008

  15. Three Studies to Energize a Campus Conversation About Student Success • Grades & Success in Sequenced Courses • Cohort Tracking in Developmental Education • Levels of Preparedness in GE Courses – success of simultaneously enrolled students in Math / English courses

  16. Study 1: Grades in Sequenced Courses Note: Data tracked from 2006-07 to 2011-12

  17. Grades in Sequenced Courses Backdrop • Course sequences analyzed in Mathematics, English, Biology, Chemistry, Physics & Economics • Relationship between grade in 1st course in sequence and success in 2nd course in sequence was examined. • Enrollment data tracked from 2006-07 to 2011-12 • Cohort Ns ranged from 1,890 to 126,367

  18. Segmentation of Students Taking Intermediate Algebra

  19. Table for Intermediate Algebra

  20. Developmental Education Math Course Sequence Pre-Algebra Introductory Algebra Introductory Algebra Intermediate Algebra Transfer Level Math 306 Math 308 Math 308 Math 310 Math 1300s The grade received by students in Math 306 Success Rate of those same students in Math 308 100% 90% A A 76% 80% 70% Those placing directly into Math 308 60% 60% 51% B B 50% 40% 27% 30% C 20% 10% 0%

  21. Developmental Education Math Course Sequence Pre-Algebra Introductory Algebra Intermediate Algebra Intermediate Algebra Transfer-Level Math 306 Math 308 Math 310 Math 310 Math 1300s The grade received by students in Math 308 Success Rate of those same students in Math 310 100% 90% A A 81% 80% 70% Those placing directly into Math 310 60% 60% 57% B B 50% 40% 37% 30% C 20% 10% 0%

  22. Intermediate Algebra – Transfer-Level Mathematics Intermediate Algebra Transfer-Level Transfer-Level MATH 310 MATH 1300s MATH 1300s The grade received by students in Math 310 Success Rate of those same students in Math 1300s 100% 90% A A 81% 80% Those placing directly into Math 1300s 63% 70% 66% 60% B B 50% 44% 40% 30% C 20% 10% 0%

  23. Calculus Course Sequence Calculus I Calculus II Calculus II MATH 2413 MATH 2414 MATH 2414 The grade received by students in Math 2413 Success Rate of those same students in Math 2414 100% 90% 90% A A 78% 80% Those placing directly into Math 2414 72% 70% 60% 50% B B 50% 40% 30% C 20% 10% 0%

  24. Developmental Education Writing Course Sequence Two Levels below Transfer One Level below Transfer One Level below Transfer Transfer Level English ENGL 306 ENGL 307 ENGL 1301 The grade received by students in English 306 Success Rate of those same students in English 307 100% 90% A A 77% 80% Those placing directly into English 307 66% 70% 66% 60% 49% B B 50% 40% 30% C 20% 10% 0%

  25. Developmental Education Writing Course Sequence Two Levels below Transfer One Level below Transfer Transfer Level English One Level below Transfer ENGL 306 ENGL 307 ENGL 1301 The grade received by students in English 307 Success Rate of those same students in English 1301 100% 90% A A 80% 74% Those placing directly into English 1301 71% 70% 61% 60% B B 46% 50% 40% 30% C 20% 10% 0%

  26. College English Course Sequence Composition I Composition II Composition II ENGL 1301 ENGL 1302 ENGL 1302 The grade received by students in English 1301 Success Rate of those same students in English 1302 100% 88% 90% A A 77% 80% Those placing directly into English 1302 70% 68% 58% 60% B B 50% 40% 30% C 20% 10% 0%

  27. College Biology Course Sequence Biology I Biology II Biology II BIO 1406 BIO 1407 BIO 1407 The grade received by students in Biology 1406 Success Rate of those same students in Biology 1407 100% 90% 90% A A 76% 80% Those placing directly into Biology 1407 70% 70% 60% 60% B B 50% 40% 30% C 20% 10% 0%

  28. College Biology Course Sequence Anatomy Physiology Physiology BIO 2401 BIO 2402 BIO 2402 The grade received by students in Biology 2401 Success Rate of those same students in Biology 2402 100% 88% 90% A A 80% 72% Those placing directly into Biology 2402 70% 67% 60% 50% B B 50% 40% 30% C 20% 10% 0%

  29. College Chemistry Course Sequence General Chemistry I General Chemistry II General Chemistry II CHEM 1411 CHEM 1412 CHEM 1412 The grade received by students in Chemistry 1411 Success Rate of those same students in Chemistry 1412 100% 86% 90% A A 80% 70% Those placing directly into Chemistry 1412 70% 66% 60% B B 46% 50% 40% 30% C 20% 10% 0%

  30. University Physics Course Sequence General Physics I General Physics II General Physics II PHYS 1401 PHYS 1402 PHYS 1402 The grade received by students in Physics 1401 Success Rate of those same students in Physics 1402 100% 94% 87% 90% A A Those placing directly into Physics 1402 80% 78% 69% 70% 60% B B 50% 40% 30% C 20% 10% 0%

  31. Economics Course Sequence Macro Economics Micro Economics Micro Economics ECON 2301 ECON 2302 ECON 2302 The grade received by students in Economics 2301 Success Rate of those same students in Economics 2302 100% 89% 90% A A 81% 80% 74% Those placing directly into Economics 2302 71% 70% 60% B B 50% 40% 30% C 20% 10% 0%

  32. Study 2: Cabrillo College Developmental Education Cohort Tracking

  33. Developmental Education Cohort Tracking Backdrop • Deved cohorts tracked in Math and Writing. • Students taking their first course within each department in Fall 2010 were tracked forward through Summer 2013. • The charts give the % of each cohort passing each subsequent stage of the sequence. • Note that in some cases, students may not need to pass all the courses in the sequence to meet their goals. • Cohort Ns ranged from 225 to 635

  34. Math cohort tracking starting in Pre-Algebra INTRODUCTORY ALGEBRA INTERMEDIATE ALGEBRA TRANSFER LEVEL PRE-ALGEBRA 100% 100% Attempt the Course 90% 80% 70% 72% Pass the Course 60% Of the original cohort 50% 43% Attempt the Course 40% 30% Of the original cohort 27% Pass the Course 20% 18% Attempt Of the original cohort 10% 11% Pass 5% Att 4% Pass 0% Notes: Enrollments from Fall 2009 thru Spring 2012; Success is defined as A/B/C/CR grade.

  35. Math cohort tracking starting in Introductory Algebra INTRODUCTORY ALGEBRA INTERMEDIATE ALGEBRA TRANSFER LEVEL PRE-ALGEBRA 100% 100% Attempt the Course 90% 80% 70% 64% Pass the Course 60% Of the original cohort 50% 50% Attempt the Course 40% 39% Pass the Course 30% Of the original cohort 25% Attempt 20% 19% Pass 10% 0% Notes: Enrollments from Fall 2009 thru Spring 2012; Success is defined as A/B/C/CR grade.

  36. Math cohort tracking starting in Intermediate Algebra INTRODUCTORY ALGEBRA INTERMEDIATE ALGEBRA TRANSFER LEVEL PRE-ALGEBRA 100% 100% Attempt the Course 90% 80% 70% 67% Pass the Course 60% Of the original cohort 50% 50% Attempt the Course 40% 37% Pass the Course 30% 20% 10% 0% Notes: Enrollments from Fall 2009 thru Spring 2012; Success is defined as A/B/C/CR grade.

  37. English Writing cohort tracking starting at Developmental Writing I DEV WRITING II COMPOSITION I COMPOSITION II DEV WRITING I 100% 100% Attempt the Course 90% 80% 70% 71% Pass the Course 60% 53% Attempt the Course Of the original cohort 50% 45% Pass the Course 40% 33% Attempt 30% Of the original cohort 26% Pass the Course 20% 10% 0% Notes: Enrollments from Fall 2009 thru Spring 2012; Success is defined as A/B/C/CR grade.

  38. English Writing cohort tracking starting at Developmental Writing II DEV WRITING II COMPOSITION I COMPOSITION II DEV WRITING I 100% 100% Attempt the Course 90% 80% 78% Pass the Course 70% 65% Attempt the Course 60% Of the original cohort 54% Pass the Course 50% 40% 30% 20% 10% 0% Notes: Enrollments from Fall 2009 thru Spring 2012; Success is defined as A/B/C/CR grade.

  39. A Direct Look at Meaningful Analyses from Four-Year Schools

  40. Simple and Effective Analyses to Inform Student Progress and Completion Efforts • Based on analyses from: • Florida State University • Georgia State University • San Diego State University • University of North Carolina – Greensboro • University of Texas • University of Southern California • University of Wisconsin Eau Claire • Virginia Commonwealth University

  41. Simple and Effective Analyses to Inform Student Progress and Completion Efforts Targeting at-risk populations (UNCG) Identifying At-Risk Students Using Historical Data (GSU, FSU) Identifying At-Risk Students Using Milestones (FSU, GSU) Tracking beyond Freshmen to Sophomore Retention Rates (FSU) Tracking Second Year Students with Sophomore Standing (GSU)

  42. Simple and Effective Analyses to Inform Student Progress and Completion Efforts Identifying Correlates of Success (VCU, UWEC, SDSU) Identifying Correlates of Non-Success (USC) Predictive Model for Retention (VCU, GSU) Impact of Course Withdrawals (VCU) Additional Analyses (USC, FSU, GSU, UWEC)

  43. First Year to Second Year Retention, Georgia State University

  44. First Year Retention & Progression Rates - Georgia State University

  45. Discuss evidence broadly STAGE 3 Engage a variety of campus stakeholders in evidence-based discussions about improvements in practice

  46. Data do not speak for themselves.

  47. The vital role of exploration • In order to make data useful, ample time and space are needed to discuss and analyze the information and connect it back to the original research question. • Answers are not always immediately apparent, so skilled facilitation may be needed to dig out the deeper meaning. • Multiple perspectives and types of information are often needed to make sense of individual data points. !

  48. Study 3: • English & Math Preparedness & Success in GE Courses –

  49. Success in Psychology 101 for students simultaneously enrolled in an English course English 826 (Two Below) English 836 (One Below) English 100 (Transfer A) English 110 (Transfer B) Success Rate of those same students in Psychology 101 English course taking profile for students in Psychology 101 100% 90% 75% 80% Not in an English course 68% 70% 64% 60% 48% 50% 40% 31% 33% 67% 30% 20% 10% 0% Note: Enrollments from Summer 2000 to Spring 2009; Success is defined as A/B/C/CR grade

More Related