Unpacking the Student Success Scorecard

1. Unpacking the Student Success Scorecard Measuring Disproportionate Impact and Identifying Factors that Impact Hispanic Student Completion Rates Matthew Wetstein, Ph.D., Vice President of Instruction, San Joaquin Delta College Alice van Ommeren, Ed.D., Dean, Research, Analysis and Accountability, CCCCO Alyssa Nguyen, Senior Research Analyst, San Joaquin Delta College Sabrina Sencil, Research Analyst, San Joaquin Delta College Tom Leigh, Ph.D., Research Program Specialist II, CCCCO

2. Background • Increasing attention to reducing the achievement gap (outcomes) • Policymakers and administrators are inquiring about the racial disparities • Researchers are being tasked to measure and explain inequities and disparities • Hispanic enrollment is increasing, but a persistent completion gap exits.

3. Caution Racial categories are constructs and do not capture social, cultural, economic and political issues surrounding racial diversity. Differences in outcomes are due to underlying social, cultural, economic issues associated with race/ethnicity.

4. Measuring Disproportionate Impact • Existing Legislation or Policy • Title 5, Section 55512(a) • Assessment process and its impact • Terms of ethnicity, gender, age or disability • Student Success Task Force • Recommendation to disaggregate • Demographics, including race/ethnicity • Title 5, Section 54220 • Student Equity Plans • Revised and due in Fall 2014

7. 2013 Scorecard Completion COHORT 2013 Scorecard 2006-07 Cohort OUTCOME Attained Completion Outcome

9. Completion Percentage of degree and/or transfer-seeking students tracked for six years through 2011-12 who completed a degree, certificate or transfer related outcomes.

10. Measuring Disproportionate Impact • Two Methods: • 80-Percent Rule • Proportionality Index

11. The 80 Percent Rule The 80 Percent Rule methodology is based on the Equal Employment Opportunity Commission (EEOC) 80% Rule, outlined in the 1978 Uniform Guidelines on Employee Selection Procedures, and was used in Title VII enforcement by the U.S. Equal Opportunity Commission, Department of Labor, and the Department of Justice.

12. The 80 Percent Rule (cont’d) The 80% Rule states that: “A selection rate for any race, sex, or ethnic group which is less than four-fifths (4/5) (or eighty percent) of the rate for the group with the highest rate will generally be regarded by the Federal enforcement agencies as evidence of adverse impact, while a greater than four-fifths rate will generally not be regarded by Federal enforcement agencies as evidence of adverse impact.”

13. Calculating the 80 Percent Ratio • Three Steps: • Calculate the frequency and percent of disaggregated subgroups in cohort and outcome groups. • Calculate the percent attainment of each subgroup. Divide the outcome count by the cohort count. • Divide the percent attainment of each subgroup by the percent attainment of a reference group to obtain the 80 Percent Ratio.

14. Step One. Calculate the frequency and percent of disaggregated subgroups in cohort and outcome groups.

15. Step Two. Calculate the percent attainment of each group. Divide the outcome count by the cohort count.

16. Step Three. Divide the percent attainment of each subgroup by the percent attainment of a reference group to obtain an 80 Percent Ratio. • How to pick the reference group? • Original EEOC legislation mandated the highest-performing group. • CCCCO suggests the largest subgroup as the reference group. • or • When there is not a clear majority or the majority percentage may not be the best choice (e.g., the percent of the largest majority is less than the overall rate) one can use the overall rate as the reference.

17. Step Three. Divide the percent attainment of each subgroup by the percent attainment of a reference group to obtain an 80 Percent Ratio.

18. Proportionality Divide the percentage of each race/ethnicity in the outcome group by its percent in the cohort.

20. Proportionality: Divide the percentage of each race/ethnicity in the outcome group by its percent in the cohort.

21. Hispanic 2013 Scorecard Completion Rate Proportionality by College

22. *First-Time Students Fall 2012 with valid Parent Education value.