Expenditures & Outcomes

1. Expenditures&Outcomes Edward R. KarppDirector of Institutional ResearchGlendale Community College

2. Expenditures&Outcomes(Including ARCC) Edward R. KarppDirector of Institutional ResearchGlendale Community College

3. The Relationship Between Expenditures by Category and Student Outcomes • Is there a relationship? • Do districts spending proportionately more on instruction have stronger student outcomes? • Do districts spending proportionately more on student services have stronger student outcomes? • Do districts spending proportionately more on technology have stronger student outcomes?

4. Pike, Smart, Kuh, Hayek (2006). Educational expenditures and student engagement: When does money matter? • Expenditures data from IPEDS • Engagement data from NSSE • Conclusions • Relationships between expenditures and engagement are complex • Expenditures on instruction related to student engagement

5. Pike, Smart, Kuh, Hayek (2006). Educational expenditures and student engagement: When does money matter? • What if the data came from a more homogeneous set of institutions? • What if the outcome measures were more directly defined? • Would the relationships still be as complex?

6. The Variables • Dependent Variable: ARCC Indicators of Student Outcomes • Source: ARCC 2007 Final Report (most recent years) • Problems • Possible inconsistencies in MIS reporting (particularly in indicators tracking progress in ESL and basic skills) • Missing data

7. The Variables • Independent Variables: Percentage of Expenditures in Particular Categories • Source: Fiscal Data Abstract (2005-2006 Data) • Expenditure Categories • Certificated Salaries & Instructor Salaries; Classified Salaries • Benefits • Current Expense of Education • Instructional Administration • Instructional Support Services (Libraries, Learning Centers) • Admissions & Records; Counseling; Other Student Services (EOPS, DSPS, Health Services, Financial Aid Administration, etc.) • Planning & Policymaking • General Institutional Support Services (including technology, HR) • Other Measures • Noncredit Percentage of FTES • Percentage FTES Growth • Full-Time Faculty FTE Percentage • Average Full-Time Faculty Salary

8. Dependent Variables:ARCC Indicators

9. Dependent Variables: ARCC Indicators • ARCC Indicators are college-level measures • Expenditures are district-level measures • District-level ARCC indicators, weighted by college FTES

10. Dependent Variables: ARCC Indicators • Indicator A: Student Progress & Achievement (2000-2001 to 2005-2006) • Percentage of first-time students who showed intent to complete and achieved any of the following outcomes within six years: transferred to a four-year institution, earned an AA/AS or certificate of at least 18 units, achieved “transfer directed” status, or achieved “transfer prepared” status

11. Dependent Variables: ARCC Indicators

12. Dependent Variables: ARCC Indicators • Indicator B: Students Earning 30+ Units (2000-2001 to 2005-2006) • Percentage of first-time students who showed intent to complete and earned at least 30 units in the California community college system

13. Dependent Variables: ARCC Indicators

14. Dependent Variables: ARCC Indicators • Indicator C: Persistence Rate (Fall 2004 to Fall 2005) • Percentage of first-time students with a minimum of six units earned in a Fall term who enrolled in the subsequent Fall term anywhere in the California community college system

15. Dependent Variables: ARCC Indicator

16. Dependent Variables: ARCC Indicators • Indicator D: Vocational Course Completion (2005-2006) • Percentage of vocational course enrollments that were passed with a grade of A, B, C, or CR

17. Dependent Variables: ARCC Indicators

18. Dependent Variables: ARCC Indicators • Indicator E: Basic Skills Course Completion (2005-2006) • Percentage of basic skills course enrollments that were passed with a grade of A, B, C, or CR

19. Dependent Variables: ARCC Indicators

20. Independent Variables:Expenditures

21. Independent Variables: Expenditures • Fiscal Data Abstract (2005-2006) • Total expenditures in 2005-2006 by district • Including or excluding capital outlay? • Results reported here include capital outlay in total; the relationships were exactly the same whether capital outlay was included or not

22. Independent Variables: Expenditures • Percentage of total expenditures in following areas: • Certificated salaries • Instructional salaries • Classified salaries • Benefits • Instructional administration • Instructional support services • Admissions & Records • Counseling & guidance • Other student services • Planning & policymaking • General institutional support services (incl. technology) • Vocational education (by TOP code, flawed due to overlaps)

23. Description&Analysis

24. ARCC A: Student Progress & Achievement • Positive Predictors • Total expenditures (r = 0.39) • % of expenditures on Admissions & Records (r = 0.25) • Negative Predictors • % of instructional expenditures on vocational education (r = -0.52) • % of instructional expenditures on other student services (r = -0.27)

25. ARCC A and Total Expenditures

26. ARCC A and FTES

27. ARCC A and Expenditures on Vocational Programs

28. ARCC B: Students Completing 30+ Units • Positive Predictors • Total expenditures (r = 0.36) • % of expenditures on instructional salaries (r = 0.37) • Negative Predictors • % of expenditures on “other” student services (r = -0.39) • % of instructional expenditures on vocational education (r = -0.27) • % of instructional expenditures on planning & policymaking (r = -0.25)

29. ARCC B and Total Expenditures

30. ARCC B and Instructional Salaries

31. ARCC B and Other Student Services

32. ARCC C: Persistence Rate • Positive Predictors • Total expenditures (r = 0.54) • % of expenditures on instructional salaries (r = 0.46) • Average full-time instructor’s salary (r = 0.26) • Growth (r = 0.24) • Negative Predictors • % of expenditures on “other” student services (r = -0.43) • % of instructional expenditures on vocational education (r = -0.33) • % of instructional expenditures on planning & policymaking (r = -0.26)

33. ARCC C and Total Expenditures

34. ARCC C and Instructional Salaries

35. ARCC C and Other Student Services

36. ARCC D: Vocational Course Success • Positive Predictors • % of instructional expenditures on vocational education (r = 0.29) • Growth (r = 0.26) • Negative Predictor • % of expenditures on instructional salaries (r = -0.25)

37. ARCC D and Vocational Instruction

38. ARCC D and Growth

39. ARCC D and Instructional Salaries

40. ARCC E: Basic Skills Course Success • No strong positive or negative predictors

41. Conclusions&Further Research

42. Summary of Correlations

43. Relationships • District size (total expenditures, FTES) is a predictor of progress & achievement, completing 30+ units, and persistence • Expenditures on instructional salaries is a positive predictor of completing 30+ units and persistence, but a negative predictor of vocational course success • Expenditures on vocational instruction is a negative predictor of progress & achievement, completing 30+ units, and persistence, but a positive predictor of vocational course success • Expenditures on other student services is a negative predictor of progress & achievement, completing 30+ units, and persistence

44. District Size/Total Expenditures • Is there a “third variable” that influences both size and outcomes? • Urban location? • Quality? • Centralized district functions in multi-college districts? • For single-college districts, size/total expenditures is not a strong predictor of progress & achievement, but is a strong predictor of persistence and completing 30+ units

45. Other Student Services • Does the negative correlation between other student services and the ARCC indicators imply a bias in the indicators against open access? • Do districts spending proportionately more on EOPS, DSPS, etc. serve more nontraditional students? • Are these districts be “penalized” by weaker ARCC indicators?