280 likes | 286 Views
This study examines the impact of institutional factors on time to degree and graduation rates at a non-traditional distance education university. The research includes both multivariate and bivariate approaches to analyze the relationship between institutional factors and student outcomes. The study aims to determine whether theories and models used in traditional institutions can be applied to non-traditional distance institutions.
E N D
Examination of the Influence of Institutional Context on Time-To-Degree/Program Graduation Rates at Non-Traditional Distance University Edward Hans Kofi Acquah, PhD. Senior Institutional Analyst May 28, 2008: 11:40-12:20am Association for Institutional Research 2008 Annual Conference, Seattle WA
Introduction and Background • Time-to-degree and graduation rates still important and challenging areas of research particularly at distance institutions(Abedi & Benkin, 1987; Astin, 1997). • As KPIs, of interest to policy makers, gov. agencies and parents(Burke, 1998; Titus, 2004, 2006; Sheridan & Pyke, 1994). • Past research focused mainly on traditional students at traditional institutions. • In both traditional and non-traditional institutions, role of institutional factors have been neglected(Tinto, 1975; Spady, 1971; Bean, 1980). • Mixed research results on relationship between institutional factors and student learning outcomes(Hayek, 200; Astin, 1993; Ryan, 2004; Titus, 2004, 2006; Smart, Ethington, Riggs & Thompson, 2002).
Background(continued) • E.g., Ryan(2004): positive and significant relationship between graduation rates & instructional exp.; but negative relationship between graduation rates & inst support expenditures; • Smart & eta(2002): instructional expenditures have negative effect on student leadership.; & student services have positive effect
Research QuestionsMultivariate and Bivariate approaches needed to answer the questions: • Do institutional factors help predict time-to-degree at distance education university? • Do institutional factors help predict program graduation rates at distance education university? • Are the multivariate regression results consistent with the bivariate regression results? • How well do institutional factors play out on their own in predicting non-traditional distance students’ learning outcomes? • Can the theories and models used in traditional institutions to explain students learning outcomes be applied to non-traditional distance institutions/students?
Institutional Context • Study based on a distance university in North America. • One of the top three of its kind in the world. • Open admission, year-round enrolment and course registrations. • Three modes of delivery: Individualized Study; Grouped Study(Seminar); an Challenge Study. • Students may transfer credits from another institution and/or • Be assessed and awarded credits based on prior learning/work experience (Prior Learning Accreditation & Recognition: PLAR). • Students must meet residency requirements(some credits earned at distance university). • Degree completion at varying times. • Study period: April 2002-March 2007. • Over 3,000 undergraduate degree recipients.
DATA AND VARIABLE DESCRIPTIONS • Study Period: April, 2002-March, 2007; chosen for stable economic, political and social conditions. • Sample Size: 2,916 undergraduate degree recipients. • Post-graduate degree, diploma and certificate and undergraduate diploma and certificate programs excluded to preserve homogeneity of data. • Two Groups of Independent Variables: • Demographic Characteristics • Gender: Female=1 & Male=0 (X1) • Age at time of admission(X2)
DATA AND VARIABLE DESCRIPTION Institutional Variables • Average individualized study course pass rate(X3) • Average final grade as measure for GPA(X4) • Average number of grouped study courses taken(X5) • Degree Type: General Degree=1 & Applied Degree=0(X6) • Net credits earned at distance institution(X7) • Institutional expenditure per full-load equivalent for direct instruction deflated by education price index(EPI)(X8) • Institutional expenditure per full-load equivalent on student services(X9) deflated by the education price index(EPI). Outcome Variables • Time-to-degree(degree completion)(y1) • Program graduation rate defined as #Program Graduates/Total Graduates(y2)
REASONS FOR VARIABLE CHOICE • Used in empirical studies at traditional institutions of higher education. • To determine how well they could help to explain learning outcomes in non-traditional distance institutions. • To test if models and theories used in traditional institutional environments could be applied to non-traditional institutional environments.
ANALYTICAL FRAMEWORK Multivariate Regression Models • y1=a0 + a1X1 + a2X2 + a3X3 + a4X4 + a5X5 + a6X6 + a7X7 + a8X8 + a9X9 + et • y1=b0 + b1X1 + b2X2 + b3X3 + b4X4 + b5X5 + b6X6 + b7X7 + b8X8 + b9X9 + et Where: • a0 & b0 = the intercepts of the regression equations • et = stochastic error term in the regression equations. • X’s & y’s are as defined. • a’s & b’s are the parameters to be estimated
ANALYTICAL FRAMEWORK(continued) Model Assumptions • Assumptions of the Classical Linear Regression : • Normally distributed residuals; • Homoscedastic • Serially uncorrelated , that is, • et~N [0, s2I] Predictor Variables: • No a priori assumptions made regarding nature of their expected influence on dependent variables
DESCRIPTIVE STATISTICS • Time-to-degree(y1) varied from 2.44 years – 7.04 years with a mean of 5.5 years. • Program graduation rates(y2) varied from 0.17% - 26.71% with a mean of 13.8%. • Age(X1) varied from 15.3 years – 77.9 years with a mean of 29.8 years. • Average course passing rate(X3) varied from 31.0% - 94.0% with mean of 59.8%. • Average final grade(GPA, X4) varied from 70.7% - 87.1% with mean 79.5%. • Number of grouped study courses(X5) taken varied from 0 – 1. • Credits earned at distance institution(X7) varied from 26 – 68 credits with mean 49 credits.
Time-to-Degree Multiple Regression Results • Model strongly fit data: R2 = 0.6363, adj. R2 = 0.6352. • F = 564.84, p<0.001 indicates powerful model. • Strong correlation between dependent variable(y1) and independent variables as a whole: R = 0.7977. • All model effects statistically significant: t-values and p-values(probability of significance). • Control Variables:; age(X1) has positive effect; and gender(X2) has negative effect on time-to-degree(y1). • Grouped study courses(X5), and expenditures on student services(X9) have negative effect on time-to-degree(y1). • Individualized study course pass rate(X3), final grade or GPA(X4), degree type(X6), distance institution’s credits earned(X7), and direct instruction expenditures(X8) have positive effect on time-to-degree(y1)
Graduation Rates Multiple Regression Results • Model strongly fit data: R2 = 0.7014, adj. R2 = 0.7005. • F = 758.41, p<0.001 indicates powerful model. • Strong correlation between dependent variable(y2) and independent variables as a whole: R = 0.8375. • All model effects statistically significant: t-values and p-values (probability of significance). • Control Variables: age(X1) has negative effect; gender(X2) has positive effect on program graduation rates(y2). • Individualized study course pass rate(X3), GPA(X4), distance university credits(X7), and expenditures on student services(X9) have negative effect on program graduation rates(y2). • Grouped study course taken (X5), degree type(X6), and direct instructional expenditures(X8) have positive effect on program graduation rates(y2).
Table 4 Independent Bivariate Regression Results: Time-To-Degree
Independent Bivariate Regression Results 1. Age(X1) has significant positive individual effect on y1, mean time-to-degree: 4.9yrs; has insignificant negative effect on y2, mean graduation rate: 14.2%. 2. Gender(X2) has significant negative effect on y1, mean time-to-degree: 5.9yrs; has insignificant positive effect on y2, mean graduation rate: 13.6%. 3. Individualized study course pass rate(X3) has significant positive effect on y1, mean time-to-degree: 3.4yrs; significant positive individual effect on y2, mean graduation rate: 10.2%. 4. Average program final grade(X4) has significant positive individual effect on y1, mean time-to-degree: 1.4yrs; has significant negative individual effect on y2, mean graduation rate: 73.7%. 5. Average grouped study course(X5) has significant negative individual effect on y1, mean time-to-degree: 5.6yrs; has significant positive effect on y2, mean graduation rate: 12.9%. 6. Degree Type(X6) has significant positive individual effect on y1, mean time-to-degree:4.8yrs; has significant negative effect on y2, mean graduation rate: 21.6%. 7. Required credits(X7) has significant positive individual effect on y1, mean
Independent Bivariate Regression Results(continued) • Time-to-degree: 5.2yrs; has significant and negative individual effect on y2, expected graduation rate: 17.8%. 8. Average direct instructional expenditures(X8) have significant positive individual effect on y1, expected time-to-degree: 4.8yrs; have significant positive individual effect on y2, expected program graduation rate: 2.0%. 9. Average institutional expenditures on student services(X9) have significant positive individual effect on time-to-degree(y1) • expected time-to-degree: 4.8yrs; • have significant positive individual effect on graduation rates(y2)with • expected program graduate rate: 2.0%.
Table 5 Independent Bivariate Regression Results for Program Graduation
DISCUSSION AND IMPLICATIONS • Results confirm some results found in traditional institutions. • That institutional factors influence time-to-degree and graduation rates. • Direct Instructional Expenditures: • have positive effect on time-to-degree and program graduation rates. • consistent with previous results(Ryan, 2004) and partly confirm Astin’s(1993) conclusions regarding effects of institutional expenditures on learning outcomes. • inconsistent with other results (Belfield and Thomas, 2000): no significant relationship between expenditures and student performance. • Positive relationship means increases in instructional expenditures will increase time-to-degree(retention) & improve graduation rates.
DISCUSSION(continued) 2. Expenditures on Student Services: • Have significant and negative effect on y1 and y2. • Consistent with results obtained by Ryan(2004). • Contradict positive effects hypothesized by Astin(1993) & positive results obtained by Smart et. Al(2002). • Negative effect means expenditures on students services shortens time-to-degree but leads to decreasing rate of return in terms of graduation rates. 3. Credits required to earn at distance institution: • Have significant positive effect on time-to-degree(y1) but significant negative effect on graduation rates(y2). • Indicates the more the credits the longer the time-to-degree & the lower the graduation rates.
DISCUSSION(continued) 4. Degree Type • Has significant positive effect on time-to-degree and graduation rates. • Indicate time-to-degree is longer for general degree than applied degree. • More general degree students in a program improves graduation rates/graduation rates are higher for general degree than applied degree. 5. Grouped Study Courses • Have significant negative effect on time-to-degree but a significant positive effect on graduation rates. • Indicate grouped study courses taken shorten time-to-degree. • Improves graduation rates/The more grouped study courses taken, the higher the graduation rates .
DISCUSSION(continued) 6. Average Program Final Grade • Has significant positive effect on time-to-degree but significant negative effect on graduation rates. • Indicates the higher the final grade(program difficulty) the longer the time-to-degree. • And the longer the time-to-degree, the lower the graduation rates per program. 7. Individualized Course Pass Rate • Has significant positive effect on time-to-degree but significant negative effect on graduation rates. • Indicating that difficult courses prolong time-to-degree. • The more difficult the individualized courses(longer the time-to-degree), the lower the graduation rates.
DISCUSSION(continued) 8. Gender • Has significant negative effect on time-to-degree, but • Significant positive effect on program graduation rates • Indicates that the more female students are in a program the shorter the time to degree(female students take shorter time to graduate) • Indicates female students have higher graduation rates/female students are more likely to graduate in a program than male students(Ryan, 2004; Leppel, 1984). 9. Age • Significant positive effect on time-to-degree but • Significant negative effect on program graduation rates. • Indicating older students take longer to complete degree programs. • Indicating the higher the age, the lower the graduation rates(Ryan, 2004; Leppel, 1984).
CONCLUSIONS • Overall results are illuminating • Create interesting implications for non-traditional distance student retention and degree attainment models. • Policy implications. • It is possible to use institutional factors to predict learning outcomes of non-traditional distance students. • Institutional expenditures on direct instruction might be used to improve non-traditional distance students’ academic engagement and graduation rates. • Transfer expenditures from student services to direct instruction in order to shorten degree completion time and improve graduation rates. • Increase grouped study courses offered and to encourage distance students to take more grouped study courses to shorten time-to-degree and improve graduation rates.
LIMITATIONS AND FUTURE RESEARCH • Since the study applies to only one non-traditional institution, the results are not generalizable to the entire non-traditional distance students in North America. • Not all institutional factors were included and results cannot be generalized to all institutional factors. • Research needed to study academic engagement and learning outcomes of more non-traditional distance institutions using more advanced models. • Study required to focus on how changes in institutional expenditures per program over time affect changes in distribution of students across programs.
Any questions or observations? Thank you