280 likes | 352 Views
Measuring Vocational Program Outcomes: What We Know and What’s Next. Patrick Perry Vice Chancellor, Technology, Research, & Information Systems. Who is this guy? Why should we listen to you?. Brad Pitt-like looks Vin Diesel physique I collect data and measure stuff for a living.
E N D
Measuring Vocational Program Outcomes: What We Know and What’s Next Patrick Perry Vice Chancellor, Technology, Research, & Information Systems
Who is this guy? Why should we listen to you? • Brad Pitt-like looks • Vin Diesel physique • I collect data and measure stuff for a living. • I have all the data. • Information Management & Institutional Research: • IM…therefore IR.
My Credo • I realize that I will not succeed in answering all of your questions. Indeed, I will not answer any of them completely. The answers I provide will only serve to raise a whole new set of questions that lead to more problems, some of which you weren’t aware of in the first place. When my work is complete, you will be as confused as ever, but hopefully, you will be confused on a higher level and about more important things.
Today’s Learning Outcomes • Learn about recent impacts of fee increases/budget cuts on Voc. enrollments • Learn about vocational course completion rates • Know the trends of awards/certificates conferred in the system • Learn about wages by degree type • Learn about wages by TOP code • Learn about the ARCC/1417 Wage Study (Pre-Post)
Effects of Degree Attainment on Wages • Recent study done in support of ARCC/Ab1417 Accountability Project • Catharine Liddicoat, CCC Research Unit
Effects of Degree Attainment on Wages • Methodology: • Take all award recipients in 2000-2001 who were • Not enrolled in 01-02 and 02-03; and • Not transferred to a 4-yr college; and • Had a record on EDD’s wage file • Cut post-attainment wages by award type and TOP code of award (2+ years after)
Study Domain • 2000-2001 “Completers Cohort” had 14,516 students • 12,105 earned one award; 2,411 earned 2 or more • 78.7% had wage data for all 3 years out • Looking at only single award earners who had 3 years of wage data: • Study N=9,490
TOP 5 Highest Earning: • 5. Admin. Of Justice ($54,158) • 4. Plumbing & Pipefitting ($56,628) • 3. Corrections ($62,414) • 2. Physicians Assistant ($64,658) • 1. Surveying ($70,626)
Bottom 5: • 5. Fashion Design ($16,206) • 4. Animal Science ($14,086) • 3. Home Health Aide ($14,081) • 2. Cosmetology ($11,616) • 1. Spanish ($9,307)
ARCC/AB1417 • Is the next Accountability report of the CCC System • Features College-level metrics and System-level metrics
ARCC/AB1417 • Ideally, we desired to produce program completion rates for all voc. Programs, but… • MIS does not collect data on student program of study
ARCC/AB1417 • Metrics Associated with Vocational outcomes: • Student Progress & Achievement Rate-College Metric • FTF cohort tracked over 6 years • Tracks students who attempt transfer or degree-applicable level math + English courses as “behavioral intent to complete” • Outcomes: Transfer, Transfer-prepared, transfer-directed, AA/AS, Certificate, or “earned 30 units” threshhold
ARCC/AB1417 • Annual Successful Course Completion Rate (Vocational Courses)—College Metric • Same as in PFE Report
ARCC/AB1417 • Annual Volume of Degrees/Certificates Conferred (System Metric) • Cut by TOP code • Increase in Total Personal Income as a result of degree/certificate attainment (System metric)
ARCC/AB1417 • Draft report sent to college ~October • 60-day review of draft report, data resubmission allowed • Peer Groupings created for metrics • Final draft of report to field ~January • 30 day “response to report and local analysis”; college comments made a part of the report • Report due March • Colleges have 1 year to have local board review report and acknowledge having interacted with it
Your Turn… • We are always open to hearing good research ideas…feel free to contact us so we may assist. • Thanks for inviting me to your conference!