Quantitative Data Presentation

1. Quantitative Data Presentation Rutgers University Education & Employment Research Center School of Management and Labor Relations Janice H. Levin Building 94 Rockafeller Road Piscataway, NJ 08854 www.smlr.rutgers.edu

2. Role as Third Part Evaluators • Heather McKay, Director – hmckay@work.rutgers.edu • Debra Borie-Holtz, Senior Research Analyst – dbholtz@rutgers.edu • Suzanne Michael, Senior Research Analyst - sm1246@rci.rutgers.edu • Laura Barrett, Senior Program Coordinator - laurabar@rci.rutgers.edu • Renee Edwards – Senior Project Manager – redwards@work.rutgers.edu • Joseph Rua – Research Analyst – joseph.rua@rutgers.edu • Jim Lloyd – Research Associate – james.lloyd@rutgers.edu • Ian Markey – Research Associate – ian.markey@gmail.com

3. What Are We Measuring? • Validation of Data • Attainment of TAACCCT goals • Comparison Cohort • Impact of Career Counseling

4. Method of Analysis • Quantitative: • Validation of data • Comparative Cohort • Sample Methods – TAA Round 1 • Qualitative: Process

5. Comparison Cohort • Primary Outcomes of Interest • Labor market outcomes of interest • Job placement • Career advancement • Earned wages • Job retention • Educational outcomes of interest • Credentials and degrees attained • Program retention • Program completion • Advanced/continuing education for completers

6. Monthly Report + Individual Tracking System • The Navigators will submit two reports on a monthly basis • Monthly Activity Report – Collects Information on Non-Advising work such as: • Outreach efforts • Employer Recruitment • Key Meetings (Faculty, Workforce Center, etc) • Individual Tracking System (uploaded into Monthly Activity Report) – Collects information on intensive advising efforts such as: • Student Eligibilities • Reason for Visit • Referrals Made • How Student Heard About the Program (for targeted outreach)

7. Templates • Course Unit of Analysis – This dataset contains basic data on every course redesigned under the grant or in the redesigned curriculum by student. • Student Unit of Analysis – This dataset contains basic demographic data on served CHEO students. • Course History – This dataset takes the individual students found in the Course Unit of Analysis (those sitting in redesigned course/curriculum) and provides basic data on their enrollment history • UI Data – This dataset contains the student’s wage data. This allows us to identify incumbent workers as well as those students employed after program completion.

8. Codebook • The Codebooks can be found here. • These codebooks contain the following and will be regularly updated. • Dataset the variables are stored • Variable Description • Variable’s COGNOS Name • Variable Example

9. Logic Models • Aims • CCD • EGTC • FRCC • LCC • MSU • PCC • PPCC • RRCC

10. Pathways • We are currently constructing a “Pathways document” that will contain information on the following: • What programs are redesigned under CHAMP? • What courses are part of these CHAMP programs? • What semesters did these courses run? • What is the specific course information on these courses? This information is very important because this course information with be cross referenced with CCCS’s “course bible” and serve as a validation of that information. This document is also what the data pulls by IAN at CCCS will be based off of. Therefore, you will receive a document fro us and we will ask you to validate the document and add all missing information in order to ensure it is accurate and up to date.

11. Pathways (cont’d) • Aims • CCD • EGTC • FRCC • LCC • MSU • PCC • PPCC • RRCC

12. Calendar • Our Reporting Calendar can be found at the hyperlink below. This calendar will contain the dates that reports are sent out on and due in by as well as the dates that we will be requesting data pulls from CCCS. • We will also be able to integrate your academic calendar into this document as well so that we know when your semesters begin and end. • CHAMP QUANT REPORTING CALENDAR • Two tabs – System Schools and Non-System Schools • Non-System Schools’ tab includes dates of data requests

13. Our “Ask” List: Questions for You • Data codebook? • Grade Scale – Standard? Best way to obtain grading scales (course information, syllabi, etc)? • Passing grade requirement for curriculum/CHAMP courses • Academic Semester Calendar • Academic Year schedule (AY) • Drop/Add periods • Term codes • Summer session? Winter Session? • Registration schedule • Drop/Add periods • Registrar codes (i.e. withdrawals, drops)

14. Our “Ask” List(cont’d) • Discuss Data Collection Form • Are definitions the same? • Access to wage data for labor analysis • What’s included? (Quarterly wage date, VE-135, other) • Legacy programs? • Comparable curriculum? • What years did they run? • Grant Priorities • MOU • Changes proposed or adopted since signed • Targeted students (by number and background)

15. Your Questions for Us? • What’s on your minds? What questions do you have for us? • What would you like us to include in our observations about your college’s story? • Outcomes you would like us to measure for you? • Areas that need further clarification?