1 / 43

What’s in YOUR toolbox?

What’s in YOUR toolbox?. Investigating Milestones and Completions at a Local Institution Based on adelman’s study, “The toolbox Revisited.”. Daniel Martinez, PhD Associate Dean, Institutional research Riverside community college district. Inspiration. What this is not Critique

mahina
Download Presentation

What’s in YOUR toolbox?

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. What’s in YOUR toolbox? Investigating Milestones and Completions at a Local Institution Based on adelman’s study, “The toolbox Revisited.” Daniel Martinez, PhD Associate Dean, Institutional research Riverside community college district

  2. Inspiration • What this is not • Critique • Replication • What it is • What if? • Verification of milestones • Exploration

  3. Difference From Toolbox • Datasets • Adelman • NCES transcript-based grade cohort study • Cooperative Institutional Research Project (CIRP) • NCES Beginning Postsecondary Students (BPS) Survey • Martinez • State MIS data • Local administrative system • Local assessment database • National Student Clearinghouse • Decision rules • Type of regression

  4. Analytic Steps: Adelman Demographic background & high school history Postsecondary entrance 1st postsecondary year history Factors of financing postsecondary education Postsecondary attendance patterns Extended postsecondary performance Final model with complete academic history

  5. Analytic Steps: Martinez Demographics High school history 1st semester performance 1st year performance Completion of transfer level English or math within 1st 2 years of enrollment Extended postsecondary performance Continuous enrollment

  6. Population First time students (self-reported) in Fall 2002 Prior enrollments used to verify Age?

  7. Age Distribution

  8. Population First time students (self-reported) in Fall 2002 Prior enrollments used to verify Age < 20 High school graduates

  9. Demographics • Gender • Ethnicity • White/Asian • Black/Latino • 1st generation • FG4 • FG2

  10. High School History • Placement test scores • English • Math/Math test • Reading • Self-reported high school information • English grade • Highest level of math • Grade in highest level of math • Time since last math class • Geometry • HS GPA

  11. 1st Semester Performance Units attempted Units earned GPA Delay Time of day

  12. 1st Year Performance Units attempted Units earned GPA

  13. Transfer Level English/Math in 1st 2 Years Units earned in transfer level math in the 1st 2 years of postsecondary enrollment Units earned in transfer level English in the 1st 2 years of postsecondary enrollment

  14. Extended Postsecondary Performance Overall GPA Transfer units Developmental education units Summer enrollment Winter enrollment Part-time Financial aid Withdrawals Repeats

  15. Final Step Continuous enrollment

  16. Completer Tracked for 6 years 2 year degree or certificate 4 year degree Transfer to a 4 year school

  17. The Analyses

  18. Step 1: Demographics What was entered: Gender Ethnicity 1st generation

  19. Step 1: Demographics What survived: Gender Ethnicity 1st generation (modified)

  20. Step 1: Demographics What survived: Gender Ethnicity 1st generation (modified) R=.181 R2=.033

  21. Step 2: High School History What was entered: Gender Ethnicity 1st generation Followed by: • Placement test scores • English/Math/Math test/Reading • Self-reported high school information • English grade • Highest level of math • Grade in highest level of math • Time since last math class • Geometry • HS GPA

  22. Step 2: High School History What survived: Gender 1st generation Placement Test: Reading HS: Grade in English HS: Highest level of math HS: Grade in highest level of math HS: Geometry

  23. Step 2: High School History What survived: Gender 1st generation Placement Test: Reading HS: Grade in English HS: Highest level of math HS: Grade in highest level of math HS: Geometry R=.328 R2=.108

  24. Step 3: 1st Semester Performance What was entered: Gender 1st generation Placement Test: Reading HS: Grade in English HS: Highest level of math HS: Grade in highest level of math HS: Geometry Followed by: Units Attempted 1st Units Earned 1st GPA 1st Delay Time of day

  25. Step 3: 1st Semester Performance What survived: Gender 1st generation HS: Highest level of math HS: Grade in highest level of math HS: Geometry Units earned 1st GPA 1st

  26. Step 3: 1st Semester Performance What survived: Gender 1st generation HS: Highest level of math HS: Grade in highest level of math HS: Geometry Units earned 1st GPA 1st R=.429 R2=.184

  27. Step 4: 1st Year Performance What was entered: Gender 1st generation HS: Highest level of math HS: Grade in highest level of math HS: Geometry Units earned 1st GPA 1st Followed by: Units attempted year Units earned year GPA year

  28. Step 4: 1st Year Performance What survived: Gender 1st generation HS: Highest level of math HS: Grade in highest level of math HS: Geometry Units earned 1st GPA 1st

  29. Step 4: 1st Year Performance What survived: Gender 1st generation HS: Highest level of math HS: Grade in highest level of math HS: Geometry Units earned 1st GPA 1st R=.427 R2=.182

  30. Step 5: Transfer English/Math in 1st 2 Years What was entered: Gender 1st generation HS: Highest level of math HS: Grade in highest level of math HS: Geometry Units earned 1st GPA 1st Followed by: Units earned in transfer level English in 1st 2 years Units earned in transfer level math in 1st 2 years

  31. Step 5: Transfer English/Math 1st 2 Years What survived: Gender 1stgeneration HS: Highest level of math HS: Geometry Units earned 1st GPA 1st Transfer level math in 1st 2 years

  32. Step 5: Transfer English/Math 1st 2 Years What survived: Gender 1stgeneration HS: Highest level of math HS: Geometry Units earned 1st GPA 1st Transfer level math in 1st 2 years R=.478 R2=.228

  33. Step 6: Extended Postsecondary Performance What was entered: Gender 1st generation HS: Highest level of math HS: Geometry Units earned 1st GPA 1st Transfer level math in 1st 2 years Followed by: Overall GPA Transfer units Developmental education units Summer enrollment Winter enrollment Part-time Financial aid Withdrawals Repeats

  34. Step 6: Extended Postsecondary Performance What survived: Gender 1st generation HS: Geometry Units earned 1st Transfer level math in 1st 2 years Summer enrollment Developmental education units

  35. Step 6: Extended Postsecondary Performance What survived: Gender 1st generation HS: Geometry Units earned 1st Transfer level math in 1st 2 years Summer enrollment Developmental education units R=.520 R2=.270

  36. Step 7: Continuous Enrollment What was entered: Gender 1st generation HS: Geometry Units earned 1st Transfer level math in 1st 2 years Summer enrollment Developmental education units

  37. Step 7: Continuous Enrollment What was entered: Gender 1st generation HS: Geometry Units earned 1st Transfer level math in 1st 2 years Summer enrollment Developmental education units Followed by: Continuous enrollment

  38. Step 7: Continuous Enrollment What survived: Gender 1st generation HS: Geometry Units earned 1st Transfer level math in 1st 2 years Summer enrollment Developmental education units Continuous enrollment

  39. Step 7: Continuous Enrollment What survived: Gender 1st generation HS: Geometry Units earned 1st Transfer level math in 1st 2 years Summer enrollment Developmental education units Continuous enrollment R=.526 R2=.276

  40. What’s NOT Here Ethnicity Placement test scores Part-time enrollment Financial aid Withdrawals Repeats 20 unit milestone

  41. Implications Milestone research may not be applicable to local institutions Effectiveness of placement tests needs to be examined 1st generation dataneeds to be utilized The outcomes used in research need to be critically examined

  42. Limitations/Future Research Not disaggregated by student characteristics Measures could be strengthened Identify gateway courses and investigate their impact on student achievement

  43. Thank You

More Related