Big Picture Learning Longitudinal Study

1. Big Picture Learning Longitudinal Study Karen Arnold Boston College December 12, 2008 arnoldkc@bc.edu

2. Research Team • Boston College Higher Education Department • Karen Arnold, Katie Wartman, Samantha Carney, Percy Napier, Jennifer May, Charlotte Martin • Big Picture Learning • Shezwae Fleming, Mario De Anda • Met Providence: Ben Castleman • College Transition Counselor: Carmen Perez

3. Longitudinal Study Questions • What becomes of Big Picture graduates in higher education, occupations, families, and communities? • What makes a difference in these outcomes? • High school experiences • Transition support • College conditions • Personal qualities • Parent, family and adult support

4. Study Mission • The Big Picture Longitudinal study tracks the lives of students from high school until age 30 in order to document their outcomes, inform school improvement, and support the continued personal and professional development of alumni…

9. Study Instruments May/June October Senior Transition Survey First Fall Update Survey Advisor Survey of Seniors Student Tracker

10. Student and Advisor Survey Responses

11. Additional Data Collection • First Fall Update Survey • 66 alumni from Class of 2006 (33%) • 114 alumni from Class of 2007 (17%) • 64 alumni from Class of 2008 (17%) • National Student Clearinghouse Student Tracker college enrollment of 2000-08 alumni from participating schools (~600) • Summer studies of college transition • National admission survey on summer melt

12. Survey Results on School Effectiveness: What’s Working • Advisor connection • Parent, family and adult involvement • College-going culture • Student self-knowledge • Real-world learning

13. What High School Taught Best #1 Knowing own strengths & weaknesses #2 Speaking clearly and effectively #3 Naming & following passions/interests #4 Preparing for post high school success #5 Learning on their own #6 Preparing for work world success #7 Knowing how to make decisions

14. % Seniors Assessed by Advisors as Somewhat or Extremely Weak • Preparation for college math 59% • Preparation for college science 54% • Readiness for college writing 43% • Readiness for college reading 35% • Time management 48% • Organizational skills 39% • Ability to ask for help 36% • Ability to work alone 30%

15. Connecting the Dots: Analysis Model Senior Transition Survey First Fall Update Survey Advisor Survey of Seniors Student Tracker May/June October

16. Senior Year (May/June) College Plans and Degree Expectations Senior Transition Survey Accepted to College: 95% -100% Expecting Fall Enrollment: 88% Expecting BA Degree: 43% Expecting Grad Degree: 37% Advisor Survey of Seniors

17. Post-Secondary Plans for 2008 Big Picture School Graduates

18. Advisor Reports of Seniors’ College Plans and Degree Expectations Advisor Survey Committed to Beginning College: 83% Committed to Earning a Degree: 82% Senior Survey

19. Correspondence of Senior Year Degree Expectations and Plans for Beginning College Seniors Enrollment Plan & Degree Plan Correlation=.189** Advisors Enrollment Plan & Degree Plan Correlation=.843**

20. Advisor Assessment of Seniors’ Intentions for Fall College Enrollment & Senior Plans

21. Advisor Assessment of Seniors’ Intentions for Fall College Enrollment & Senior Plans

22. New Graduates’ College Outcomes • 66% enrolled in college (compared with 54% of low-income students nationally) • Clearinghouse Student Tracker and First Fall Update differ on enrollment #s • No difference in college enrollment by gender, race, parents’ education, or income status

23. Student Reports of Senior Year Intentions for Fall College Enrollment (per StudentTracker)

24. Student Reports of Senior Year Intentions for Fall College Enrollment (per Student Tracker)

25. Advisor Assessment of Seniors’ Intentions for Fall College Enrollment & Student Fall Status

26. Advisor Assessment of Seniors’ Intentions for Fall College Enrollment & Student Fall Status

27. SUMMER FLOOD Post-graduate Summer Changes (~1/3 of all graduates) New College 2-yr Part time JOB

28. Summer Flood Follow-up • 2007 summer interview study • 2008 summer intervention study • Met Providence, Bronx Guild, Williams • Summer intervention outreach treatment and control groups • Enrollment results in January 2009 • 2008 national summer melt study (national admission organization NACAC)

29. Last Year’s Study Take-Homes • Over 3/4 of seniors plan fall college enrollment at the point of H.S. graduation • Substantial reconsideration of college plans over the summer • New college students generally satisfied

30. What We Learned This Year • The Big Picture equalizes opportunity for its students

33. What We Learned This Year • The Big Picture equalizes opportunity for its students • Seniors’ degree aspirations do not connect directly to their college plans • Advisors cannot reliably predict students’ college enrollment • The Clearinghouse Student Tracker is THE BEST AND BOLDESTWAY to get good college data

34. What we need to do: • Move beyond college acceptance to attendance • Post-graduation summer intervention needed • Need to make sure everyone has a plan A and B • Increase response rates and outreach to alumni • Clearinghouse data superior to self-report • Need for relationship-based data collection • Make degree aspirations realistic and tied to clear understanding of college and career paths • Enable multiple paths within a college-going culture • Needs to be acceptable to make a postponed college plan • Schools need to balance college-going ethos and parallel pathways to adult success

35. Steps for Schools • Using Alumni Manager • Supporting survey responses • Providing summer support to grads. • Tracking graduate contact info • Subscribing to Student Tracker • Sharing and using study findings

36. Next Steps for the Study • Help principals interpret school-specific data • Report on summer intervention results • Help schools subscribe to Student Tracker • Explore non-survey-based methods to reach older alumni • Continue feedback to schools • Develop consortia for alumni follow-up studies

37. Next Steps for the Study • Help principals interpret school-specific data • Report on summer intervention results • Help schools subscribe to Student Tracker • Explore non-survey-based methods to reach older alumni • Continue feedback to schools • Develop consortia for alumni follow-up studies

38. Contact Information • For information about the Big Picture Longitudinal Study: Karen Arnold Boston College arnoldkc@bc.edu • For information about the Big Picture College Transition Network: Shezwae Fleming The Big Picture Company sfleming@bigpicture.org • For a copy of the 2008 Principal's Retreat Power Point and supplemental materials relevant to the longitudinal study, please log onto the Big Picture website (www.bigpicture.org), click on the "INNOVATION" link and scroll down to the list of topics and click on "A Longitudinal Study of Big Picture School Graduates."