The Student Learning Project: Identifying and Measuring Learning

1. The Student Learning Project: Identifying and Measuring Learning Monday, March 12, 2012 10:30 AM - 11:30 AM Michael N. Christakis, Ph.D. Assistant Vice President – University at Albany 2012 NASPA Annual Conference s Phoenix, Arizona s March 10–14, 2012

2. (Appropriately…) Learning Outcomes • By attending this presentation, participants will be able to: • Identify modes of building staff capacity (and gaining staff buy-in) around a learning outcomes framework (and a clearly articulated learning outcomes vernacular); • Developing specific, measurable learning outcomes; • Identify methods that provide direct measures of student learning.

3. What This Presentation WILL…

4. From "Satisfaction" to "Learning"

5. Characteristics for Success • The importance of leadership. • The role of staff buy-in. • The need to build capacity.

6. Characteristics for Success

7. Learning Outcomes Framework:Identifying, Identifying, Identifying... • Identifying learning domains (CAS, Learning Reconsidered, etc.). • Identifying (specific) learning dimensions. • Identifying (even more specific) learning outcomes: the Student Learning Project.

8. Campus Models University of Texas - El Paso: • "Mine Tracker"

9. Campus Models University of Pittsburgh: • "Outside the Classroom Curriculum"

10. Campus Models Slippery Rock University: • "The Co-Curricular Experience Program"

11. UAlbany's "Framework" • Since the spring 2009, sought to purposefully identify learning experiences that UAlbany students engage in through their daily interactions with programs, activities and services throughout Student Success. • Student Success adopted five broad “learning outcome statements” during the summer 2009 and urged units across the Division to adopt these statements or develop unit-specific statements that remain consistent with the spirit of the five Divisional statements. • Since then, limited progresswas made towards realizing learning as illustrated in the five learning outcome statements.

12. UAlbany's "Student Learning Outcomes Areas" (Summer 2009) Students will be able to… • Make healthy life choices that reflect a balance of intellectual, emotional physical, professional, social, and spiritual well-being. • Respect the diversity of our community as well as the individuality of each member. • Engage in the life of the university and other communities as participants and leaders. • Develop goals and identify resources needed for their attainment. • Communicate effectively, appropriately address and resolve challenges, and manage conflict.

13. UAlbany's NEW (and Improved!) "Framework" (Summer 2011) Division of Student Success Unit/Program-Level

14. UAlbany's "Framework" • Learning Domain – “Learning domains” are broad titles which characterize experiential learning experiences students will have outside of the classroom while enrolled at UAlbany. Domains can consist of one or more learning dimensions. • Learning Dimensions – “Learning dimensions” identify relevant and desirable student learning and development outcomes as prescribed by the CAS Frameworks for Assessing Learning and Development Outcomes (FALDOS). • Learning Outcomes – “Learning outcomes,” developed at the unit-level, are program-specific and encourage the achievement of one or more learning dimensions. Learning outcomes must provide evidence, through direct measurement, of student learning. Learning outcomes are identified, realized and measured as part of the Division’s Student Learning Project.

15. UAlbany's "Framework" • The Student Success newStudent Learning Outcomes Framework – composed of three learning domains – articulate the types of learning experiences we value most in Student Success. • Student Success’ Student Learning Project aims at developing unit level learning outcomes in each of the Division’s three learning domains each academic year, beginning in 2011 and concluding in 2014. • Learning outcomes should be both attainable and measurable.

16. UAlbany's "Framework" • Balanced Life Choices – Students will achieve balance between educational, personal, physical, professional, interpersonal and spiritual pursuits in order to become well rounded individuals. • Cultural Awareness – Students will demonstrate an awareness of and have an appreciation for the differences and similarities between cultures. • University Citizenship – Students will be informed and engaged University citizens, while contributing one’s talents to make a difference on campus and in the surrounding community.

17. UAlbany's "Framework" • The Division’s Assessment Council engaged in a three-week exercise during the winter intersession in January 2011 and again in January 2012. • The outcome of the exercise resulted in two specific, measurable learning outcomes per unit – 28 learning outcomes in all in the first year (an additional 28 specific, measurable outcomes each of the remaining two years). • The “Student Learning Project” attempts to: • Identify particular learning experiences; • Operationalize those experiences through an assessment instrument which provides a direct measure of student learning; • Articulate to key stakeholders (e.g. students, faculty, etc.) the efficacy of students learning experiences outside of the classroom.

18. UAlbany's "Framework" • “The Student Learning Project is a three year long enterprise that focuses our Divisional assessment efforts on student learning…” • “What we do not have…is good evidence – through direct measures – of students’ learning as a result of…our services…programs and activities.” • Student Learning Project (Pocket Guide), 2011

19. The Student Learning Project

20. The Student Learning Project: Multicultural Student Success • 96%of freshmen were able to correctly identify the terms “diversity” and “inclusion” after attending the diversity and inclusion presentation at summer Orientation. • 61% of freshmen were be able to identify one campus resource available to increase their cultural competency while at UAlbany after attending the Diversity and Inclusion presentation at Summer Orientation.

21. The Student Learning Project: Multicultural Student Success • 603 out of 630 correctly identified the terms “diversity" and “inclusion.” • 397 out of 647 identified one campus resource available to increase their cultural competency, including (top three): • Participation in student groups • Multicultural Resource Center • The Study Abroad Office

22. The Student Learning Project: Orientation • 78% of new freshmen were able to identify a campus resource they can access to assist them to be successful academically as a result of attending Orientation. • 52%of new transfer students were able to identify a campus resource they can access to assist them to be successful academically as a result of attending Orientation. • 72% of Orientation Assistants were able to accurately explain Meal Plan Options as a result of attending UAS training.

23. The Student Learning Project: Orientation • 503 out of 647 (freshman) and 132 out of 255 (transfer) identified a campus resource to assist them to be successful academically, including: • Advisement Services Center • Academic Support Services * • The University Libraries • 39% more Orientation Assistants were able to accurately explain meal plan options following training (33.3% before; 72.2% after).

24. The Student Learning Project: Parent & Family Services • 43%of parent and family members were able to identify a campus representative to contact with future questions as a result of attending the parent program as part of their students Orientation. • 339 out of 790 parent and family members identified a campus representative, including: • Holly Barker-Flynn (122 or 36%) • Chris Fernando (110 or 32%) • Suzanne Freed (51 or 15%)

25. The Student Learning Project: Explore UAlbany • 87% of students were able to identify one way to connect with faculty by attending Explore UAlbany. • 84% of students were able to identify one tip or resource to succeed in a UAlbany Classroom by attending Explore UAlbany.

26. The Student Learning Project: Explore UAlbany • 137 out of 158 were able to identify one way to connect with faculty, including (top three): • Office Hours • Food for Thought Lunch Program • Participate & Ask Questions in Class • 132 out of 158 were able to identify one tip or resource to succeed in the classroom, including (top three): • Ask/answer questions in class • Sit in front • Utilizing Professors (get to know personally or go to office hours)

27. Next Steps • Increasing use of “direct measures” of student learning across the Division. • Deeper examination of aspects to students’ learning/experience while at UAlbany. • Example: Identifying how to succeed academically and actually doing those things. • Provide interim reports in late March and again in mid-June with preliminary findings following this past fall's and this spring's efforts.

28. Lessons Learned • Good things take time. • If at first you don't succeed... • It's not always about the outcome, sometimes it's about the effort! • It's usually about the outcome, but always about the measure! • Don't reinvent the wheel; there is lots of great information and valuable models out there already.

29. Contact Michael N. Christakis, Ph.D. Assistant Vice President for Student Success University at Albany, SUNY 1400 Washington Avenue | Albany, NY 12222 email: mchristakis@albany.edu phone: 518.956.8140 | twitter: @MikeChristakis

30. * * Audio recordings + synchronized slide presentations from a select number of presenters Mac and PC compatible Includes 80 sessions * Can’t be in two places at once? Now you can! 2012 NASPA Annual Conference DVD-ROM SPECIAL ONSITE PRICE of $89 (plus S&H) Order Now! Price increases to $139 after the conference! This exclusive offer is brought to you by *The data DVD-ROM is meant to be used ONLY on computers with DVD-ROM drives. The product will ship approx. 6-8 weeks after the conference ends. Note – special pricing available for onsite purchases only, price will increase after conference ends.