Download
1 / 23
230 likes | 383 Views
Assessing Quality and Sharing Best Practices for the Undergraduate Senior Thesis. Collaboration Across Three Liberal Arts Colleges Student Success and the Quality Agenda, AAC&U 2013. Teagle Senior Thesis Evaluation. Capstone as most significant student artifact No systematic evaluation
E N D
Assessing Quality and Sharing Best Practices for the Undergraduate Senior Thesis Collaboration Across Three Liberal Arts Colleges Student Success and the Quality Agenda, AAC&U 2013
Teagle Senior Thesis Evaluation • Capstone as most significant student artifact • No systematic evaluation • Developed Senior Thesis Rubric • Performed cross-institution thesis evaluation • Administered Thesis Experiences Survey • Will perform second thesis evaluation on individual campuses using rubric Collaborators New College of Florida Bard College Bennington College Colorado College Hampshire College Smith College Wellesley College
Key Questions for Thesis Evaluation • Are there common evaluative criteria across analytic disciplines? Can a common rubric be developed? • Can a rubric improve on the validity, reliability and systematicity of grades for evaluating analytic work? • Can using a rubric help institutions improve pedagogy? • To what extent do student input characteristics predict high-quality senior theses? • Can we identify student experiences that predict high-quality theses? • Do the same experiences lead to high-quality work no matter whether theses are required, optional, or honors-only?
Timeline at Bard College • June 2009: first reading/evaluation of senior theses using the rubric. Three Bard faculty participated. • June 2010: full consortium meeting at Bard. Faculty discussed results from the June 2009 reading and planned for improvement. • February 2012: meeting at Bard for Bard faculty to further disseminate the work of the grant. Led by Steve Weisler and Carol Trosset in conjunction with Bard Center for Faculty and Curricular Development. Steve and Carol also held a focus group with students. • April 2012: meeting at Bard with faculty in the performing and practicing arts from Bard, Bennington, and New College. Explored possibilities for rubrics in the arts. • May 2012: first survey of graduating seniors at Bard about their Senior Project experiences. The response from the class of 2012 was encouraging. ~160 students responded.
Results at Bard College • The results from the June 2009 meeting showed that Bard senior theses were not theses that stand alone well with respect to the rubric, in comparison with the other colleges in consortium. • The June 2010 meeting produced enough momentum to focus the discussion of the Senior Project on campus for first time in many years. Indeed, the discussion has shifted away from anecdotal stories about individual students to a discussion focused on talking about how we prepare and evaluate all students. • A number of programs have instituted practices that help students prepare for the Senior Project and provide a scaffolding for students as they progress through the Senior Project. In addition, several programs are experimenting with rubrics to advise and evaluate students. • Take home lesson for Bard: make the Senior Project more like a course.
New College of Florida Senior Thesis Practices • Public honors college, narratives instead of grades, contracts not credit hours • Senior thesis/project required of each student. • 6th semester Thesis Prospectus form • Thesis advisor and 2 additional faculty serve as Baccalaureate Committee for oral exam. • Thesis is a major focus of final semester.
Results:NCFAssessment and Priorities for Discussion 2009 Thesis Assessment Results 2012 Faculty and Student Priorities for Discussion Students & Faculty: Preparing students for thesis success before thesis year Faculty: Managing thesis workload Students: regular meetings with advisor, time to revise drafts, support for interdisciplinary and non-standard projects • In 2009 Thesis Assessment, New College compared favorably with others • New College theses weakest areas Scholarly Context and Position
Evolving NCF Thesis Discussions • Initial skepticism/resistance to rubric assessments • Later, rubric seen as possible tool: set expectations, guide theses, replace SAPA • Positive and energizing conversations with Bard and Hampshire Faculty • Hampshire’s workload depiction and assigning advisors • Bard’s midway and moderation practices • Reinvest in “projects” as well as “theses”
NCF Enduring Insights • Learning process can be highly successful even when the senior thesis itself is disappointing. • No matter how well we prepare students, there will always be a distribution from low to high quality. • There is tension in expecting students to be flexible, independent, risk-takers and also meet honors standards for senior thesis.
Thesis Rubric Introduction: Rational
Using a Rubric Diversifies and Focuses the Evaluation Process
Student judgments correlate with external readers more than with grades.
Different experiences are more common at different institutions.
What makes for a good thesis? Predicted Grade Predicted Self-Rated Quality Student felt prepared to form their own position or argument on a subject Student felt prepared to manage their own time Hours per day spent on the thesis Student usually took the adviser’s advice • Student felt prepared to find and evaluate relevant scholarship • Student felt prepared to fairly consider conflicting points of view
The Best Predictors of Quality Only two survey items predicted* both the adviser-assigned grade and self-rated quality: • Student views the thesis as the most important work done in college • Student feels challenged by the adviser to do his/her best work *in a stepwise regression equation, for more than one institution
Next Steps • Survey will be administered again this spring. • Each institution will conduct a thesis-reading applying the rubric to theses written by students who completed the survey. • A new analysis will discover whether particular experiences predict higher rubric scores for the same theses.
