200 likes | 210 Views
Learn why and how to use survey data in academic advising, through a case study of the Integrated Social Sciences program. Explore considerations, resources, and tips for effective survey implementation and data analysis.
E N D
Using Survey Data to Enhance Advising Practice Aimee Kelly Assistant Director of Academic Services Joe Hannah Academic Adviser Integrated Social Sciences Program
Today we’ll talk about… • Why use survey data in advising? • Case Study – ISS • Considerations • Resources and Tips • Wrap-Up • Q & A / Discussion
Before we start, a bit about ISS… • 100% online degree completion program • About 350 active students – expect to grow to 500+ • “High Touch” advising model – lots of information on each student • Various data strategies • Completed our Three Year Review in Winter 2018
I. Why use survey data in advising? Initial Rationale • New program (started AUT 2014) • “How do you know what you know?” • Initial rationale for collecting information • Three-Year FCAS Report • Direct student support • Learning about the ISS student population
I. Why use survey data in advising? Anticipated and Added Benefits • Learn more about your advisees and alumni individually and as a population • Individual advising • Reporting and population-level advocacy • Outreach materials • Opportunities for curricular and programmatic assessment • Request, leverage, and distribute resources strategically
II. Case Study: ISS • Catalyst WebQ (survey tool) • Four surveys • Year One: 1. Incoming Student Survey • Required in First Quarter for Incoming Students 2. End of the Year Survey • Optional, Administered at end of Spring Quarter • On-Going (TBD): 3.Student Support Survey (Withdrawn Students) • After Graduation: 4. Alumni Survey
II. Case Study: ISS • Examples of Outcomes • Resources for advising individual students • Three-Year FCAS Report • At-a-Glance Information Sheets
II. Case Study: ISS Individual Student Advising “I am a gay second generation Filipino American” “I hope that thru completing this program I can get the skills needed to pursue a job helping people and minority groups that I am a part of.” “Outside of a few quarters here and there, I feel like I've been an underachieving student...I'm hoping I won't screw this up.”
II. Case Study: ISS Three-Year FCAS Report
II. Case Study: ISS At-a-Glance Sheets Ex. What Makes ISS Students Unique? • Educated course resource planning • Outreach to non-ISS course instructors • Financial aid advocacy • Prospective student outreach materials
III. Considerations • Survey planning stage • What do you want to know? • Is this data available via BI Portal, EDW, or other resources? • Audience? • Survey frequency/timing? • “Survey fatigue” • Aligning multiple surveys • What do you need the data for? • What is the final product that you want to create? Who is your audience?
III. Considerations • Planning stage • What skills do you have/want/need? • Resources available? • Who will create the survey, analyze the results, and report the findings? • Timelines • Creating and conducting survey • Analyzing and producing results
III. Considerations Example Data Plan • Audience for final product • Research question / Information needed • Sources for that information • Student database/ Institutional data • Student surveys • Advisers’ notes • Specific products needed • Reports • Data sheets • Presentation slides • Student management tools
III. Considerations • Survey Drafting • Create a list of survey questions! • Test/get feedback • Evaluate how question/answer structure impacts ease of analysis • Consider whether you will want compare results over time
III. Considerations Analysis • Identify and schedule timeto do the analysis work • Save copy of raw results and separate copy for analysis • Document steps taken to analyze data • Identify opportunities for efficiencies • Develop a template for analyzing data that is easy to replicate • Back-it-up!! • Build in time to assess effectiveness of survey tool to make improvements • Did you find the answers to the questions you wanted to know?
III. Considerations Analysis example
IV. Resources • Data planning and management • Data Management Research Guide • Online Data Management Workshop through UW Libraries • Designing Surveys • UW Survey Resources • https://www.washington.edu/surveys/survey-resources/ • WebQ Catalyst • https://itconnect.uw.edu/learn/tools/catalyst-web-tools/webq/webq-examples/ • Academic Experience Design & Delivery • https://catalyst.uw.edu/webq/survey/fournier/277326
IV. Resources • Data Analysis • Trainings through professional development • POD webinars: Microsoft Excel Techniques, Advanced Microsoft Excel PivotTables, Microsoft Access Techniques • UW IT • Online guides • Identify staff/faculty resources on your campus • Institutional sources of data • Institutional research office/staff
V. Wrap-Up • More benefits than anticipated • Organic vs. planned survey strategy • Data plan and back-up • Iterative improvements • Locate resources, build contacts, professional development opportunities • Time investment
Thanks for your attention! Q&A / Discussion Aimee Kelly Assistant Director of Academic Services Integrated Social Sciences aimeeap@uw.edu Joe Hannah Academic Adviser Integrated Social Sciences jhannah@uw.edu