1 / 23

The Future of Student Learning Outcomes Assessment within the VSA

The Future of Student Learning Outcomes Assessment within the VSA. Christine Keller VSA Executive Director Teri Lyn Hinds VSA Associate Director. Higher Learning Commission Annual Conference Chicago, IL ▪ April 7, 2013. Presentation Outline.

erol
Download Presentation

The Future of Student Learning Outcomes Assessment within the VSA

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. The Future of Student Learning Outcomes Assessment within the VSA Christine Keller VSA Executive Director Teri Lyn Hinds VSA Associate Director Higher Learning Commission Annual Conference Chicago, IL ▪ April 7, 2013

  2. Presentation Outline Review original goals of VSA, student learning outcomes pilot project Discuss selected findings, recommendations from NILOA evaluation of SLO Pilot, participant reports Describe use of evaluation results: technical work group, communications advisory group Outline next steps for VSA: new reporting options, refocus/rebranding

  3. Voluntary System of Accountability the undergraduate student experience through a common web report – the College Portrait. www.collegeportraits.org Initiative by public universities to supply straightforward, comparable information on No rankings, no spin Just the facts!

  4. VSA Overview • Developed, launched in 2007 • 70 institutions, 80 leaders • APLU and AASCU partnership • Three original objectives • Demonstrate accountability, transparency • College search tool • Support innovation in the measurement, reporting of student learning outcomes • 300 participating public universities

  5. Student Learning Outcomes Pilot Goal: Directly measure, publicly report student learning gains (value-added) at institution level using a common method Skills: critical thinking, analytic reasoning, problem solving, written communication Tests: CAAP, CLA, ETS Proficiency Profile Reporting includes link to institution specific learning outcomes data Pilot period ended December 2012

  6. Evaluate Effectiveness of Pilot Conducted by National Institute for Learning Outcomes Assessment (NILOA) Focus groups Interviews Surveys Google Analytics College Portrait statistics

  7. NILOA’s mission is to document student learning outcomes assessment work, identify and disseminate best practices, and support institutions in their assessment efforts. Surveys ● Web Scans ● Case Studies ● Focus Groups ● Occasional Papers ● Website ● Resources ● Newsletter ● Listserv ● Presentations ● Transparency Framework ● Featured Websites ● Accreditation Resources ● Assessment Event Calendar ● Assessment News ● Measuring Quality Inventory ● Policy Analysis ● Environmental Scan www.learningoutcomesassessment.org

  8. Findings I VSA in 2007 was a wise, timely, useful, necessary response to the accountability , transparency demands of the time Many eligible institutions - about 1/3 - do not participate in the VSA 50% of participating institutions missing student learning outcomes information The student learning outcomes section of attracts little traffic

  9. Findings II College Portrait: “Information posted may not reflect the needs of prospective students, families or provide the information they seek to make decisions about where to attend college.” Student Learning Outcomes: “The standardized test measures of student learning outcomes lack broad credibility and acceptance in the higher education community, undermining institutional participation and engagement with the VSA and campus faculty and staff support of the VSA initiative.”

  10. Recommendations “Mend it, don’t end it” Expand range of assessment tools and approaches Focus on specific audiences and communicating meaningful information

  11. Working Group Deliberations Technical work group considered alternative measures of learning outcomes to recommend to VSA Board Confirmed importance of student learning outcomes reporting within the VSA No perfect of measure of student learning exists for all audiences External accountability Institutional improvement College selection

  12. Working Group Deliberations II Continue use of value-added measurement using CAAP, CLA, ETS Proficiency Profile Introduce option to use VALUE Rubrics based on AAC&U essential learning outcomes Introduce option to use aggregate scores from professional and graduate admissions exams such as the GRE, GMAT, LSAT, and MCAT

  13. VSA Board Decisions Broader Focus & Outreach Evolution from college selection website to consumer information tools New audience focus: state officials, accreditors Expanded Learning Outcomes Options Original tests - CAAP, CLA, ETS PP Plus AAC&U VALUE rubrics – critical thinking, written communication Both value-added, benchmarked reporting

  14. Participant Pilot Experience Report Pilot project wrap-up: VSA participants describe, publish pilot project experiences using three part form 92 institutions completed the Pilot Experience Report 65 participated – administered or tried to administer one of the instruments 27 did not participate

  15. Participant Experiences 27 institutions posted results to their College Portrait 16 found the results useful on campus CLA was the most frequently reported 38 institutions tried to administer an instrument 14 reported difficulty meeting minimum sample size requirements 8 reported campus concerns with sample sizes, even when they met publisher recommendations

  16. Non Participant Experiences 27 institutions did not participate Campus perceptions that the instruments wouldn’t provide useful results at 9 institutions 7 institutions has more pressing institutional priorities 6 institutions were concerned about the monetary cost of the instruments

  17. Future SLO Reporting Plans Institutions asked to select all options under consideration by campus 28 institutions considering more than one option Many institutions exploring benchmarking and value-added for the same instrument 44 institutions considering the ETS PP Either/both value-added, senior-only benchmark administrations 34 institutions considering AAC&U VALUE Rubrics

  18. Expanded Focus & Outreach Form Communication Advisory Groupfrom public affairs, communications, government affairs Promote key elements on College Portrait: success and progress rate, cost of attendance, net price calculator, financial aid, future plans Re-connect with key audiences: assessment experts, state/system officials, accreditors

  19. New Tools for Users Institutions can publish Success & Progress Rate graphs and tables for customized student groups Part-time students, veterans, Pell-recipients Augmented cost, financial aid info Net price and financial aid by income range, average indebtedness, average loan payment

  20. Upcoming Releases VSA Affordability Estimator improvements provide more accurate net price estimates, clearer presentation of results (May) Learning Outcomes Pilot Project Report will summarize campus experiences, lessons from 4-year pilot (May) At-a-Glance tool for government affairs staff will offer streamlined, summarized view of key indicators (August)

  21. Bottom Line • Unprecedented challenges for public higher education to be more accountable and more transparent concerning value, outcomes • Work to position the VSA/College Portrait as a tool to respond to those challenges

  22. College Portrait website: www.collegeportraits.org Reports & Presentations: www.voluntarysystem.org Twitter:@VSAvoice Blog: http://vsavoice.blogspot.com/ Christine Keller Executive Director ckeller@aplu.org Teri Lyn Hinds Associate Director thinds@aplu.org

More Related