1 / 30

Oklahoma Association for Institutional Research and Planning Fall 2007 Conference

Oklahoma Association for Institutional Research and Planning Fall 2007 Conference. National Voluntary System of Accountability (VSA) — Impacting the Way Institutions Conduct Assessments and Report Learning Outcomes. Measuring Up and the National Assessment Pilot Project. Oklahoma.

bjorn
Download Presentation

Oklahoma Association for Institutional Research and Planning Fall 2007 Conference

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Oklahoma Association for Institutional Research and Planning Fall 2007 Conference

  2. National Voluntary System of Accountability (VSA) — Impacting the Way Institutions Conduct Assessments and Report Learning Outcomes

  3. Measuring Up and the National Assessment Pilot Project

  4. Oklahoma

  5. National College-Level Learning Assessment Pilot Project on College-Level Learning Sponsored by the Pew Charitable Trusts Margaret Miller, Project Director

  6. Learning

  7. on College-Level LearningKey Questions What do all of the state’s college-educated citizens know and what can they do that contributes to the social good? What kind of educational capital do they represent? and/or

  8. Key Questions How well do the state’s public and private colleges and universities collectively contribute to that educational capital? What do those whom they educate know and what can they do?

  9. Measuring College-Level Learning • Measuring Up 2002: Kentucky pilot • Measuring Up 2004: five-state trial (IL, KY, NV, OK, SC) • Measuring Up 2006: grade states

  10. Direct Measures • Graduate exam and licensure pass rates • ACT WorkKeys in math, reading, locating info., listening, business writing • CAE Collegiate Learning Assessment with GRE writing sample • National Assessment of Adult Literacy

  11. Indirect Measures • National Survey of Student Engagement (NSSE) & Community College Survey of Student Engagement (CCSSE) • Peterson’s Collegiate Results Survey

  12. Institutional Participation • Contact alumni in Summer 2003 • Administer assessments in Fall 2003 • Use results as desired • No institution-level data were reported • Statewide sample of public and private • No direct costs to institutions

  13. National Commission on the Future of Higher Education“Spellings Commission” “a national discussion on how we can ensure our system of higher education remains the best in the world and provides more opportunity for all Americans”

  14. Secretary Spellings’ Concerns • Access • Affordability • Quality • Transparency and Accountability • Innovation

  15. Spellings priorities from “Action Plan for Higher Education: Improving Accessibility, Affordability and Accountability” • Access including K-16 alignment • Learning measures for college preparation, workforce readiness and adult literacy • Financial aid: 1) need-based and 2) Science, Technology, Engineering and Mathematics (STEM) • Affordability including efficiency • Data systems to track student success • Learning outcomes for college graduates including comparable reporting • Accreditation including comparable learning measures and transfer

  16. Commission Findings • Transparency and Accountability “We have noted a remarkable shortage of clear, accessible information about crucial aspects of American colleges and universities . . . Our complex, decentralizedpostsecondary education system has no comprehensive strategy, particularly for undergraduate programs, to provide either adequate internal accountability systems or effective public information.” “No current ranking system of colleges and universities directly measures the most critical point—student performance and learning.” – Secretary Spellings

  17. State Perspective of Spellings Commission How Should States Respond to A Test of Leadership? by Paul E. Lingenfelter State Higher Education Executive Officers (SHEEO) Change, 2007

  18. State Perspective of Spellings Commission • What should states do? • Establish a state agenda • Develop policy capacity • Increase access • Lower costs • Improve Performance

  19. Improve Performance Student Assessment has been mandatory system-wide since 1991. The institutions report annually on entry-level course placement, general education competencies, program outcomes, student satisfaction, and the impact this information has had on learning and decision-making.

  20. Improve Performance Key Indicators of Accountability is the State Regents’ biennial report card that tracks the progress of Oklahoma higher education in several key including preparation of high school students, college attendance, benefits of higher education, affordability, degree completion and economic development. http://www.okhighered.org/studies-reports/report-card/

  21. Improve Performance Unitized Data System (UDS) collects student, course and faculty data from all Oklahoma higher education institutions providing a rich source of information for reporting and decision-making since the early 1980s. Oklahoma Education Information System (OEIS) is a Web-based, data warehouse accessible to all higher education institutions in the state.

  22. Improve Performance High School Indicators Project consists of four data-intensive annual feedback reports provided to school boards, superintendents and high school principals since the early 1990s. The reports show the school’s performance related to remediation by subject, ACT scores, college going rates, first-year college credits earned and grade point average.

  23. Improve Performance The Brain Gain initiative, which began in 1999, promotes the improvement of graduation rates at all state system institutions. Performance funding rewards institutions that improve or reach peer targets for first-year retention, graduation and degrees conferred. Incentives are provided to institutions most in need of improvement to implement new projects.

  24. Improve Performance Career Readiness Certificates are being promoted in conjunction with the Department of Commerce. ACT WorkKeys assessments are directly matched to the level of skills needed to perform specific jobs. WorkKeys are being used by community colleges in partnership with Tinker Air Force Base to match graduates with employment opportunities at Tinker.

  25. VSA “Toward a Public Universities and Colleges Voluntary System of Accountability for Undergraduate Education” is a national project in which Oklahoma is contributing to promote public reporting of standardized measures of college-level learning that recognizes the various missions of higher education institutions and the value added by a college education.

  26. VSA • VSA proposed measures: • Full-time vs. part-time • Gender • Ethnicity • Age • 4-year and 6-year graduation rates • First-year retention rates • Cost • Financial Aid • Yields

  27. VSA • VSA proposed measures: • Entering academic characteristics • Degrees awarded by field • Class size • Faculty characteristics • Institutional characteristics • Housing • Future plans • Student experience (CSEQ, CSS, NSSE, UCUES) • Learning outcomes (CAAP, CLA, MAPP)

  28. Future impact on assessment and reporting outcomes? • More collaboration among institutions • More collaboration among states • More standardization of accountability measures

  29. www.okhighered.org dstuart@osrhe.edu 405-225-9168

More Related