Oklahoma Association for Institutional Research & Planning Spring Conference April 1, 2005

1. National Assessment of College-Level Learning Debra L. Stuart dstuart@osrhe.edu (405) 225-9121 Oklahoma Association for Institutional Research & Planning Spring Conference April 1, 2005

2. Measuring Up and the National Assessment Pilot Project

3. Learning Learning Learning Measuring Up: Graded Categories • Preparation: How adequately are students being prepared for education and training beyond high school? • Participation: Do state residents enroll in education and training beyond high school? • Affordability: How affordable is higher education for students and their families? • Completion: Do students make progress toward the complete certificates and degrees in a timely manner? • Benefits: What benefits does the state receive as a result of having a more highly-educated population? • Learning: What is known about student learning as a result of education and training beyond high school?

4. Measuring Up 2004

5. National College-Level Learning Assessment Pilot Project on College-Level Learning Sponsored by the Pew Charitable Trusts Margaret Miller, Project Director

6. Learning

7. What do all of the state’s college-educated citizens know and what can they do that contributes to the social good? What kind of educational capital do they represent? and/or on College-Level LearningKey Questions

8. How well do the state’s public and private colleges and universities collectively contribute to that educational capital? What do those whom they educate know and what can they do? Key Questions

9. Measuring Up 2002: Kentucky pilot Measuring Up 2004: five-state trial (IL, KY, NV, OK, SC) Measuring Up 2006: grade states Measuring College-Level Learning

10. Graduate exam and licensure pass rates ACT WorkKeys in math, reading, locating info., listening, business writing CAE Collegiate Learning Assessment with GRE writing sample National Assessment of Adult Literacy Direct Measures

11. National Survey of Student Engagement (NSSE) & Community College Survey of Student Engagement (CCSSE) Peterson’s Collegiate Results Survey Indirect Measures

12. Contact alumni in Summer 2003 Administer assessments in Fall 2003 Use results as desired No institution-level data will be reported Statewide sample of public and private No direct costs to institutions Institutional Participation

13. 2004 Grade Learning OKLAHOMA Five states, including Oklahoma, receive a “plus” grade for their efforts to assess and measure Learning at a statewide level through their participation in a national pilot project. +

14. Learning Learning NATIONAL SNAPSHOT

15. Learning Learning GRADING LEARNING • The pilot project measured the states in terms of: • Literacy levels of the state’s residentsWhat are the abilities of the college-educated? • Graduates’ readiness for advanced practiceHow well do colleges and universities enable students to contribute to the workforce? • Performance of college graduatesHow effectively can college graduates communicate and solve problems?

16. Learning Learning Learning OKLAHOMA Results Oklahoma has been active in attempting to improve the quality of higher education. However, the state performs below the national average on most measures of student learning.

17. Learning Learning Learning OKLAHOMA Results • Literacy levels of residents are slightly below the national average. • Higher-than-average proportions of college graduates appear prepared to enter licensed technical careers.

18. Learning Learning Learning OKLAHOMA Results • Lower-than-average proportions of college graduates are prepared for traditional graduate study. • College graduates demonstrate average performance in problem-solving skills and below-average performance in written communication.

19. Learning Learning Learning Next Steps • National publication in Fall 2005 • Distribute summary data • Expand use of WorkKeys • Continue to collect same data (e.g. licensure and certification)

20. Learning Learning Learning Next Steps • Study student motivation issues • Explore common general education competencies • Address writing deficiencies • Collaborate with other states