1 / 34

SURVEY OF RECENT GRADUATES AS AN INSTRUMENT FOR ASSISTING IN THE ASSESSMENT OF INSTITUTIONAL EFFECTIVENESS

Explore how surveying recent graduates aids in assessing institutional effectiveness. Presentation covers survey design, data utilization, and outcomes analysis for academic and engagement skills. Learn how the data contributes to department and university policies and planning.

ronalee
Download Presentation

SURVEY OF RECENT GRADUATES AS AN INSTRUMENT FOR ASSISTING IN THE ASSESSMENT OF INSTITUTIONAL EFFECTIVENESS

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. SURVEY OF RECENT GRADUATES AS AN INSTRUMENT FOR ASSISTING IN THE ASSESSMENT OF INSTITUTIONAL EFFECTIVENESS Dr. Teresa Ward Ms. Beth Katz Office of Institutional Research Georgia State University

  2. Presentation Outline • Conceptual Model • Technical Logistics • Dissemination of Survey Data • Utilization of Data

  3. Survey Matrix • General Academic Skills – Questions 1-13 • Major Area of Study and University Support – Questions 14-26 • Engagement – Questions 27-31 • Comments

  4. Survey of Recent GraduatesResponse Rates

  5. Please rate the degree of competency you had in the following areas when you entered/graduated from Georgia State University Graph 1 (Entering) Graph 2 (Exiting) *Mean range: 1=very weak competency to 5=very strong competency **p<.001 all pairs Learning Outcomes Communication Technology Collaboration Quantitative Skills Critical Thinking Contemporary Issues

  6. English Majors 5 All Others 4.7 4.5 4.5 Mean 4 3.9 3.7 3.5 3 Ability to write clearly and effectively Entering Ability to write clearly and effectively Exiting

  7. 2007 NSSE Writing Items

  8. Math Majors 5 All Others 4.7 4.5 4.3 4.3 Mean 4 3.9 3.7 3.5 3 Ability to analyze quantitative problems Entering Ability to analyze quantitative problems Exiting

  9. 2007 NSSE Quantitative Items

  10. 5 Physics Majors 4.9 All Others 4.5 4.3 Mean 4 3.7 3.6 3.5 3 Apply scientific reasoning in problem-solving Entering Apply scientific reasoning in problem-solving Exiting

  11. 5.00 4.80 Mean of communication (exiting) 4.60 4.40 4.20 Mean of communication (entering) 4.00 3.80 2.0-2.99 3.0-3.69 3.7-4.0 GPA

  12. 5.00 4.80 Mean of quantitative skills (exiting) 4.60 4.40 4.20 4.00 Mean of quantitative skills (entering) 3.80 3.60 2.0-2.99 3.0-3.69 3.7-4.0 GPA

  13. 5.00 Mean of critical thinking (exiting) 4.80 4.63* 4.56 4.60 4.47* 4.40 4.20 Mean of critical thinking (entering) 4.00 3.92 3.86 3.83 3.80 2.0-2.99 3.0-3.69 3.7-4.0 GPA *p<.01

  14. 5.00 4.80 Mean of technology (exiting) 4.60 4.40 4.20 Mean of technology (entering) 4.00 3.80 2.0-2.99 3.0-3.69 3.7-4.0 GPA

  15. *Mean range: 1=poor to 4=excellent 4 point scale: Poor to Excellent

  16. Utilization of Survey Data • Department Level • Identify strengths and weaknesses using comparative data • Identify trends and implications of program changes using longitudinal data • Ability to triangulate survey data with other assessment measures • Starting point for conversations

  17. University Level • Identify trends and implications of University policy changes using longitudinal data • Ability to triangulate survey data with other assessment measures • Contribute to strategic planning and policy discussions

  18. Conclusion • High reliability index • Focused on indirect measures of learning outcomes • Saved OIR a considerable amount of money and time via online administration • Increased response rates • Facilitated access to the data • Contributed to department and University assessment activities

  19. Teresa Ward – tward@gsu.edu • Bethann Katz – bnorthup@gsu.edu • Office of Institutional Research, Georgia State University – http://www2.gsu.edu/~wwwire/

More Related