Leveraging AoL to Create Value

1. Misty Bennett, Assistant Dean, Central Michigan University Brandon Shields, Assessment and Accreditation Analyst, Kent State University Leveraging AoL to Create Value

2. Our session will demonstrate how you can use AoL to… • Educate students on their performance • Motivatestudents • Engagestudents in the AoL process • Engagefaculty in the AoL process • Savefacultytime • Finally, we will engage you as the audience in surveying where our schools are at in how we value AoL through several Kahoot questions.

3. Kahoot! • Please download the Kahoot App on your mobile device to participate in today’s polling questions • When prompted, enter the Kahoot! ID: • 703430

4. Communicating to students their role and individual performance in the Assurance of Learning Process Leveraging AoL to Create Value Brandon Shields, Assessment and Accreditation Analyst College of Business Administration Kent State University

5. College of Business Administration AoL Scope 1 BBA (10 Majors) 3 MBA (FT, Online, Executive) 1 MSA 1MAE 1MSBA 1 Ph.D. (5 concentrations) 3,800+ students  85 FT Faculty 8 campus system *based on Fall 2018 data

6. How do we as educators engage students in Assurance of Learning if... • They are unaware of their role in AoL • Results are not shared/meaningful • They do not take the assessments seriously

7. Kahoot ID: 703430How aware are your students about the AoL process by the time they graduate? • Not aware at all • Slightly aware • Somewhat aware • Very aware

8. Students have questions! What is Assurance of Learning? Why is AoL important? How do I benefit from AoL? Why should I try? How is this information used? What was my score? How did my peers do?

9. Kahoot! At my institution, an administrator/faculty member specifically talks about AoL in how many classes? • 0 • 1 • 2 • 3 or more

10. Communicating Value: From the Beginning 

11. Kent State’s BBA Assessment Program • Junior Level  • Course:  • Advanced Professional Development • Learning Outcomes: • Oral Communication • Ethical Decision-Making  • Assessment: • Ethics Presentation • Performance Motivation: • Grade  • Senior Level • Course:  • Integrated Business Policies and Strategies • Learning Outcomes: • Overall Business Knowledge • Written Communication • Understanding Globalization • Assessment: • 70 Question MC Exam • Writing Case • Performance Motivation: • Bonus Points/Timing is critical

12. Kahoot!How do you primarily motivate your students to perform their best on AoL assessments? • No mechanism for motivation • Bonus points • A grade • Setting a minimum retake score • Other

13. How do we make the AoL process valuable for the College and Students?  • Focused on learning outcomes  • Focused on meeting targets • Looking for program strengths and weaknesses • Comparing results across time   • Focused on overall performance • Focused on individual score • Looking for individual strengths and weaknesses • Comparing results amongst peers

14. Individualized Student Dashboard   • Looking for individual strengths and weaknesses​ • Assessments scored with rubrics show performance breakout • Focused on learning goals​ • Business Knowledge • Oral Communication  • Written Communication • Managing Ethical Dilemmas • Global Business Knowledge  • Focused on individual score​ • Students receive score for all assessments taken for the College • Comparing Results • Results show average score for college and for student major

15. Kahoot!What do you think is most important to your students with regard to their AoL performance? • My students are not concerned with their AoL performance • Their individual performance overall • Identifying individual strengths and weaknesses • How they compare to their peers • How their program performed overall

16. Individual Student Dashboard 

17. How to create the Dashboard? Software needed: Micrsoft Word and Microsoft Excel • Get all assessment data into one spreadsheet. Use vlookup to bring data easily into one spreadsheet. • 2. Layout Dashboard on Word: • Create headings, write explanations. • Add any charts or visuals from excel. Numbers are dynamic but charts are not. • Keep spaces available for data that will change with each student: • Name  • Major • Scores • 3. Create a mail merge on Word and bring in data. • 4. Print

18. Part of Template created before the mail merge Data from Excel through mail merge

19. Kahoot!Do you think you could implement an individualized student dashboard? • No • Seems cool but I do not have the time • Maybe? I have more questions • Absolutely

20. We have Answers! What is Assurance of Learning? Why is AoL important? How do I benefit from AoL? Why should I try? How is this information used? What was my score? How did my peers do?

21. Leveraging AoL to Create Value for Faculty and Students Misty M. Bennett, Ph.D., Assistant Dean College of Business Administration Central Michigan University

22. Kahoot!How aware are your faculty of your AoL process? Not at all; they think AoL is a reference to an early instant messaging system They have heard of it! Faculty reluctantly administer our assessments in their classes Faculty are involved in every step of the process

23. How we ValueAssessment as a College:

24. How we Value Assessment

25. What does assessment mean to our students?

26. What does assessment mean to our students?

27. What does assessment mean to our faculty?

28. What does assessment mean for assessment directors, analysts, or administrators?

29. How do we create value for faculty, students, and the college???

30. A Brief History…College of Business Administration at Central Michigan University

31. Once upon a time…

33. Step 2: Restructure! – Communicate and Coordinate

34. Our Journey

35. Kahoot!Which of the following is your biggest barrier to faculty participation in AoL? Not enough time Worried it might be used punitively Faculty aren’t knowledgable about AoL/assessment Faculty view it as service credit; not added value

36. Creating Value for Faculty… Opportunities Assessment can save you time! Assessment won’t be used punitively (tenets), assessment counts for service, and names are redacted What can they use from your class in later classes or when they graduate? (training) Built research opportunities and teams Barriers Assessment takes time! Assessment data might be used against me! But I assess my own students already… Service won’t get you tenure

37. Increasing AoL value for faculty… • Teaching resources • Communication - Newsletter • CBA AoL webpage: https://www.cmich.edu/colleges/cba/faculty/Pages/Assurance-of-Learning.aspx

38. Increasing AoL value for faculty: rubrics • Faculty offered professional development funds to attend rubric creation session • Separate faculty group evaluated and revised rubrics • Faculty tested in courses and allowed to adapt them

40. Increasing rewards/recognition for faculty • Service values increased through faculty participation • Offered rewards for tracking improvement activities • Giraffe Award

41. From service to scholarship • Published case studies of process • Content analysis of department bylaws and procedures for “service” value • Rubrics for specific areas; e.g., technology • Hold open research hours on Fridays

42. Increasing Value for Students • Communicating assessment results with students • Involving students in focus groups • Student advisory council • Celebrating assessment successes, assessment day

43. We care aboutstudent learning! What are your CBA professors looking for? • Problem-solving Skills • Oral Communication & Presentation Skills • Written Communication Skills • Basic Business Knowledge • IT Skills

44. Did You Know? Problem solving is assessed in your MGT 258 course. Problem Solving: Points of Pride

45. Tip: Remember, only you think your solution is the best! Don’t forget to consider good alternatives and to explain why you wouldn’t choose them. Problem Solving: Areas for Improvement

46. Did You Know? Oral communication is assessed using BIS 101 presentations. Oral Communication: Points of Pride

47. Tip: Difficulty making eye contact?Try looking audience members between the eyes! (This creates an illusion of eye contact and is less stressful.) Oral Communication: Areas for Improvement

48. Did You Know? Written communication is measured in MGT 258 and BUS 301. Written Communication: Points of Pride

49. Tip: Readers quickly forget earlier information. Make sure to repeat the most important takeaways in the Conclusion section of your report! Written Communication: Areas for Improvement

50. Kahoot!Do you involve students in the AoL process? Yes, they see their results and give feedback to make change Yes, they see their results Yes, they are involved in a minor way No students are not involved and don't see their results