A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence

1. A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio

2. Embedded Assessments

3. What is Embedded Assessment? • Take place in a class or a group of classes  • Determines whether students are learning pre-established learning outcomes • Take advantage of pre-existing student motivation to perform well • Assess what is actually taught

4. Types of Course-Embedded Assessment • Exams • Research Papers and Projects • Performances • Field Experiences, Lab Reports and Internships • Pre/Post Comparisons • Student Portfolios • Capstone Evaluations

5. Advantages of Embedded Assessment • Student motivation is high because the assessment activity is part of a course activity • Costs are reduced because incentives are unnecessary • It usually does not require additional student time as it is part of the curriculum • It is faculty-driven and thus, more likely, to be used for improvement • Because it’s linked to the curriculum, it’s more likely to identify specific curricular needs/deficiencies • Feedback to faculty is usually quick

6. Disadvantages of Embedded Assessment • Faculty commitment is absolutely essential, but can be hard to get • Faculty resistance to the process may be substantial • Achieving agreement among faculty on an assessment approach across courses is a challenge • Usually there are no comparable data

7. SLOs Assessment vs. Grades

8. An “All-Purpose” Rubric Form to Streamline SLO Assessments

9. Workshop Focus • Our focus is on a tool that makes it easy to • Grade a regular assignment, and • Assess students’ performance on a course level SLO • The tool is an “all purpose rubric” form developed by Chaffey’s Business department

10. Benefits of the Rubric • Automates the grading process • Provides a checklist • Easily adjustable • Can be distributed to students before and/or after collecting the assignment • May be as simple or complex as the faculty member desires • Quickly and easily enables the SLO assessment

11. Excel Terminology • Worksheet • An individual spreadsheet • Workbook • A collection of worksheets combined in a file • Cell • The intersection between a row and a column in a worksheet

12. May be Simple or Complex • Examples

13. Preparing Your Rubric • Open the All Purpose file • Save it with a new name • “Assignment 2 Grading and Assessment” • Fill in line items • Assign weighted values for each item • Fill in the total points possible on the assignment

14. Preparing Your Rubric • Make copies of the worksheet to fill in for each student in the class • Type each student’s name in the worksheet tab • The student’s name automatically appears on the worksheet • Evaluate the students’ performances

15. The Assessment • Once the grading (evaluation) is complete, the workbook contains all the data needed to conduct an assessment • All you do is make a copy of the same rubric you used to grade the assignment • The trick is Excel’s 3D Reference function

16. The Assessment • Examples

17. How to Do a 3D Reference • Make another copy of the blank worksheet • Type “Assessment” into the Worksheet tab • click in cell O4, which is the cell containing the score on the first item • Type =AVERAGE(

18. How to Do a 3D Reference • click on the tab for Student 1's worksheet – Then click in cell O4 • Press down on the “Shift” key and while still holding it down, click on the tab for the last student worksheet

19. How to Do a 3D Reference • Without going to a different sheet, click in the formula bar (the one labeled “fx” near the top of the page) • You will notice that there is a formula there that reads something like this: • =AVERAGE('Student 1:Student 5'!O4 • Type a “)” at the end of the formula • Click on the green check to the left of the formula bar (or press the “Enter” key)

20. How to Do a 3D Reference • Go back to the Assessment worksheet • Cell O4 contains the average of all the students’ scores for that line item! • Copy the formula in cell O4 and paste it into all of the other cells in column O that correspond to one of the rubric’s line items

21. How to Do a 3D Reference • Once done, you have a worksheet that shows: • The class performance on each line item, and • The overall average score on the assignment

22. The Assessment • This worksheet now contains the class assessment on this project • The only extra work required on top of the grading for the assignment was to spend a few minutes creating the Assessment worksheet • Now, all you have to do is talk about the results with your colleagues!

23. A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence - The End -