STUDENT LEARNING OUTCOMES ASSESSMENT

1. STUDENT LEARNING OUTCOMES ASSESSMENT

2. Cycle of Assessment

3. Where to Start? • Lesson Plans • Syllabi Review • Course Descriptions • Reflect accurate focus? • Collaborative Effort • Are goals for a course shared by all sections? Teaching Goals Inventory

4. When Planning a Lesson : • What do you want students to “get” from the lesson? • How can this be articulated so that you will be able to know if the students “got it”? • Articulate as a goal or outcome in order to assess if students met goal of lesson

5. Scaffolding: • What are the specific goals of using scaffolding? • What are your expectations? • How will you know if scaffolding worked?

6. Principles of good goals: • Singular • Measurable • Observable Use action words • Reasonable

7. Action Verbs compare, judge, defend, appraise compile, compose, create, predict infer, deduce, diagram, outline change, demonstrate, operate, solve discriminate, estimate, explain, generalize define, list, identify, recite Bloom’s Taxonomy of Cognitive Domain Level • Evaluation • Synthesis • Analysis • Application • Comprehension • Knowledge

9. Observable Use action words • Students WILL: “interpret” “analyze” “demonstrate” “compose” “identify”

10. What is one goal for tomorrow’s class? Students will ______________ Is this goal: • Observable? • Singular? • Measurable?

11. Cycle of Assessment

12. Means of Assessment & Criteria for Success: How do you know: Students met the goal? And to what extent?

13. Types of Assessment (specifically for classroom assessment) • Minute papers • The Muddiest Point • One sentence summary • Directed paraphrasing

14. Direct: Homework assignments Exams and quizzes Standardized tests Reports Class discussion Rubric scores for writing or presentations Grades directly related to learning goals Indirect: Course Evaluations Number of hours students spend on homework Assessment of Student Learning survey responses Grades that are not based on criteria directly related to learning goals Examples of Direct & Indirect Measures of Student Learning at the Course Level

15. Test Blueprints • List of the key learning outcomes to be assessed on a test • Includes number of points or test questions aligned to each learning goal

16. RUBRICS • Criterion-based rating scale • Establishes guidelines in evaluating assignments • Can be simplistic or comprehensive • Should be pre-tested

17. Simple Checklist Rubric • Are important components of an assignment reflected in students work?

18. Simple Rating Scales • Categorizes work: 5=Excellent 4=Good 3=Satisfactory 2=Fair 1=Poor

19. Detailed Rating Scale • Provide common performance standards • Make scores more consistent • Can be given to students along with the assignment • Clear expectations- students will know what is expected of them

20. Example of a Detailed Rating Scale

21. Implementing the Assessment: • Will the means of assessment measure what you want to find out • Inform students • Explain why- to make improvements, not to grade • Read/review as soon as possible • Time: For “quick” assessments: 1-2 minutes per student assessment

22. Overall Primary total rating Component Secondary, more detailed. Identify scores which would elicit further review by faculty Criteria for Success

23. Establishing Criteria for Success • Reasonable expectation of work • Expressed in specific terms • (overall) “At least 75% of class will receive a rating of a 3.0 or better on the organization component of the research paper rubric” • (overall) “The average number of points earned in the first section of the exam will be at least 15” • (component) “No more than 5% will earn 5 points or less”

24. Cycle of Assessment

25. Summary of Data Collected • What were your results? • Did you meet, exceed or fall below your target? • What do the results tell you? • Hypothesize

26. Results Should: • Show to what extent goals were accomplished • Be linked to use of assessment means chosen • Detailed to show the assessment took place • Justify the “use of results”

27. Results Should Not: • Be statistically unlikely • Match criteria of success exactly • Not be used

28. Informing Students of Results: • What did you learn from students’ responses? • Mode of informing students • Handout or through discussion (e.g. 40% thought “X” was the muddiest point.) • Discuss any changes: • You’ll make • Students should make

29. Cycle of Assessment

30. Using Results -Is the use of results substantive enough? -Do you need to modify your pedagogy, lesson plan, goals, targets or assessment tools? -Detailed enough? -Communicated to the appropriate parties? (your students, department Chair, Dean)

31. Using Assessment Results *: Table adapted from “Student Learning Assessment, Options and Resources” by Middle States Commission on Higher Education.

32. If Results are Positive: • Celebrate your successes! • Let colleagues know!

33. If Results are Not So Positive: • What needs to be modified? • Work with colleagues • Don’t get discouraged!

34. Some Tips: • Start off in one class • Try out on yourself first • Don’t make it a chore/burdensome- keep it simple • Take note: first few times it will take a little longer • Close the loop!

35. Next Steps: • Continue the assessment cycle • Share with department • Create an assessment process • Visit Office of Institutional Research & Assessment with any questions!

36. Questions? Kimberly Gargiulo, Coordinator of AssessmentOffice of Institutional Research andAssessmentS 752220-8331kgargiulo@bmcc.cuny.edu