Demystifying Outcomes Assessment

1. Demystifying Outcomes Assessment Barbara M. Wheeling College of Business Montana State University-Billings

2. What You Will Learn • The difference between grades and assessment data • Identifying a learning outcome • Some differences between program assessment and general education assessment • Selecting appropriate assessment instruments

3. Main Points • Grades are too broad and inclusive for assessment • Three key components of assessment • Assessment points • Assessment tasks (gradeable items) • Assessment instruments • Data should be as valid and reliable as is feasibly possible

4. What Assessment Is and What It Is Not • Example of a construction company • Grades are like a profit statement • Bottom line information • Assessment is like cost data • More detailed

5. Example from class writing assignment • Grades: Average Score: 19.9/25 points 3 A’s 9 B’s 3 C’s 4 D’s 1 F’s

6. Assessment Data (5 points each) • Organization: Average score = 4.1 • Clarity: Average score = 4.1 • Spelling and Grammar: Average score = 4.4 • Readability: Average score = 4.6 • Documentation: Average = 2.7 RED FLAG!!! NEEDS IMPROVEMENT!!!

7. Assessment Cycle Mission Learning Goals (what students are or have) Learning Objectives/Outcomes (what students do) Alignment Matrix (where students learn)

8. Assessment Cycle

9. Learning Goals • Identify what students “are” or “have” • Examples from Academic Foundations: • We want MSU-B students to be effective oral communicators (LG I.4.) • We want MSU-B students to have effective mathematical/logical skills (LG I.2.)

10. Learning Outcomes • Identify what students “do” • Examples from Academic Foundations: • We want MSU-B students to demonstrate ability to understand and interpret oral information (LO I.4.b.) • We want MSU-B students to demonstrate ability to use logical skills to make judgments (LO I.2.c.)

11. More Examples • Example of a Program LG and LO: • Learning Goal: We want our students to be effective communicators in business and professional settings • Learning Outcome: We want our students to be able to prepare and properly deliver a complete, concise business presentation

12. Assessment Points • Definition: Where assessment takes place • Should be where students have reached a level of proficiency

13. Academic Programs Usually a capstone course in senior year General Education Depends on the assessment task Assessment Points

14. Course-embedded exams or assignments Best if part of course grade so students are motivated to perform well Not necessarily in the senior year Can also use portfolios, exit exams, or standardized tests Student motivation can be a problem Most likely in the senior year Assessment Tasks

15. When outcomes assess knowledge Objective test questions work well When outcomes assess knowledge and/or skills Subjective test questions can be used Paper, project, or presentation also possible Assessment Tasks

16. Objective test questions Instrument is a measure (Pass/fail score) How many students answered correctly Subjective assessment Instrument is a rubric How many students performed at an acceptable level for each trait in the rubric Assessment Instruments/Measures

17. Conclusion • Assessment is not about evaluating teaching, but may result in changing the way that we teach • Questions? • Comments? • Confusions? • Concerns?

18. Pages with Notes