1 / 14

Overview of Types of Measures

This article provides an overview of the different types of measures used in program assessment, including direct and indirect measures. It discusses the importance of reliable and valid assessment techniques that are actionable, efficient, and meaningful. The article also emphasizes the need for convergence in evaluation measures, and touches on the concept of embedded assessment within courses.

ashook
Download Presentation

Overview of Types of Measures

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Overview of Types of Measures Margaret Kasimatis, PhD VP for Academic Planning & Effectiveness

  2. Location in Assessment Cycle DETERMINE PRACTICES USED TO ACHIEVE OUTCOMES IDENTIFY SPECIFIC OUTCOMES GATHER EVIDENCE ARTICULATE MISSION/ GOALS RECOMMEND ACTIONS REVIEW & INTERPRET RESULTS

  3. Measures Within the Context of Program Assessment • For program assessment, measurement tools should capture student learning that occurs as a result of the program curriculum • Many measurement tools can be used for multiple levels of assessment • But how you use them differs • Some assessment tools are not appropriate for program-level assessment

  4. Categories of Measures • Direct Measures • Look at student work products or performances that demonstrate level of learning • Indirect Measures • Capture students’ perceptions of their learning and the educational environment that supports learning

  5. Categories of Measures • Direct Measures • Published, standardized tests (e.g., GRE Subject Test, ETS Major Field Test) • Locally developed tests • Systematic evaluation of student work(papers, presentations, creative work, performances) • May or may not be embedded within courses • Usually involves scoring rubrics • Indirect Measures • Published surveys • Locally developed surveys and interviews • Alumni surveys

  6. Properties of Good Assessment Techniques • Reliable – internally consistent; consistent across raters • Valid – measures what it is supposed to; appropriate • Actionable – results point reviewers toward challenges to address (and how to address them) • Efficient and cost effective in time and money • Interesting and meaningful – people care about the results and are willing to act on them • Convergence – multiple lines of evidence point to the same conclusion

  7. Evaluating Measures: Direct

  8. Evaluating Measures: Direct

  9. Evaluating Measures: Direct

  10. Evaluating Measures: Indirect

  11. Evaluating Measures: Indirect

  12. Evaluating Measures: Indirect

  13. A Word on Embedded Assessment • Various types of measurement tools can be embedded within courses • Only carefully constructed measures, used in certain types of courses, are appropriate for program-level assessment • Must go beyond individual course content • Some should occur in upper-level courses that are taken only after several other courses in the major

  14. QUESTIONS?

More Related