150 likes | 166 Views
Learn how to choose the right measures to assess student learning, including direct measures using work products and indirect measures like surveys. Consider factors such as timeliness, cost, and who will analyze the information. Utilize rubrics for efficient and consistent grading.
E N D
Measures • Direct – actually using a student work product • Indirect – not using a student work product
Remember this: • Measures are where the “Rubber Meets the Road” for Outcomes.
Direct Measures • Students demonstrate knowledge or skills through their work.
Indirect Measures • Perceptions of learning (e.g. a survey)
Choosing Measures • Implement the easiest/most interesting measures first • Evaluate timeliness and cost (including the most valuable resource--faculty time) • Consider WHO will analyze the information • WHEN will it be analyzed (over summer?)
Choosing Measures • Measure Student work toward the end of the degree program • Select measures that can be controlled by the program • Measure things the program can influence
Choosing Measures • For new measures, consider a pilot study to determine • difficulty of data collection • usefulness of results • whether the data answer the right question
Choosing Measures • Be mindful of motivation • An exit exam that is not part of a course grade might not accurately reflect what students know • A long employer survey may yield too low a response rate • Get faculty feedback—will they take stock in the results?
Rubrics A way to manage analytical grading by breaking the overall evaluation of an assignment into specific criteria or expectations, rating each criterion on a scale.
Rubrics • Advantages: • Saves time • All graders use the same criteria • Graders use criterion-referenced judgments (level of competence), rather than norm-referenced judgments (performance relative to others)
Rubrics Use or adapt a rubric that already exists (examples in every discipline!) OR Create one:
Or Create a Rubric! • identify the elements of the assignment to be evaluated – list down the left column of a grid • identify the levels of performance (e.g. excellent / proficient/ acceptable/ unacceptable) – list across the top of the grid • to improve reliability and reduce ambiguity, include a detailed description of each trait at each level of performance in the boxes