90 likes | 190 Views
Moving from Concept to Meaningful Assessment :. Cultural Competence & the Intercultural Knowledge VALUE Rubric. Ashley Finley, Ph.D Senior Director of Assessment & Research, AAC&U National Evaluator, Bringing Theory to Practice Kansas State University March 14, 2014.
E N D
Moving from Concept to Meaningful Assessment: Cultural Competence & the Intercultural Knowledge VALUE Rubric Ashley Finley, Ph.D Senior Director of Assessment & Research, AAC&U National Evaluator, Bringing Theory to Practice Kansas State University March 14, 2014
The problem with program assessment… Assessment Curriculum Outcomes Co –Curriculum
K-State & Intercultural Competence… • The mission of KSU is to foster excellent teaching, research, and service that develop a highly skilled and educated citizenry necessary to advancing the well-being of Kansas, the nation, and the international community. • The university embraces diversity, encourages engagement and is committed to the discovery of knowledge…& improvement in the quality of life and standard of living of those we serve. • the institution dedicates itself to providing academic and extracurricular learning experiences which promote and value both excellence and cultural diversity… • K-State prepares its students to be informed, productive, & responsible citizens who actively participate in advancing cultural, educational, economic, scientific, and socio-political undertakings.
Moving from Goals to Expected Outcomes Would LOVE to see EXPECT to see Would LIKE to see • University embraces diversity, encourages engagement & committed to know. discovery • learning experiences promote & value excellence & cultural diversity • students are informed, productive, & resp. citizens who actively participate in advancing cultural, educ., econ., scientific, & socio-political undertakings • Changes at program level related to… • Ethical Reasoning & Responsibility • Human Diversity in US • Global Issues & Perspectives • Expected changes at course level… • Ethical Reasoning & Responsibility • Human Diversity within the US • Global Issues & Perspectives Who needs to be involved at each stage to reach goals?
Resources needed to start or keep going: Actions needed to produce outputs: OUTPUTS (What counts as good evidence?) ACTIVITIES (What will students be asked to do?) OUTCOMES (What should improve as a direct result of efforts that contribute to the long-term vision?) INPUTS (What is needed for the process?) Impact Goals (What is the hope for the future for students, for faculty, for the institution?) Products needed to assess outcomes, “countables”: Expected Changes: short, inter-mediate Long-term vision for change
Resources needed to start or keep going: Actions needed to produce outputs: OUTCOMES ACTIVITIES (What will students be asked to do?) OUTPUTS Impact INPUTS (What is needed for the process?) • Intercultural knowledge & competence • Civic engagement • Openness to diversity • Pluralistic orientation • Empathy • Moral development • Civic-mindedness • Critical reflection papers • Research papers addressing real-world problem-solving • Blogs/Wikis • Multimedia • University embraces diversity, encourages engagement & committed to know. Discovery • learning experiences promote & value excellence & cultural diversity • General education • Teaching and learning center • Student affairs • Institutional research • Career center • Alumni center • Engagement with diverse perspectives • Group dialogue • Small group problem-solving orapplications • Engagement with contemporary issues, real-life questions Products needed to assess outcomes: Expected Changes: short, intermediate:
Intercultural Knowledge & Competence VALUE Rubric • Dimensions • Knowledge – cultural self-awareness • Knowledge – knowledge of cultural worldview frameworks • Skills - empathy • Skills – verbal and non-verbal communication • Attitudes – curiosity • Attitudes – openness • Next Questions: • What activities currently promote intercultural knowledge & competence in courses? • What assignments or demonstrations of learning invite students’ applications of intercultural skills? • How are learning experiences connected over time to make applications increasingly more rigorous?
Focusing on Outputs: Intentional Assignment Design • Assignment should enable attainment of criteria • Break down criteria to determine key components for assignment • What should students do with content to meet criteria? • E.g. What are the pieces to be analyzed, compared, integrated? • Will the assignment be used for more than one outcome? • What are the types of assignments that will be most helpful for allowing students to demonstrate competency?
Additional Resources • Logic Models: http://www.wkkf.org/resource-directory/resource/2006/02/wk-kellogg-foundation-logic-model-development-guide • AAC&U VALUE Rubrics (direct assessment of learning outcomes, including civic engagement & intercultural competence): http://www.aacu.org/value/index.cfm • Wabash Center for Inquiry in the Liberal Arts: http://www.liberalarts.wabash.edu/study-instruments/(Miville-Guzman Universality-Diversity Scale, also Openness to Diversity Scale, others…)