Download
1 / 48
480 likes | 604 Views
CARTA Assessment Retreat. May 4, 2012 Office of Academic Planning and Accountability (APA) Florida International University. Introduction. Susan Himburg, Director of Accreditation, APA Mercedes Ponce, Director of Assessment, APA Katherine Perez, Associate Director of Assessment, APA
E N D
CARTA Assessment Retreat May 4, 2012 Office of Academic Planning and Accountability (APA) Florida International University
Susan Himburg, Director of Accreditation, APA • Mercedes Ponce, Director of Assessment, APA • Katherine Perez, Associate Director of Assessment, APA • Barbara Anderson & Claudia Grigorescu, GAs, APA
What would you like to learn and accomplish in this retreat? What would you like to accomplish within your unit to enhance your current assessment processes? Goal Setting Activity Retreat Goals Unit Goals
Assessment Cycles Assessment Review Process Types of Assessments Programs Colleges/Schools Administrative Units Continuous Improvement Assessment-based improvement strategies Documenting improvement strategies Coding and analyzing improvement strategies Overview of Assessment: Structure
Overview of Assessment: Timeline Cycle A
The University Assessment Committee is composed of two branches Academic Administrative Role Represent their academic and administrative units Provide their unit with assessment guidance Best practices Deadlines Connecting faculty & staff to appropriate assessment resources Enhance the culture of assessment at FIU Engage in dialogue with fellow experts to improve assessment practices Overview of Assessment: Assessment Committee
Academic Programs Student Learning Outcomes (SLOs) All academic programs Miami-based programs On-site, off-shore, and distance learning programs Academic Learning Compacts (ALCs) Program Outcomes (POs) All academic programs Miami-based programs On-site, off-shore, and distance learning programs Core Curriculum Outcomes (COs) Global Learning (GL) Administrative Assessments for Academic Units Assessment Units Included Dean’s Offices Centers/Institutes Overview of Assessment: Types of Assessment
Student Learning Outcomes (SLOs) • Student Learning Outcomes (SLOs) is a program related outcomes • SLOs focus on students’ knowledge and skills expected upon completion of an academic degree program • “A learning outcome is a stated expectation of what someone will have learned” (Driscoll & Wood, 2007, p. 5) • “A learning outcome statement describes what students should be able to demonstrate, represent, or produce based on their learning histories” (Maki, 2004, p. 60) • “A learning outcome describes our intentions about what students should know, understand, and be able to do with their knowledge when they graduate” (Huba & Freed, 2000, p. 9-10) • What should my students know or be able to do at the time of graduation?
Global Learning Outcomes (GL) • Global Learning for Global Citizenship =FIU's Quality Enhancement Plan (QEP) • Multi-year initiative enables students to act as engaged global citizens • Integrated global learning curriculum and co-curriculum • Minimum of two GL-designated courses for Undergraduate students • These are the GL outcomes: • Global Awareness: Knowledge of the interrelatedness of local, global, international, and intercultural issues, trends, and systems • Global Perspective: Ability to develop a multi-perspective analysis of local, global, international, and intercultural problems • Global Engagement: Willingness to engage in local, global, international, and intercultural problem solving
Program Learning Outcomes (POs) • Program Outcomes (POs)focus on expected programmatic changes that will improve overall program quality for all stakeholders (students, faculty, staff) • Program outcomes illustrate what you want your program to do. These outcomes differ from learning outcomes in that you discuss what it is that you want your program to accomplish. (Bresciani, n.d., p. 3) • Program outcomes assist in determining whether the services, activities, and experiences of and within a program positively impact the individuals it seeks to serve. • Emphasizes areas such as recruitment, professional development, advising, hiring processes, and/or satisfaction rates. • How can I make this program more efficient?
Administrative Assessment (AAs) • Administrative Areas • Dean’s Office • Centers/Institutes • Outcomes aligned to: • Unit mission/vision • Annual goals • University mission/vision • Strategic plan • Outcomes focus on each of the following areas (all 4 required for Dean’s Office): • Administrative Support Services • Educational Support Services • Research • Community Service • Student learning is also assessed for units providing learning services to students (e.g., workshops, seminars, etc.)
Assessment Tracking • Microsoft Word • Forms • TracDat: http://intranet.fiu.edu/tracdat/
Activity Writing SLOs and POs
Tying Outcomes to Curriculum: Curriculum Maps • Introduced = indicates that students are introduced to a particular outcome • Reinforced = indicates the outcome is reinforced and certain coursesallow students to practice it more • Mastered = indicates that students have mastered a particular outcome • Assessed = indicates that evidence/data is collected, analyzed and evaluated for program-level assessment • *Adapted from University of West Florida, Writing Behavioral, Measurable Student Learning Outcomes CUTLA Workshop May 16, 2007.
Understanding Types of Measurements • Direct versus Indirect Measures • Direct Measure:Learning assessed using tools that measure direct observations of learning such as assignments, exams, and portfolios; Precise and effective at determining if students have learned competencies defined in outcomes • Indirect Measure: Learning assessed using tools that measure perspectives and opinions about learning such as surveys, interviews, and evaluations; Provide supplemental details that may help a program/department understand how students think about learning and strengths/weaknesses of a program • Program Measures versus Course Measures • Program Measure: Provides data at the program level and enables department to understand overall learning experience; Includes data from exit exams and graduation surveys • Course Measure: Provides data at the course level and enables professors to determine competencies achieved at the end of courses; Includes data from final projects/presentations and pre-post exams • Formative Measures versus Summative • Formative Measures: Assessing learning over a specific timeline, generally throughout the academic semester or year • Summative Measures: Assessing learning at the end of a semester, year or at graduation
Course Level • Program Level • Portfolios • Exit exams • Graduation surveys • Discipline specific national exams • Essays • Presentations • Minute papers • Embedded questions • Pre-post tests Examples of Measures/Instruments
Institution-Level Assessments NSSE FSSE Graduating Master’s and Doctoral Student Survey Graduating Senior Survey Student Satisfaction Survey Global Learning Perspectives Inventory Alumni Survey Proficiency Profile Case Response Assessment (Kuh & Ikenberry, 2009, p. 10)
Reporting Results • Summary of Results • Format • Narrative • Tables or charts • Analysis/Interpretation of results • Explain results in a narrative form by interpreting results or using qualitative analysis of the data. • Every student learning outcome must have at least: • One set of results • One student learning improvement strategy (use of results)
Reporting Results • Non-Examples: • Our students passed the dissertation defense on the first attempt. • All the students passed the national exam. • Criteria met. • Examples: • 75% of the students (n=15) achieved a 3 or better on the 5 rubric categories for the capstone course research paper. Average score was: 3.45 • Overall, 60% of students met the criteria (n=20) with a 2.65 total average. The rubric’s 4 criteria scores were as follows: • Grammar: 3.10 (80% met minimum criteria) • Research Questions: 2.55 (65% met minimum criteria) • Knowledge of Topic: 2.50 (55% met minimum criteria) • Application of Content Theories: 2.45 (60% met minimum criteria)
Activity Developing Improvement Strategies
Thank you for attending.Contact Us:Katherine Perezkathpere@fiu.edu305-348-1418Departmental Information:ie@fiu.edu305-348-1796PC 112
