220 likes | 246 Views
OUTCOMES ASSESSMENT. Developing and Implementing an Effective Plan. Principle 1. Outcome Assessment. Excellence in sport management education is evaluated through the assessment of student learning outcomes and operational outcomes.
E N D
OUTCOMES ASSESSMENT Developing and Implementing an Effective Plan
Principle 1. Outcome Assessment • Excellence in sport management education is evaluated through the assessment of student learning outcomes and operational outcomes. • Institution is required to have developed and fully implemented an O/A process.
Creating the Outcomes Assessment Plan 1. Mission and Broad-Based Goals 2. Student Learning Outcomes 3. Basic Skills Development 4. Student Personal Development 5. Methods for Measuring Effectiveness
Mission and Broad-Based Goals Institution: Provide your institution’s approved mission & broad-based goals Sport Management Program: Provide the approved broad-based goals for your sport management program Measurement: State how you will provide evidence that the goals are being accomplished
Student Learning Outcomes • Description of what your students are able to do • Clear and measurable • Related to the goals of the institution. • Identify measurement tools you will use/Rubric design • What is a learning outcome?
Measure Attainment of Learning Outcomes • Identify a minimum of: • two direct measures • two indirect measures • Explain the process for how your measures will provide meaningful results • Provide copies of your instruments/rubrics in the appendix
Determine Measures and Assessment Tools Types of Measures: Student Learning Outcomes (Direct) Student Learning Outcomes (Indirect) Student Satisfaction (Indirect) Operational Effectiveness (Indirect) Note: Two direct and two indirect measures are required.
Direct Measures Direct Measures: Demonstrates direct evidence of student learning Examples: Comprehensive exams Standardized national exams Pretest and posttest assessments Portfolios Capstone assessment
Pre/Post Testing • Develop test to address course content – relate to CPC areas • Administration • Embed within select course • Introduction to sport management • Capstone seminar • Set benchmarks for expected improvement
Written & Oral Communication Assessment Written • Format • Mechanics • Grammar • Content • Organization • Style Oral Communication • Use of technology • Presentation design • Speaks clearly • Enthusiasm • Stays on topic • Content • Professional Image
Capstone Assessment • Capstone course measurements • Foundation courses used as a basis for instrument development • Internship Portfolio • Case study
Case Assessment - Selection & Question Development • Direct Measure – link to specific outcome • Define clear purpose • What are you trying to measure? • Broad range of outcomes vs. specific areas • Issues to consider • Is the case comprehensive enough to address all areas being assessed • Case selection for graduate and undergraduate programs
Case Selection & Question Development (cont.) • Select Specific Learning Outcome • Demonstrate knowledge of the fundamental principles of the sport management field. • Cases and questions developed to address this outcome • Questions tested, reviewed and refined
Development Of Evaluation Rubric • Rubric development • Analysis of core sport management content areas and relevancy of measurement through selected case • Evaluation criteria and weightings agreed upon • Grading consistency • Training
Indirect Measures Indirect Measures: Indirect evidence of student learning outcomes (asking versus demonstrating) Examples: Internship evaluations National or program-specific student satisfaction surveys - NSSE Student SWOT analysis Alumni survey
Basic Skills Development • Prepare a statement on the “Basic Skills” development program at your institution • Describe how this is administered within the sport management dept. • Programs to help students with writing deficiencies • Tutoring services
Personal Development of Students • Prepare a statement on the “Personal Development” of students at your institution • Describe how this is administered within your academic unit • Special programs focused on personal development – student leadership • First year seminar
Measuring Program Effectiveness • Explain how you will measure the effectiveness of your sport management program • Accomplishment of goals and objectives in the strategic plan • Retention data • Graduation rates • Teaching evaluations • SWOT
Problem Areas • Direct measures – linking measure to specific outcome • Rubric development & data collection • Go beyond use course grades • Role of teaching evaluations
Useful Resources • http://course1.winona.edu/shatfield/air/rubrics.htm • http://academic.scranton.edu/department/assessment/ksom/