240 likes | 373 Views
ASSESSMENT. Are you having an impact? How do you know? Are the programs and services you work on getting better? How do you know?. What is Assessment?. Assessment is any effort to gather, analyze, and interpret evidence which describes institutional, divisional, or agency effectiveness.
E N D
ASSESSMENT • Are you having an impact? • How do you know? • Are the programs and services you work on getting better? • How do you know?
What is Assessment? • Assessment is any effort to gather, analyze, and interpret evidence which describes institutional, divisional, or agency effectiveness. • Evaluation is any effort to use assessment evidence to improve . . . effectiveness. --(Upcraft and Schuh, 1998)
What is Assessment? • Outcomes AssessmentOutcomes assessmentillustrates the effectiveness of a program in relation to program goals.
What is Assessment? • Outcomes AssessmentOutcomes assessmentillustrates the effectiveness of a program in relation to program goals. With its focus on student learning, outcomes assessment indicates the extent to which students can demonstrate knowledge, skills, and behaviors that are consistent with program goals.
What is Assessment? • Outcomes AssessmentOutcomes assessmentillustrates the effectiveness of a program in relation to program goals. With its focus on student learning, outcomes assessment indicates the extent to which students can demonstrate knowledge, skills, and behaviors that are consistent with program goals. Like teaching, the purpose of assessment is to ensure that students are learning what you intend for them to learn.
What is Assessment? • Outcomes AssessmentOutcomes assessmentillustrates the effectiveness of a program in relation to program goals. With its focus on student learning, outcomes assessment indicates the extent to which students can demonstrate knowledge, skills, and behaviors that are consistent with program goals. Like teaching, the purpose of assessment is to ensure that students are learning what you intend for them to learn.
What is Assessment? Assessment is a PROCESS, not an EVENT.
What is Assessment? Assessment is a PROCESS, not an EVENT.
What Assessment Does • Establishes a baseline • Establishes that what we have done works • Raises doubts, undermines certainty • Motivates learning
Why Do Assessment? • Impact (Effectiveness) • Improvement • => Accountability
Levels of Assessment • Program • Department • Division • Institutional • State • Country
Measurement Methods • Evidence of Learning – Two Types: • Direct – methods of collecting information that require the students to display their knowledge and skill. • Indirect – methods that ask students or someone else to reflect on the student learning rather than asking the student to directly demonstrate his/her learning. Marilee Bresciani, North Carolina State, 2004. Palomba & Banta, 1999
Comprehensive Assessment Model • Tracking data • Needs assessment • Student/client satisfaction • Campus or student culture • Outcomes • Comparable institutions – best practice • Nationally accepted standards (i.e. CAS)
Typical Components of Assessment Plans • Mission • Objectives • Outcomes • Evaluation Methods • With criteria and by outcome • Implementation of Assessment • Who is responsible for what? • Timeline • Results • By outcome • Decisions and Recommendations
Organizing Assessment for Advisors • Defined Mission • Goals • Learning Outcomes: what knowledge should be gained by working with you? • Metrics • Who are you serving? What are their interests and needs? • Demographic data • Volume (seasonal?) • Services offered/utilized
How do you use the information? • Presenting the information: • What are the important things to gather? • How do you stay credible? • “Is there an opportunity to take it to the faculty?”Dissemination strategies • How do you adapt your program?Learning Outcomes do change over time!Results can lead to changes in goals or outcomes or both, especially unexpected results.
Resources • CAS for Academic Advising
Resources • Institutional Research http://www.ir.colostate.edu • The Operational Data Store (ODS)http://www.informationsystems.colostate.edu/Security Forms to get access • Student Voice http://studentvoice.com/Work with Dave McKelfreshif Student Affairs or Kim Bender if Academic Affairs • PRISM – CSU’s online file cabinet of annual assessment plans – lots of outcomes to look at, best practices!http://assessment.colostate.edu • SAN (comments made in AriesWeb)Work with Mike Brake to get the info you need back outhttp://ariesweb.colostate.edu
What can I do today? • Mission and Goals! • Track who you are seeing and what services are offered • Data available to me • Tracking my effort • Analysis
Data Available to Me • Program of Study (Major/Concentration) • Race/ethnicity • Gender • Residency • First Generation • Pell • Student Type/Class/Level • Academic Standing, GPA, Credits • Enrolled in which semesters? • Special attention populations • Precipitous Grade Change, 0.0 GPA, Students with a “U” at midterm
Tracking my effort • Appointments by purpose • Contacts by type • Referrals by Office • Advisor/Advisee Load • Attendance at events
Analysis • Description of Population