320 likes | 443 Views
Using CCSSE to Assess Skyline’s iSLOs. April 22, 2013 David D. Ulate Interim Dean of PRIE. Community College Survey for Student Engagement (CCSSE) in General. Measures student engagement on a variety of dimensions Asks questions about institutional perceptions as well as student behaviors
E N D
Using CCSSE to Assess Skyline’s iSLOs April 22, 2013 David D. Ulate Interim Dean of PRIE
Community College Survey for Student Engagement (CCSSE) in General • Measures student engagement on a variety of dimensions • Asks questions about institutional perceptions as well as student behaviors • Useful for benchmarking and as a diagnostic tool • Survey items can be viewed at: • http://www.skylinecollege.edu/prie/feedback.php
CCSSE & iSLOs Can be used as a proxy for achievement of institutional SLOs Benefits: data already available, custom scales can be crafted from 91 content items Caveats: self-reported, indirect measure not directly designed to assess SLOs
The Process CCSSE conducted at Skyline in Spring 2012 Sample of over 800valid responses to same survey questions used in 2008 Item analysis conducted in 2008 and carried over to 2012, selecting 4 to 16 items per iSLO David converts data into 0 – 100 scales and analyzes in Spring 2013
Skyline’s iSLOs Citizenship Critical Thinking Effective Communication Information & Computer Technology Literacy Lifelong Wellness
Citizenship iSLO -15 Survey Items (1) Worked with other students during class Worked with classmates outside of class to prepare class assignments Tutored or taught other students Discussed ideas with others outside of class Had serious conversations with students of different race/ethnicity Had serious conversations with students who differ in religious / political / personal values
Citizenship iSLO -15 Survey Items (2) Internship / field / co-op experience College encourages contact among students from different economic / social / ethnic groups College provides support you need to thrive socially Participation in college-sponsored activities
Citizenship iSLO -15 Survey Items (3) • Experience at college contributes to: • Acquiring a broad general education • Working effectively with others • Understanding people of other racial & ethnic backgrounds • Developing a personal code of values & ethics • Contributing to the welfare of your community
Critical Thinking SLO – 11 Items (1) • Asked questions in class / contributed in class discussions • Made a class presentation • Worked on paper or project requiring integrating ideas / info from various sources • Experience at college contributed to: • Thinking critically and analytically • Solving numerical problems
Critical Thinking SLO – 11 Items (2) • Coursework at the college emphasizes: • Memorizing facts, ideas, or methods • Analyzing the basic elements of an idea / theory • Synthesizing and organizing ideas, info, experiences • Making judgments about value or soundness of information / arguments / methods • Applying theories / concepts to practical problems • Using information you have read / heard to perform a new skill
Effective Comm. SLO – 8 Items (1) Asked questions in class / contributed in class discussions Made a class presentation Prepared two or more drafts of paper / assignment before turning it in Worked on a paper or project that required integrating ideas or information from various sources
Effective Comm. SLO – 8 Items (2) • Discussed ideas from your readings or classes with instructors outside of class • Discussed ideas with others outside of class • Experience at this college contributed to: • Writing clearly and effectively • Speaking clearly and effectively
Info & Comp. Tech SLO – 4 Items Used the internet or instant messaging to work on an assignment Used email to communicate with an instructor College emphasizes using computers in academic work Experience at this college contributed to using computing and information technology
Lifelong Wellness iSLO -16 Items (1) Asked questions in class / contributed in class discussions Come to class without completing readings / assignments Discussed grades / assignments w/instructor Talked about career plans with an instructor or advisor Discussed ideas from readings / classes with instructors outside of class
Lifelong Wellness iSLO -16 Items (2) • Skipped Class • College emphasizes: • Providing support you need to help you succeed • Helping you cope with your non-academic responsibilities • Hours spent preparing for class
Lifelong Wellness iSLO -16 Items (3) • Quality of relationships at college with: • Other Students • Instructors • Administrative Personnel / Offices • Experience at college contributes to: • Learning effectively on your own • Understanding yourself • Developing clear career goals • Gaining information about career opportunities
Comparing 2012 and 2008 Results • Overall comparison • Means for each iSLO • iSLO comparisons • Percentages for score ranges
Comparison Summary (Means) • Overall • Increased on three iSLOs. • No change on two iSLOs. • Increase • Citizenship (+1.2) • Info. & Comp. Tech (+2.4) • Lifelong Wellness (+1.4) • No change • Critical Thinking • Effective Communication
Comparison Summary (iSLO Score Ranges) • Top 5 Increases • Info. & Comp. Tech – Over 80 (+4%) • Critical Thinking – Over 80 (+2%) • Critical Thinking – Under 30 (+2%) • Effective Comm. – Under 30 (+2%) • Lifelong Wellness – Over 80 (+2%) • Top 4 Decreases • Critical Thinking – 30-39 (-3%) • Info. & Comp. Tech – 50-59 (-3%) • Info. & Comp. Tech – 40-49 (-2%) • Lifelong Wellness – 50-59 (-2%) • Citizenship - not represented here.
Next Steps • Discussion of scales • Do we have the right items? • Should they be weighted equally? • General discussion • Are these results where we want them to be? • Over time and in 2012 • What should future benchmark goals be? • Over time and in 2012 • Do we need other ways of assessing iSLOs directly?