210 likes | 336 Views
2008 Library Assessment Conference, Seattle, WA. Using iSkills to measure instructional efficacy: One example from the University of Central Florida Penny Beile University of Central Florida. Background. Institutional description SACS Quality Enhancement Plan
E N D
2008 Library Assessment Conference, Seattle, WA Using iSkills to measure instructional efficacy: One example from the University of Central Florida Penny Beile University of Central Florida
Background • Institutional description • SACS Quality Enhancement Plan • Accreditation driven initiative • Four programs initially selected • Multiple assessments
Methods - Nursing • Goal is to collect baseline data, design curricular interventions, reassess to evaluate instructional efficacy • Nursing students matriculate as a cohort, ~120 students enter each semester for BSN program • Analyze at cohort level and across cohorts
Results of 2007 Administration • 114 students in class, 107 completed iSkills • Scores ranged from 485 to 625, m=561.36, sd=29.94 • Established cut score of 575
How Data are Being Used • To identify where instruction is needed • Over time, to assess efficacy of interventions and instructional models • To provide evidence that we are meeting our instructional goals
Implications for Practice Assessment offers a critical and objective way to see how effective we are in meeting our instructional goals • Do libraries contribute to the academic mission of the institution? • How effective are our current models? • Lead us to explore new frameworks
2008 Library Assessment Conference, Seattle, WA Using iSkills to Measure Instructional Efficacy: The CSU Experience Stephanie Brasley California State University, Office of the Chancellor sbrasley@calstate.edu
Background- Calif. State University 23 Campuses Information Competence (IC) Pioneers Sponsoring Partner with ETS on iSkills Assessment IC Grant Program, iSkills Focus, 2006-2008 9 Campuses Snapshot of Use California Maritime Academy – Small campus CSU Los Angeles – Medium-Sized campus San Jose State – Large campus
California Maritime Academy (CMA) - ApproachMindy Drake – mdrake@csum.edu Advanced test used as pre-test Goal: Baseline Data and Current skills-set Test Groups: Freshmen in Com 100 and Engr 120 151 Tested; 137 analyzed: 57% of incoming frosh Seniors in capstone courses 80 tested; 49 analyzed: 32% of Senior population
CMA - Deliverables Information Fluency and Communication Literacy Learning Objectives Rubric for assessing the development of information and communication technology skills within course assignments Modified COM 100 & ENG 120 assignments and supplemental materials Syllabus and iSkills-influenced learning objectives of the newly developed LIB 100: Information Fluency in the Digital World course
CMA – Summary Results iSkills data used in 4 ways Development of learning objectives Baseline for ICT Literacy of incoming freshmen Determining ICT Literacy skill-set of current seniors Catalyst for innovation in design of ICT literacy instructional activities for freshmen
CSU Los Angeles – ApproachCatherine Haras - charas@calstatela.edu Advanced test used as pre-post test Goal: Evaluate ICT literacy-related instructional interventions Target Group: 234 students enrolled in Business Communications (Juniors and Seniors) Approx. 60% transfer students and 70% ESL students Study run over three quarters (Fall 2006, Winter 2007, Spring 2007)
CSU Los Angeles StudyMethodology Treatment (day) Instructor A Business 305 Curriculum 1.5 hr Library Lecture Two Library Workshops Information Literacy project iSkills Posttest iSkills Pretest Treatment (evening) Instructor B Business 305 Curriculum 1.5 hr Library Lecture Two Library Workshops Control Instructor A Business 305 Curriculum 1.5 hr Library Lecture
CSU Los Angeles - Summary Results Treatment (day) Control Treatment (evening)
CSU Los Angeles – More Results Submitted June, 2008 – J. of Education for Business
San Jose State UniversityToby Matoush – tmatoush@sjsu.edu Advanced test used as a post test Goal: Determine gaps and develop instructional interventions Test Groups: Freshmen: MUSE students (59); Eng. 1B (100) Sophomores - Juniors