290 likes | 478 Views
Assessment Cycle. California Lutheran University Deans’ Council February 6, 2006. Assessment Cycle. Assessment Symposium. Strategic Plan 2014. Program Review. California Lutheran University
E N D
Assessment Cycle California Lutheran University Deans’ Council February 6, 2006
Assessment Cycle Assessment Symposium Strategic Plan 2014 Program Review CaliforniaLutheran University Dedicated to educating leaders for a global society who are strong in character and judgment, confident in their identity and vocation, and committed to service and justice. Core Values Excellence Service Diversity Respect Responsibility Courage Pursuit of Truth
Assessment Cycle Program Review Assessment Symposium Strategic Plan 2014 Assessment Symposium
Purpose Assessment Symposium Report assessment evidence and ways in which the evidence was and will be used to improve student learning and the quality of our service. Live Action Research
Guiding Principles Assessment Symposium • Simple • Meaningful A Work in Progress
Benefits Assessment Symposium • Sharing of research and learnings (e.g. Program Review) • Engages various members of the University Community • Listen, learn, and appreciate others
Benefits Assessment Symposium • Supportive environment via roundtable format • Encourages assessment to become part of our practice • Research in Action!
Features Assessment Symposium • 5 step model • 5 – 10 minute presentation • One goal • Standardized PowerPoint format • Review and practice sessions
5 Step Model Assessment Symposium • What goal was set? • What research design / measure was used? • What data were collected? • What emerged from data (analysis)? • What recommendations are made?Measurable goals set?
Examples Assessment Symposium Academics • Program Review including External Review • External Review only Operations
External Review Assessment Goal • Review of Foundations Courses and Student Teaching Seminar conducted by an external university team • Purpose: to investigate • Repetition of concepts • If “diversity” met NCATE standard 4 • If field experiences met NCATE standard 4 • If Foundation learning outcomes aligned with Student Teaching • If exit survey provided data for improvement Sample
Research Design and Data Collection Sample • Content analysis of syllabi including candidate learning outcomes and anchor activities • Analysis of exit survey • Interviews with Dean and Foundations Coordinator
Analysis of Data Sample • Findings • Syllabi content analysis shows appropriate content • “Diversity” depth is sufficient • Field experiences appropriate for Foundations courses • Appropriate alignment of Foundations and Student Teaching Seminar learning outcomes • Exit survey should be strengthened
Future Goals Sample • Goals for upcoming year: • Continue to align online and onsite syllabi and anchor activities • Distribute specific TPE responsibility between Foundation courses • Specify school demographics for Field Activities to ensure experience in diversity • Gather exit portfolio data to help guide program improvement decisions
Operations Assessment Goal Sample Reduce the number of complaints received from credential students
Research Design Sample • Measures Used to Collect Data Toward Goal Progress • Established categories for complaints and recorded data daily Resulting from previous Data Analysis: • Created position of Student Service Coordinator • Provided additional training in customer service and technical areas • Implemented the development of staff professional portfolios
Data Collection Results Sample
Analysis of Data Sample • Fewer complaints received in areas with closer proximity of a credential supervisor. • Mis-advisement has the most room for improvement; most related to changes or confusion about state or university regulations or policies. • Fewer complaints were received in locations where professional development was regularly utilized. • Greater number of student-centered initiatives and fewer complaints received from areas where staff had developed professional portfolios.
Future Goals Sample • Develop, implement and measure additional ways to communicate policies in order to decrease “mis-advisement” complaints. • Determine the relationship between complaints and participation in professional development and proximity of credential supervision provided. • Design and implement staff professional portfolios state-wide.
Assessment Symposium • May 2006, a.m. • Format
Assessment Cycle Program Review Assessment Symposium Strategic Plan 2014 Program Review
Program Review • In Progress: • 5 reviews completed Spring 2006 • Revised Template, incorporating Assessment Plan into Program Review • Program Review Handbook • March Workshops for upcoming Reviews • External Reviewers • Internal Reviewers
California National External Reviewers Program Review • Credentials • External perspective Lutheran link Aspiring link • Study components of program through a series of specific review objectives or answer questions as prepared by program faculty.
External Reviewers Program Review • Receive copies of the Program Review Report data in advance • May be asked to respond to questions such as: • Do references in syllabi adequately cover current knowledge in the field? • Do CVs of faculty demonstrate appropriate qualifications for teaching in this program? • Does the curriculum demonstrate an undergraduate / graduate level of instruction? • Are assessments appropriate?
External Reviewers Program Review • Complete a site visit and conduct interviews with administrators, faculty, students, employers, and alumni, as well as review facilities.
Program Review External Reviewers’ Report • Three to five pages • Prepare preliminary report on-site • Responds to the objectives or questions • Includes three parts: general comments, singles out features of the program that merit commendations, and makes recommendations where there is room for improvement
Internal Reviewers Program Review • California Lutheran University faculty members from outside the college or school of the program under review • Assessment Committee, Assessment Director, Associate Provost, Provost, GPEC, …
Assessment Cycle Assessment Symposium Strategic Plan 2014 Program Review CaliforniaLutheran University Dedicated to educating leaders for a global society who are strong in character and judgment, confident in their identity and vocation, and committed to service and justice. Core Values Excellence Service Diversity Respect Responsibility Courage Pursuit of Truth
Assessment Cycle California Lutheran University Deans’ Council February 6, 2006 Halyna Kornuta Director of Assessment and Educational Effectiveness