200 likes | 367 Views
Dr Abdul Sattar Al-Alusi, PhD Previous Director, PEQA Dean, CMIS and Prof Shaker Rizk, PhD Program Director, ELT Program ITTIHAD UNIVERSITY, Ras Al-Khaimah, UAE. A Continuous Improvement Cycle for Academic Programs: Ittihad University Case. QA. IE. Mission. Internal. Instruction.
E N D
Dr Abdul Sattar Al-Alusi, PhDPrevious Director, PEQA Dean, CMIS and Prof Shaker Rizk, PhD Program Director, ELT Program ITTIHAD UNIVERSITY, Ras Al-Khaimah, UAE A Continuous Improvement Cycle for Academic Programs: Ittihad University Case
QA IE Mission Internal Instruction External Alumni Faculty Employers PA Courses Goals & Objectives Outcomes curriculum Ministry /CAA Ed. & Admin. Support Service Students International Training Instruments Peer Review System A Continuous Improvement Cycle for Academic Programs: Ittihad University Case
A Continuous Improvement Cycle for Academic Programs: Ittihad University Case Phases/Purposes Phase onemapping measurable objectives, outcomes Phase two program effectiveness - feedback surveys. Phase three program continuous improvement
A Continuous Improvement Cycle for Academic Programs: Ittihad University Case • Models • A blend of models used for PA has been adopted in light of the needs of each phase. The eclectic model adopted by IU has comprised three major models; namely, • The objective/outcome-based model(comparing CAA standards with existing procedures), • The decision-making model (focusing on accountability to reallocate resources or decide the continuation of a program), and • The responsive model (focusing on learner-based and market-based concerns).
A Continuous Improvement Cycle for Academic Programs: Ittihad University Case Phases of Program Assessment
A Continuous Improvement Cycle for Academic Programs: Ittihad University Case
A Continuous Improvement Cycle for Academic Programs: Ittihad University Case IU has adopted an eclectic method in assessing its programs utilizing one or all of the following methods: • screening method(annual review of program against basic metrics) • 2. cyclical review( 4-year review cycle) for all programs by all colleges • 3. divisional model(select divisions: faculty or administrative) • faculty-led(Faculty Committees) • administration-led(Institutional Research Office)
A Continuous Improvement Cycle for Academic Programs: Ittihad University Case Phase One:Comprehensive Curriculum Assessment The PA Plan includes assessing the following: • Academic Program • Educational & Administrative Support Services • Steps and processes to conduct the PA • Develop mission and program objectives. • Develop Program Outcomes. • Devise quantitative metrics for measuring. • Use tools and processes to gather data. • Modify program aspects in light of mission & objectives • Conduct SWOT analysis.
A Continuous Improvement Cycle for Academic Programs: Ittihad University Case Table 1: Assessment Instruments Evaluating Program Outcomes
A Continuous Improvement Cycle for Academic Programs: Ittihad University Case Phase Two:Program Effectiveness & Improvement The PA Plan consists of: • Mapping Matrices to evaluate course & program effectiveness using: • program objectives and outcomes, • course outcomes, • assessment instruments • A three-level approach that includes: • Course Assessment • Curriculum Assessment • Program outcomes Assessment • Educational & Administrative Support Services Assessment
A Continuous Improvement Cycle for Academic Programs: Ittihad University Case The Assessment Tools used for Educational and Administrative Units/Services are shown in the following table: Table 2: Assessment Instruments for Educational Support Services
A Continuous Improvement Cycle for Academic Programs: Ittihad University Case Phase Three: Program Continuous Improvement & Change ‘Closing the Gap’ • 1. Gap Closing • Using assessment results for closing the gap: • Revised/new objectives/outcomes for the next cycle • Tasks to be completed • Resource allocation (budget) • Goal attainment • Formulating a Continuous Improvement Strategy 2. Prospective Improvement Strategy
A Continuous Improvement Cycle for Academic Programs: Ittihad University Case 3. Monitoring & Auditing • The aims of monitoring are to ensure that: • Academic programs have implemented PA Plans • Educational & administrative support units have implemented plans & submitted Annual Reports • Colleges and support units have submitted annual future plans • Academic programs have achieved outcomes and accomplished objectives • Performance Indicators are tracked • Assessment reports are sent back to the relevant program/unit for corrections, clarifications and/or modifications • Performance results and learning outcomes are kept in records for future use
A Continuous Improvement Cycle for Academic Programs: Ittihad University Case Auditing is mainly associated with; • Gaining information about the effectiveness system of the university. • Evaluating to ascertain the validity and reliability of information. • Providing assessment of IU internal control. • Constructing a link between policy-making and operational levels. • Setting objectives, providing advance notice of the audit, organizing meetings, conducting fieldwork, responding to Final Audit Report.
A Continuous Improvement Cycle for Academic Programs: Ittihad University Case Conclusion, Implications, and Recommendations
A Continuous Improvement Cycle for Academic Programs: Ittihad University Case THANK YOU
Program Curriculum – Objectives – Outcomes – Teaching and Learning Tools Analysis of Outcomes Program Outcomes are measured and analyzed by a review team/committee of faculty members that is formed by the College Council. The aim of this team is to analyze the collected data through using those assessment tools mentioned in this plan. Such tools are as Course Evaluation by Faculty, Employers' Survey, Alumni Survey, Exit Survey, Training Program Repots, direct observation reports by academic advisors, holistic review report, etc. The results of this analysis are reported to the College Council with a set of recommendations regarding the Business Administration curriculum. These recommendations are to be taken into account in the following academic year. • Phase I (Before Graduation): • First (Fall) Semester: • This phase of the program is assessed by using different instruments as listed below. • Assessment Instruments Semester Course Midterm exam. Semester activities (Assignments/Projects/Class participation, etc.) Semester Course Final Exam. Semester Course & Teaching Evaluation by students. Semester Course Evaluation (Course File) by Faculty. Graduation Project Report if relevant Exit Survey Overall GPA • Phase III (After Graduation): • Graduates are followed up to find out job placement rate, postgraduate studies, professional achievements at work, professional test (if any), employers points of view, and feedback from external sources regarding the Business Administration graduates' performance in the market. This phase is assessed by using the instruments below. • Assessment Instruments • Employers' Survey • Alumni Survey • College Council inputs / feedback • External feedback • Holistic Review • Internal & external Report. • Phase II (Before Graduation): • Second (Spring) Semester: • This phase of the Program is assessed by using the instruments below. • Assessment Instruments Semester course Midterm Exam. Semester activities (Assignments/Projects/Class Participation, etc.) Semester Course Final Exam. Semester Course & Teaching Evaluation by students. Semester Course Evaluation (Course File) by faculty. Training Program Reports. Graduation Project Report if relevant Exit Survey. Annual Education support Services Evaluation by Students Overall GPA Graduation Career A Continuous Improvement Cycle for Academic Programs: Ittihad University Case BACK
Students, Alumni, Business Community (Employers) University & College Requirements Courses College Council Program Faculty Members (Curriculum committee) Common Courses with other programs (Faculty Members) University-wide Curriculum Committee Curriculum, Outcomes, Objectives, Accreditation Standards A Continuous Improvement Cycle for Academic Programs: Ittihad University Case Figure -2 Curriculum Assessment Flowcharts BACK
Corrective Actions/Decisions Course File Report (CFR) Course & Teaching Survey Students' Activities Survey Edu. Support Services Survey University Council Training Evaluationsurvey Exit /Graduating Survey Counselling & Career Survey Residence Survey Alumni Survey Employers’ Survey Staff Evaluation Faculty/Staff Job Satisfaction Faculty Evaluation Academic Advising Survey Chancellor Unit Annual Reports (Administrative Units/Services Reports) • Course Assessment • Curriculum Assessment Report Institutional Research Office (PEQA) (Auditing /Monitoring) Program Annual Assessment Report College Annual Report University Overall Annual Report A Continuous Improvement Cycle for Academic Programs: Ittihad University Case ITTIHAD UNIVERSITY EFFECTIVENESS SYSTEM (IUES) (University Mission, Goals, and Objectives) PLANNING EDUCATIONAL, ADMINISTRATIVE, & SUPPORT SERVICES/ UNITS SSESSMENT ACADEMIC PROGRAM ASSESSMENT • Annual Plans: • . College/Program Plans • . Administrative/ٍ/ • Services Units Plans University Annual Plan Source; Al-Alusi, 2008 back BACK2
Ittihad University Mission Planning: University Goals from the Strategic Plan Program’s /Unit’s Mission Program’s /Unit’s measurable Objectives/ Outcomes: Student Learning Outcomes Method(s) of Assessment, timeframe, and resources needed Assessment Cycle Criteria for Assessment: Success Assessment Results: Measurable Goals vs assessment findings • Use of the Assessment Results: Institutional Research Monograph Series/Evaluation Reports • (CLOSING THE GAP) • For continuous improvement? • Revised/new objectives/outcomes for next cycle • Tasks to be completed • Resource allocation (budget) • Goal attainment? Based on the findings what is the continuous improvement plan? • Improvement Strategy: What are the proposed changes (with justification) made to the program/service as a result of data collection and analysis? • List the required resources for this improvement strategy. A Continuous Improvement Cycle for Academic Programs: Ittihad University Case Source; Al-Alusi, 2008