KSU – Quality Deanship

دور مؤشرات الأداء في تقويم وتحسين التعلم القائم على النواتج: نموذج من عمادة الجودة، جامعة الملك سعود، المملكة العربية السعودية" أ.د. أحمد عكاوي، أ.د. عوض القرني عمادة الجودة – جامعة الملك سعود – المملكة العربية السعودية الرياض 11451، ص ب 2454 - مبنى 19 akarni@ksu.edu.sa & ahmakawy@yahoo.com The role of KPIs to assess and improve the Outcomes-based Education: A model from Quality Deanship, KSU By Prof. Dr. Ahmed Akawy & Prof. Dr. Awad Al-Karni Quality Deanship, KSU KSU – Quality Deanship

We will present: • Efforts of KSU Quality Deanship in the field of OBE • The KPIs and OBE relationship • The KPIs and the overall university Outcomes • The importance, characteristics and types of the applied KPIs • How we check the integrated chain of the OBE • - The continuous improvement of the OBE Overview

23 Colleges • Medicine • Science • Humanities • Community • 61115 Students • 133 Academic Programs King Saud University

Quality Deanship Mission Continuous Improvement of Quality at All University Units Through the Implementation of Effective Quality Systems to Support the University Mission and to Achieve Its Strategic Goals

Quality Deanship KPIs Key performance indicators, KPIs or Key Success Indicators (KSI), help an organization define and measure progress toward organizational goals. Once an organization has analyzed its mission, identified all its stakeholders, and defined its goals, it needs a way to measure progress toward those goals. Key Performance Indicators are those measurements

What are Outcomes? • In KSU- Quality Deanship, we consider • Outcomes as achievements or changes in • Skill • Knowledge • Behavior • Attitude

Why we deal with OBE? • In KSU- Quality Deanship, we deal with the OBE to hopefully achieve: • Increase program effectiveness • Inform decision-making • Document completeness, successes and impacts of the university academic affairs • Increase graduate employability • Increase university media image • Increase community Development by providing highly qualified graduates • Help in correction actions and improvements

We have 64 KPIs and 54 additional KPIs covering all areas of the university activities We don't focus only on teaching and learning outcomes (OBE), but extend our view to Outcomes-based Research (OBR) and Outcomes-based Community Services (OBCS) The wide view of Quality Deanship through KPIs We have a wide view ……..

Integration Policy of the Quality Deanship Besides measuring the main three types of the university outcomes (Education, Research, Community Services), we deal with the KPIs of Management system to achieve integration and ensure the quality of the main outcomes

KSU Outcomes KPIs - Teaching and Learning (Education) Outcomes, 24 KPIs - Research Outcomes, 12 KPIs - Community Services Outcomes, 8 KPIs --------------------------------------------------------------------------------- - Management System Validity, 20 KPIs

KPIs for Processes and Outcomes There are Processes-based KPIs and Outcomes -based KPIs There are Qualitative and Quantitative KPIs

The most common KPIs used by International Universities Wheel Model for HEI Performance and its KPIs

Subsidiary Fields covered by KPIs (Examples) Research Global 66 subsidiary fields are covered by KPIs

KPIs Levels

KPIs - Inputs

KPIs Scale System • Ratio (X/Y) • Percentage (X/Y*100) • Likert scale (1-5) • Traffic light system • 100/50 (100 is better than competitor or benchmark, • 50 is less than competitor or benchmark)

Elements of KSU Outcomes - based KPIs Time Cost Quality

What KSU-KPIs measure and help in? Measure the Progress in university activities Recognize the gap between planned and achieved goals Help in structuring of correction actions

Outcomes-based Quantitative KPIs Statistics, Numbers, Ratios, Percentages, Frequency

Outcomes-based Qualitative KPIs Questionnaires visualizing opinions toward something .

Characteristics of KSU Outcomes – based KPIs • Easy to collect the required data • Simple • Easy to be understood • Sensitive to minor changes • Expressive • Fair and objective

Example of OBE KSU-KPIs Because the integration is our concept, we also deal with all inputs and processes that lead to OBE, that we call “Integrated chain of OBE” At institutional, college, and/or program level, we have KPIs to measure the integration, consistency, inputs, processes and outputs of each element of the Integrated chain of OBE

OBE Logic Model Outcomes Inputs Processes Outputs Indicators Data Sources Applied to (Who) Data Interval (When) Targets (Goals) Observable and measurable behaviors or conditions Sources of information about conditions being measured The population to be measured When data is collected The amount of impact desired What goes into outcomes planning Mission  PROGRAM PURPOSE Modified after from Karen Motylewski

Integrated chain of KSU - OBE

Example of OBE KSU-KPIs Percentage of Bachelor graduates who work in their major field of study (Z) Percentage of the Bachelor graduates who can secure jobs and who can be self-employed within one year. (%) (Z) • Field: Student achievement & Graduates Skills • Target: Highly qualified graduates who can get jobs and compete in labor market • Outcomes: Graduate Knowledge and Skills (have to be measured) • KPIs: • Percentage of graduates from undergraduate programs who within six months of • graduation are:employed, enrolled in further study, not seeking employment or • further study. • Percentage of students and alumni graduated in the last 3 years who are recognized in the areas • of academics, or profession, or sports, health, arts and cultures, and environment at the national or • international level (%) . • Percentage of Bachelor graduates who work in their major field of study. • Percentage of the Bachelor graduates who can secure jobs and who can be self-employed within • one year. (%). • Number of theses/ dissertations and students‘ academic works awarded at the national or • international level within the past 3 years (number of works).

Thanks for attention Thanks for attention

KSU – Quality Deanship