Prof. Vera Dondur Aleksandar Jović peshes@ius.bg.ac.rs peshes.ius.bg.ac.rs/

1. XXV Conference DEVELOPMENT TRENDS IN HE - TREND 2019: Quality of the Higher Education in Serbia Panel “Key performance indicators for Serbian higher education“ February 11th, 2019 Erasmus+ CBHE Project PESHES QUALITY OF HIGHER EDUCATION: WHY INDICATORS? Prof. Vera Dondur Aleksandar Jović peshes@ius.bg.ac.rs http://peshes.ius.bg.ac.rs/

2. Strategic goals The strategic goals of higher education according to the Strategy for the Development of Education in Serbia until 2020 are grouped within strategic directions through increasing the quality and conformity of study programs with the needs of the market as well as through increasing the efficiency of the study itself, increasing the availability of different types of study programs and modernizing the existing. Quality assurance adapted to the vision and priorities of each higher education institution will encourage greater diversity and specialization of higher education institutions and will promote greater cooperation by systematically embedding results in strategic decision making, with emphasis on sustained progress. And the important issue that arises in higher education institutions is actually the issue of long-term quality assurance.

3. Project goals • For the purpose of this project we will present the possible road map for development and implementation of performance evaluation system for Serbian higher education institutions and system as whole. • The idea is to provide the set of key performance indicators, model for evaluation and ranking of study programs, and institutions. • This system could provide the number of benefits for different stakeholders. • Measurement of performance and quality is very important for efficient planning, improvement and control, as well as decision making in organizations. • Performance measurement results show the effects of strategy and potential organization capabilities. • In order to achieve the goals, it is necessary to measure performance.

4. KPIs • It is necessary to provide optimization of the indicators for study programs, institutions and HE, as well as to provide process of tuning of the indicators, definition of limits and scopes as well as to define values and limit for specific indicators. • Preliminary sets of meaningful indicators have to be tested against feasibility of data collection and policy acceptance.

5. Guiding principles for KPIs Key performance indicators should: • be relevant • be statistically and methodologically rigorous • be derived from high quality, objective data sources, and where possible collected at by an independent body, as well as not easily manipulated • be as simple, transparent and explicable as possible • have an explicit and consistently used definition • be collected and analysed cost-effectively • inform and encourage policy and practice at both the national and institution level

6. Purpose of KPIs 1. Primary role should be in monitoring and measuring HE performance ‘to provide an overview of Serbian HE’ to: • HEIs, • funding bodies/policy-makers, • the public and • students. 2. Performance based evaluation should be used in universities financing as a simulative, not as a punitive measure 3. The goal should be quality assurance, not a ranking of study programs or HEIs

7. KPIs process Goals Informations Database KPIs Internal External Generation Calculation Users What should we measure and who should we measure? Results

8. The question is how to construct meaningful KPIs? Non-profit HE institutions Profit HE institutions Serbiahasthreetypes of HigherEducationInstitutions (HEI): Universities, colleges of professionalcareerstudiesandcolleges of academicstudies. Universities are thelargestinstitutions. The status of university is grantediftheinstitutionoffersacademicstudyprograms at alllevels of studies, within at leastthreefields (naturalsciencesandmathematics, socialandhumanisticstudies, medicalscience, technicalandtechnologicalscience, andarts).A university is composed of Faculties, Art AcademiesandsometimesResearchinstitutes. Thefaculties are highereducationinstitutionswhichcarryoutacademicstudyprogramsanddevelopscientific, vocational, orartisticwork in one or more areas. Facultiesand art academiesmayalsocarryoutvocationalstudyprograms.Facultiesand art academiesconduct legal affairsunderthename of theuniversitythattheybelong to, andundertheirownname, in accordancewiththe statute of theuniversity. academicstudy programms vocational study programms study programms in: Natural sciences and mathematics, Social and humanistic studies, Medical science, Technical and technological science, Arts Institutional Key Performance Indicators

9. Composite or Aggregated Performance Indicators PESHES team propose composite quantitative performance measures in which a number of different numerical indicators are combined into a single group. Not too many indicators, only few (voice from the EUA at the University of Belgrade 210 Anniversary) clear and selected aims and objectives are necessary

10. KPIsCurrent and future challenges Legal framework -KPIs Specific KPIs : arts and humanities Data form sources in public domain Specific KPIs : Natural sciences and mathematics, Medical science, Technical and technological science, The number of Spin-off companies Exploitation of IP Genaration of database QUESTIONNAIRE Specific KPIs : Vocational HE Informations Internal External