330 likes | 483 Views
Recent developments in rankings: implications for developing countries?. Jamil Salmi The World Bank IREG-3 Shanghai, 29-30 October 2007. The rankings business. A ranking of league tables September 10, 2005. Gordon’s Brown’s disastrous retreat How do super-jumbo changes air travel
E N D
Recent developments in rankings: implications for developing countries? Jamil Salmi The World Bank IREG-3 Shanghai, 29-30 October 2007
The rankings business A ranking of league tables September 10, 2005
Gordon’s Brown’s disastrous retreat How do super-jumbo changes air travel Meet Fred Thompson Has commercial property peaked? Liu Nian Cai , the man and the myth Rankers, Beware League tables under scrutiny
outline of the presentation • status of rankings • new directions in accountability • prospects for ranking
who prepares the rankings? • A = government agency (Ministry of Higher Education, Higher Education Commission, University Grants Council, etc.) • B = independent organization / professional association / university • C = newspaper / magazine / media • D = accreditation agency • I = International ranking (IA, IB, IC and ID linking the international dimension to the type of institution conducting the ranking)
trends • more rankings • except Africa and Middle East • who does the rankings? • less from the press • more from independent think tanks or governments • accepted in growing number of countries • voluntary participation • Austrians, Swiss, Flemish
outline of the presentation • status of rankings • new directions in accountability
what does accountability mean? • information • achievement of results • sanctions
trends in accountability • multiple stakeholders • multiple themes • multiple instruments
multiple stakeholders • government(s) • employers • society at large • professors • students
multiple themes • access • equity • quality • relevance • efficiency • sustainability • nation-building / values
multiple instruments • licensing • evaluation / accreditation • performance-based funding • rankings • assessment of learning outcomes
measurement of outcomes • From inputs to competencies • Bologna process • ABET • Spellings Commission • ”no graduates left behind” • OECD / PISA for tertiary education • World Bank benchmarking tool
country experiences • Australia • Brazil • Canada • Colombia • Jordan • Korea • Mexico • UK • USA
outline of the presentation • status of rankings • new directions in accountability • prospects for ranking
usefulness of rankings? • for the public? • for the institutions? • for the Government?
usefulness of rankings: for individuals • choice based on information
usefulness of rankings: for institutions • benchmarking and self-evaluation • counter-rankings (Paris) • voluntary accountability framework (USA)
from the viewpoint of institutions • sensitive to factors that affect their rankings (benchmarking) • goal setting for strategic planning purposes • forming strategic partnerships • mergers
usefulness of rankings: for governments • rapid QA assessment in lieu of accreditation • international benchmarking • national benchmarking • culture of competition
government use of rankings • Pakistan case • promoting a culture of accurate and transparent information • promoting a culture of quality
new challenges • multiplicity of institutions (and joint programs) • multiplicity of missions • blurring of boundaries between disciplines • emerging disciplines • new delivery modes
For sale:charming and peaceful residence away from neighbors, with a wonderful view of the sea, a grand period staircase, and lots and lots of light…”
For sale: charming and peaceful residence away from neighbors, with a wonderful view of the sea, a grand period staircase, and lots and lots of light…”
divisive or helpful? • rankings are here to stay • useful for prospective students • useful in the absence of an established evaluation and/or accreditation system • useful for benchmarking, goal-setting and self-improvement purposes • useful to conduct a healthy debate on issues and challenges • useful to promote a culture of accountability
linking rankings and funding? • Arizona State • RAE (UK, Hong Kong, NZ, Australia) • Nigeria (based on ranking done by Accreditation Commission) • performance premium for academics publishing in journals included in Shanghai ranking (Norway, Australia) • donors and home ministries making scholarship decisions • corporate donors • strengthening the strong and weakening the weak
principles of appropriate ranking instruments • compare similar institutions • focus on program rather than on entire institution • rank by indicator rather than wholesale • outcomes/outputs/results rather than inputs • better if used for self-improvement purposes • make results publicly available