WHY THE RANKINGS ARE WRONG: LESSONS FROM DATA UNDERLYING U.K. UNIVERSITY LEAGUE TABLES.

Saved in:
Bibliographic Details
Title: WHY THE RANKINGS ARE WRONG: LESSONS FROM DATA UNDERLYING U.K. UNIVERSITY LEAGUE TABLES.
Authors: GRAYSON, J. PAUL1, GRAYSON, KYLE2
Source: Canadian Journal of Higher Education. 2026, Vol. 56 Issue 1, p35-54. 20p.
Subject Terms: *Learning, Robust statistics, Skepticism
Geographic Terms: United Kingdom, Canada
Abstract (English): This article uses high-quality data from the United Kingdom to critically examine the assumptions underpinning university league tables in Canada and elsewhere. Particular attention is given to research quality and value added in learning (VA). Unlike many global ranking systems, U.K. rankings incorporate measures that allow for robust assessment. Based on these data, we show that league table positions in the United Kingdom are weakly associated with research quality and largely unrelated to VA. Furthermore, research funding bears little consistent relationship to research quality. At both institutional and departmental levels, notably in Politics and International Studies, highly ranked universities do not necessarily deliver superior learning outcomes or research quality. These findings challenge the validity of using inputs such as research grants or student awards as proxies for institutional quality. Although U.K. data cannot be generalized automatically, they provide a valuable reference point for other countries. As a result of these findings, we argue that Canadian rankings, and others like them, must be treated with considerable skepticism. [ABSTRACT FROM AUTHOR]
Abstract (French): Le présent article utilise des données britanniques de grande qualité pour examiner de manière critique les présupposés qui sous-tendent les classements universitaires au Canada et ailleurs dans le monde. Une attention particulière est accordée à la qualité de la recherche et à la valeur ajoutée dans l'apprentissage. Contrairement à de nombreux systèmes de classement mondiaux, les classements britanniques intègrent des indicateurs qui permettent une évaluation robuste. Sur la base de ces données, nous montrons que les positions dans les classements au Royaume-Uni sont faiblement associées à la qualité de la recherche et n'ont pratiquement aucun lien avec la valeur ajoutée. De plus, le rapport entre le financement de la recherche et la qualité de la recherche est peu constant. Aux niveaux institutionnel et départemental, notamment en sciences politiques et études internationales, les universités les mieux classées ne sont pas nécessairement supérieures en matière de résultats d'apprentissage ou de qualité de la recherche. Ces résultats remettent en question la validité de l'utilisation de données telles que les subventions de recherche ou les bourses d'études comme indicateurs de la qualité institutionnelle. Bien que les données du Royaume-Uni ne puissent pas être généralisées automatiquement, elles constituent un point de repère précieux pour les autres pays. En conséquence, nous soutenons que les classements canadiens, et d'autres classements semblables, doivent être considérés avec beaucoup de scepticisme. [ABSTRACT FROM AUTHOR]
Copyright of Canadian Journal of Higher Education is the property of Canadian Society for the Study of Higher Education and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Education Research Complete
Description
Abstract:This article uses high-quality data from the United Kingdom to critically examine the assumptions underpinning university league tables in Canada and elsewhere. Particular attention is given to research quality and value added in learning (VA). Unlike many global ranking systems, U.K. rankings incorporate measures that allow for robust assessment. Based on these data, we show that league table positions in the United Kingdom are weakly associated with research quality and largely unrelated to VA. Furthermore, research funding bears little consistent relationship to research quality. At both institutional and departmental levels, notably in Politics and International Studies, highly ranked universities do not necessarily deliver superior learning outcomes or research quality. These findings challenge the validity of using inputs such as research grants or student awards as proxies for institutional quality. Although U.K. data cannot be generalized automatically, they provide a valuable reference point for other countries. As a result of these findings, we argue that Canadian rankings, and others like them, must be treated with considerable skepticism. [ABSTRACT FROM AUTHOR]
ISSN:03161218