British education research and its quality: An analysis of Research Excellence Framework submissions.
Saved in:
| Title: | British education research and its quality: An analysis of Research Excellence Framework submissions. |
|---|---|
| Authors: | Inglis, Matthew, Foster, Colin, Lortie‐Forgues, Hugues, Stokoe, Elizabeth |
| Source: | British Educational Research Journal. Oct2024, Vol. 50 Issue 5, p2495-2518. 24p. |
| Subjects: | British education system, Dirichlet principle, Calculus of variations, Higher education, Continuing education |
| Abstract: | We analysed the full text of all journal articles returned to the education subpanel of the 2021 Research Excellence Framework (REF2021). Using a latent Dirichlet allocation topic model, we identified 35 topics that collectively summarise the journal articles that research units, typically schools of education, selected for submission. We found that the topics which units wrote about in their submitted articles collectively explained a large proportion (84.1%) of the variance in the quality assessments they received from the REF's expert peer review process. Further, with the important caveat that we cannot attribute causality, we found that there were strong associations between what the subpanel perceived to be excellent research and the adoption of particular methods or approaches. Most notably, units that returned more interview‐based work typically received lower scores, and those which returned more analyses of large‐scale data and meta‐analyses typically received higher scores. Finally, we applied our 2021 model to articles submitted to the previous exercise, REF2014. We found that education research seems to have become less qualitative and more quantitative over time, and that our 2021 model could successfully predict the scores assigned by the REF2014 subpanel, suggesting a reasonable degree of between‐exercise consistency. [ABSTRACT FROM AUTHOR] |
| Copyright of British Educational Research Journal is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Psychology and Behavioral Sciences Collection |
|
Full text is not displayed to guests.
Login for full access.
|
|
| FullText | Links: – Type: pdflink Text: Availability: 1 |
|---|---|
| Header | DbId: pbh DbLabel: Psychology and Behavioral Sciences Collection An: 180149889 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: British education research and its quality: An analysis of Research Excellence Framework submissions. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Inglis%2C+Matthew%22">Inglis, Matthew</searchLink><br /><searchLink fieldCode="AR" term="%22Foster%2C+Colin%22">Foster, Colin</searchLink><br /><searchLink fieldCode="AR" term="%22Lortie‐Forgues%2C+Hugues%22">Lortie‐Forgues, Hugues</searchLink><br /><searchLink fieldCode="AR" term="%22Stokoe%2C+Elizabeth%22">Stokoe, Elizabeth</searchLink> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22British+Educational+Research+Journal%22">British Educational Research Journal</searchLink>. Oct2024, Vol. 50 Issue 5, p2495-2518. 24p. – Name: Subject Label: Subjects Group: Su Data: <searchLink fieldCode="DE" term="%22British+education+system%22">British education system</searchLink><br /><searchLink fieldCode="DE" term="%22Dirichlet+principle%22">Dirichlet principle</searchLink><br /><searchLink fieldCode="DE" term="%22Calculus+of+variations%22">Calculus of variations</searchLink><br /><searchLink fieldCode="DE" term="%22Higher+education%22">Higher education</searchLink><br /><searchLink fieldCode="DE" term="%22Continuing+education%22">Continuing education</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: We analysed the full text of all journal articles returned to the education subpanel of the 2021 Research Excellence Framework (REF2021). Using a latent Dirichlet allocation topic model, we identified 35 topics that collectively summarise the journal articles that research units, typically schools of education, selected for submission. We found that the topics which units wrote about in their submitted articles collectively explained a large proportion (84.1%) of the variance in the quality assessments they received from the REF's expert peer review process. Further, with the important caveat that we cannot attribute causality, we found that there were strong associations between what the subpanel perceived to be excellent research and the adoption of particular methods or approaches. Most notably, units that returned more interview‐based work typically received lower scores, and those which returned more analyses of large‐scale data and meta‐analyses typically received higher scores. Finally, we applied our 2021 model to articles submitted to the previous exercise, REF2014. We found that education research seems to have become less qualitative and more quantitative over time, and that our 2021 model could successfully predict the scores assigned by the REF2014 subpanel, suggesting a reasonable degree of between‐exercise consistency. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of British Educational Research Journal is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=pbh&AN=180149889 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1002/berj.4040 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 24 StartPage: 2495 Subjects: – SubjectFull: British education system Type: general – SubjectFull: Dirichlet principle Type: general – SubjectFull: Calculus of variations Type: general – SubjectFull: Higher education Type: general – SubjectFull: Continuing education Type: general Titles: – TitleFull: British education research and its quality: An analysis of Research Excellence Framework submissions. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Inglis, Matthew – PersonEntity: Name: NameFull: Foster, Colin – PersonEntity: Name: NameFull: Lortie‐Forgues, Hugues – PersonEntity: Name: NameFull: Stokoe, Elizabeth IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 10 Text: Oct2024 Type: published Y: 2024 Identifiers: – Type: issn-print Value: 01411926 Numbering: – Type: volume Value: 50 – Type: issue Value: 5 Titles: – TitleFull: British Educational Research Journal Type: main |
| ResultId | 1 |