View in EDS

Advancing open science through research assessment reform? Content analysis of CoARA action plans.

Saved in:
Bibliographic Details
Title: Advancing open science through research assessment reform? Content analysis of CoARA action plans.
Authors: Rushforth, Alexander1 (AUTHOR) a.d.rushforth@cwts.leidenuniv.nl, Gogadze, Nino1 (AUTHOR), Skhirtladze, Tornike2 (AUTHOR), Pölönen, Janne3 (AUTHOR)
Source: Scientometrics. Jun2026, Vol. 131 Issue 6, p3897-3918. 22p.
Subjects: Open access publishing, Content analysis, Open scholarship
Abstract: Research assessment reform and open science are frequently presented as aligned reform movements within science, with assessment reform expected to incentivize open science practices. However, empirical evidence of this integration remains limited. We conducted a quantitative content analysis of open science terminology in action plans from Coalition for Advancing Research Assessment (CoARA) signatories—institutions publicly committed to reforming research assessment. Analysing 248 publicly available action plans, we coded mentions of open science terms across values, umbrella, and operational categories. Results reveal skewed distributions of open science terms: most terms appear in fewer than 20% of documents. Values terms substantially outnumber operational terms in top mentions, suggesting organizations currently emphasize aspirational principles over concrete practices. Open Access emerges as the by far the most widely mentioned operational practice, while key activities emphasized in policy frameworks (Open Evaluation, Open Methods, Open Software) receive minimal attention. Overall, our findings suggest open science integration into assessment reform remains in early developmental stages, characterized by values-heavy discourse, and gaps between policy aspirations and organizational commitments. Beyond substantive findings, this study demonstrates how terminological analysis can track science reform movement development and provide data for longitudinal monitoring of open science and its convergence with reforms of research assessment. [ABSTRACT FROM AUTHOR]
Copyright of Scientometrics is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
FullText Text:
  Availability: 0
Header DbId: egs
DbLabel: Engineering Source
An: 194995925
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Advancing open science through research assessment reform? Content analysis of CoARA action plans.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Rushforth%2C+Alexander%22">Rushforth, Alexander</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> a.d.rushforth@cwts.leidenuniv.nl</i><br /><searchLink fieldCode="AR" term="%22Gogadze%2C+Nino%22">Gogadze, Nino</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Skhirtladze%2C+Tornike%22">Skhirtladze, Tornike</searchLink><relatesTo>2</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Pölönen%2C+Janne%22">Pölönen, Janne</searchLink><relatesTo>3</relatesTo> (AUTHOR)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Scientometrics%22">Scientometrics</searchLink>. Jun2026, Vol. 131 Issue 6, p3897-3918. 22p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Open+access+publishing%22">Open access publishing</searchLink><br /><searchLink fieldCode="DE" term="%22Content+analysis%22">Content analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Open+scholarship%22">Open scholarship</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Research assessment reform and open science are frequently presented as aligned reform movements within science, with assessment reform expected to incentivize open science practices. However, empirical evidence of this integration remains limited. We conducted a quantitative content analysis of open science terminology in action plans from Coalition for Advancing Research Assessment (CoARA) signatories—institutions publicly committed to reforming research assessment. Analysing 248 publicly available action plans, we coded mentions of open science terms across values, umbrella, and operational categories. Results reveal skewed distributions of open science terms: most terms appear in fewer than 20% of documents. Values terms substantially outnumber operational terms in top mentions, suggesting organizations currently emphasize aspirational principles over concrete practices. Open Access emerges as the by far the most widely mentioned operational practice, while key activities emphasized in policy frameworks (Open Evaluation, Open Methods, Open Software) receive minimal attention. Overall, our findings suggest open science integration into assessment reform remains in early developmental stages, characterized by values-heavy discourse, and gaps between policy aspirations and organizational commitments. Beyond substantive findings, this study demonstrates how terminological analysis can track science reform movement development and provide data for longitudinal monitoring of open science and its convergence with reforms of research assessment. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Scientometrics is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=194995925
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1007/s11192-026-05650-w
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 22
        StartPage: 3897
    Subjects:
      – SubjectFull: Open access publishing
        Type: general
      – SubjectFull: Content analysis
        Type: general
      – SubjectFull: Open scholarship
        Type: general
    Titles:
      – TitleFull: Advancing open science through research assessment reform? Content analysis of CoARA action plans.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Rushforth, Alexander
      – PersonEntity:
          Name:
            NameFull: Gogadze, Nino
      – PersonEntity:
          Name:
            NameFull: Skhirtladze, Tornike
      – PersonEntity:
          Name:
            NameFull: Pölönen, Janne
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 06
              Text: Jun2026
              Type: published
              Y: 2026
          Identifiers:
            – Type: issn-print
              Value: 01389130
          Numbering:
            – Type: volume
              Value: 131
            – Type: issue
              Value: 6
          Titles:
            – TitleFull: Scientometrics
              Type: main
ResultId 1