View in EDS PDF Full Text

Indicators as Judgment Devices: An Empirical Study of Citizen Bibliometrics in Research Evaluation

Saved in:
Bibliographic Details
Title: Indicators as Judgment Devices: An Empirical Study of Citizen Bibliometrics in Research Evaluation
Language: English
Authors: Hammarfelt, Björn, Rushforth, Alexander D.
Source: Research Evaluation. Jul 2017 26(3):169-180.
Availability: Oxford University Press. Great Clarendon Street, Oxford, OX2 6DP, UK. Tel: +44-1865-353907; Fax: +44-1865-353485; e-mail: jnls.cust.serv@oxfordjournals.org; Web site: http://applij.oxfordjournals.org/
Peer Reviewed: Y
Page Count: 12
Publication Date: 2017
Document Type: Journal Articles
Reports - Research
Education Level: Higher Education
Descriptors: Bibliometrics, Economics Education, Teacher Evaluation, Teacher Selection, Selection Criteria, Faculty Publishing, Productivity, College Faculty, Educational Indicators, Benchmarking, Research Utilization, Educational Quality, Foreign Countries
Geographic Terms: Sweden
DOI: 10.1093/reseval/rvx018
ISSN: 0958-2029
Abstract: A researcher's number of publications has been a fundamental merit in the competition for academic positions since the late 18th century. Today, the simple counting of publications has been supplemented with a whole range of bibliometric indicators, which supposedly not only measures the volume of research but also its impact. In this study, we investigate how bibliometrics are used for evaluating the impact and quality of publications in two specific settings: biomedicine and economics. Our study exposes the various metrics used in external evaluations of candidates for academic positions at Swedish universities. Moreover, we show how different bibliometric indicators, both explicitly and implicitly, are employed to assess and rank candidates. Our findings contribute to a further understanding of bibliometric indicators as "judgment devices" that are employed in evaluating individuals and their published works within specific fields. We also show how "expertise" in using bibliometrics for evaluative purposes is negotiated at the interface between domain knowledge and skills in using indicators. In line with these results, we propose that the use of metrics we report is best described as a form of "citizen bibliometrics"--an underspecified term which we build upon in the article.
Abstractor: As Provided
Entry Date: 2017
Accession Number: EJ1163421
Database: ERIC
FullText Links:
  – Type: pdflink
    Url: https://content.ebscohost.com/cds/retrieve?content=AQICAHj0k_4E0hTGH8RJwT4gCJyBsGNe_WN95AvKlDbXJGqwxwEePD2rdXhyvUIBOq6ZESpcAAAA4zCB4AYJKoZIhvcNAQcGoIHSMIHPAgEAMIHJBgkqhkiG9w0BBwEwHgYJYIZIAWUDBAEuMBEEDK-vK9Y8XXjtGdTsrQIBEICBm-_vAqq1W0NGMtgXIHH9pit0P69TGiNTsfpc3OyZTTGvw3zsTODnUFYtXeZ68Eq0GrthOOtAIp-VUwBJ5TfP4iEs4AHcJGXbT2C68FEvbFmekhDkIb9MU5_1Yf0_WRVUUidyf12mPuVunDV4HuHtXWFI5jX612aKONeEKReOnR3TZAeBK31366zC5Sni0vEEP8h92Zz0paf-mUkQ
Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: EJ1163421
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Indicators as Judgment Devices: An Empirical Study of Citizen Bibliometrics in Research Evaluation
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Hammarfelt%2C+Björn%22">Hammarfelt, Björn</searchLink><br /><searchLink fieldCode="AR" term="%22Rushforth%2C+Alexander+D%2E%22">Rushforth, Alexander D.</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Research+Evaluation%22"><i>Research Evaluation</i></searchLink>. Jul 2017 26(3):169-180.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Oxford University Press. Great Clarendon Street, Oxford, OX2 6DP, UK. Tel: +44-1865-353907; Fax: +44-1865-353485; e-mail: jnls.cust.serv@oxfordjournals.org; Web site: http://applij.oxfordjournals.org/
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 12
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2017
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Bibliometrics%22">Bibliometrics</searchLink><br /><searchLink fieldCode="DE" term="%22Economics+Education%22">Economics Education</searchLink><br /><searchLink fieldCode="DE" term="%22Teacher+Evaluation%22">Teacher Evaluation</searchLink><br /><searchLink fieldCode="DE" term="%22Teacher+Selection%22">Teacher Selection</searchLink><br /><searchLink fieldCode="DE" term="%22Selection+Criteria%22">Selection Criteria</searchLink><br /><searchLink fieldCode="DE" term="%22Faculty+Publishing%22">Faculty Publishing</searchLink><br /><searchLink fieldCode="DE" term="%22Productivity%22">Productivity</searchLink><br /><searchLink fieldCode="DE" term="%22College+Faculty%22">College Faculty</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+Indicators%22">Educational Indicators</searchLink><br /><searchLink fieldCode="DE" term="%22Benchmarking%22">Benchmarking</searchLink><br /><searchLink fieldCode="DE" term="%22Research+Utilization%22">Research Utilization</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+Quality%22">Educational Quality</searchLink><br /><searchLink fieldCode="DE" term="%22Foreign+Countries%22">Foreign Countries</searchLink>
– Name: Subject
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Sweden%22">Sweden</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1093/reseval/rvx018
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 0958-2029
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: A researcher's number of publications has been a fundamental merit in the competition for academic positions since the late 18th century. Today, the simple counting of publications has been supplemented with a whole range of bibliometric indicators, which supposedly not only measures the volume of research but also its impact. In this study, we investigate how bibliometrics are used for evaluating the impact and quality of publications in two specific settings: biomedicine and economics. Our study exposes the various metrics used in external evaluations of candidates for academic positions at Swedish universities. Moreover, we show how different bibliometric indicators, both explicitly and implicitly, are employed to assess and rank candidates. Our findings contribute to a further understanding of bibliometric indicators as "judgment devices" that are employed in evaluating individuals and their published works within specific fields. We also show how "expertise" in using bibliometrics for evaluative purposes is negotiated at the interface between domain knowledge and skills in using indicators. In line with these results, we propose that the use of metrics we report is best described as a form of "citizen bibliometrics"--an underspecified term which we build upon in the article.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2017
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1163421
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1163421
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1093/reseval/rvx018
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 12
        StartPage: 169
    Subjects:
      – SubjectFull: Bibliometrics
        Type: general
      – SubjectFull: Economics Education
        Type: general
      – SubjectFull: Teacher Evaluation
        Type: general
      – SubjectFull: Teacher Selection
        Type: general
      – SubjectFull: Selection Criteria
        Type: general
      – SubjectFull: Faculty Publishing
        Type: general
      – SubjectFull: Productivity
        Type: general
      – SubjectFull: College Faculty
        Type: general
      – SubjectFull: Educational Indicators
        Type: general
      – SubjectFull: Benchmarking
        Type: general
      – SubjectFull: Research Utilization
        Type: general
      – SubjectFull: Educational Quality
        Type: general
      – SubjectFull: Foreign Countries
        Type: general
      – SubjectFull: Sweden
        Type: general
    Titles:
      – TitleFull: Indicators as Judgment Devices: An Empirical Study of Citizen Bibliometrics in Research Evaluation
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Hammarfelt, Björn
      – PersonEntity:
          Name:
            NameFull: Rushforth, Alexander D.
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 07
              Type: published
              Y: 2017
          Identifiers:
            – Type: issn-print
              Value: 0958-2029
          Numbering:
            – Type: volume
              Value: 26
            – Type: issue
              Value: 3
          Titles:
            – TitleFull: Research Evaluation
              Type: main
ResultId 1