View in EDS HTML Full Text PDF Full Text

Rater Connectedness Affects Student Achievement Estimates and Ordered Rankings in Formal Music Performance Assessments.

Saved in:
Bibliographic Details
Title: Rater Connectedness Affects Student Achievement Estimates and Ordered Rankings in Formal Music Performance Assessments.
Authors: Wind, Stefanie A. (AUTHOR), Wesolowski, Brian C. (AUTHOR), Jones, Eli (AUTHOR)
Source: Journal of Research in Music Education. Apr2026, Vol. 74 Issue 1, p110-131. 22p.
Subjects: Musical performance, Ranking (Statistics), Inter-observer reliability, Academic achievement
Abstract: A persistent concern in music performance assessments is the quality of ratings assigned by judges. Differences in rater judgment are most concerning in cases when student performances are scored by different raters (i.e., disconnected rating designs)—bringing into question the comparability of scores between raters and students. We used data from a formal solo music performance assessment to demonstrate and explore the impact of different data collection designs and a statistical adjustment procedure on the estimates and rank-ordering of student performances. Our results indicated notable discrepancies in conclusions about individual student performances between conditions where all raters scored all students, designs with no common performances between raters, designs that included overlapping performances between raters, and the results from a post hoc adjustment procedure for disconnected designs. We discuss the implications of our results for the design and interpretation of music performance assessments. [ABSTRACT FROM AUTHOR]
Copyright of Journal of Research in Music Education is the property of Sage Publications Inc. and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Psychology and Behavioral Sciences Collection
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
Text:
  Availability: 1
Header DbId: pbh
DbLabel: Psychology and Behavioral Sciences Collection
An: 192008311
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Rater Connectedness Affects Student Achievement Estimates and Ordered Rankings in Formal Music Performance Assessments.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Wind%2C+Stefanie+A%2E%22">Wind, Stefanie A.</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Wesolowski%2C+Brian+C%2E%22">Wesolowski, Brian C.</searchLink> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Jones%2C+Eli%22">Jones, Eli</searchLink> (AUTHOR)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Journal+of+Research+in+Music+Education%22">Journal of Research in Music Education</searchLink>. Apr2026, Vol. 74 Issue 1, p110-131. 22p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Musical+performance%22">Musical performance</searchLink><br /><searchLink fieldCode="DE" term="%22Ranking+%28Statistics%29%22">Ranking (Statistics)</searchLink><br /><searchLink fieldCode="DE" term="%22Inter-observer+reliability%22">Inter-observer reliability</searchLink><br /><searchLink fieldCode="DE" term="%22Academic+achievement%22">Academic achievement</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: A persistent concern in music performance assessments is the quality of ratings assigned by judges. Differences in rater judgment are most concerning in cases when student performances are scored by different raters (i.e., disconnected rating designs)—bringing into question the comparability of scores between raters and students. We used data from a formal solo music performance assessment to demonstrate and explore the impact of different data collection designs and a statistical adjustment procedure on the estimates and rank-ordering of student performances. Our results indicated notable discrepancies in conclusions about individual student performances between conditions where all raters scored all students, designs with no common performances between raters, designs that included overlapping performances between raters, and the results from a post hoc adjustment procedure for disconnected designs. We discuss the implications of our results for the design and interpretation of music performance assessments. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Journal of Research in Music Education is the property of Sage Publications Inc. and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=pbh&AN=192008311
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1177/00224294251363327
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 22
        StartPage: 110
    Subjects:
      – SubjectFull: Musical performance
        Type: general
      – SubjectFull: Ranking (Statistics)
        Type: general
      – SubjectFull: Inter-observer reliability
        Type: general
      – SubjectFull: Academic achievement
        Type: general
    Titles:
      – TitleFull: Rater Connectedness Affects Student Achievement Estimates and Ordered Rankings in Formal Music Performance Assessments.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Wind, Stefanie A.
      – PersonEntity:
          Name:
            NameFull: Wesolowski, Brian C.
      – PersonEntity:
          Name:
            NameFull: Jones, Eli
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 04
              Text: Apr2026
              Type: published
              Y: 2026
          Identifiers:
            – Type: issn-print
              Value: 00224294
          Numbering:
            – Type: volume
              Value: 74
            – Type: issue
              Value: 1
          Titles:
            – TitleFull: Journal of Research in Music Education
              Type: main
ResultId 1