Computation and Accuracy Evaluation of Comparable Scores on Culturally Responsive Assessments.

Saved in:
Bibliographic Details
Title: Computation and Accuracy Evaluation of Comparable Scores on Culturally Responsive Assessments.
Authors: Sinharay, Sandip1 (AUTHOR) ssinharay@ets.org, Johnson, Matthew S.1 (AUTHOR)
Source: Journal of Educational Measurement. Mar2024, Vol. 61 Issue 1, p5-46. 42p.
Subject Terms: *Computer adaptive testing, Rasch models, Multidimensional databases, Data modeling, Fairness
Abstract: Culturally responsive assessments have been proposed as potential tools to ensure equity and fairness for examinees from all backgrounds including those from traditionally underserved or minoritized groups. However, these assessments are relatively new and, with few exceptions, are yet to be implemented in large scale. Consequently, there is a lack of guidance on how one can compute comparable scores on various versions of these assessments. In this paper, the multigroup multidimensional Rasch model is repurposed for modeling data originating from various versions of a culturally responsive assessment and for analyzing such data to compute comparable scores. Two simulation studies are performed to evaluate the performance of the model for data simulated from hypothetical culturally responsive assessments and to find the conditions under which the computed scores are accurate. Recommendations are made for measurement practitioners interested in culturally responsive assessments. [ABSTRACT FROM AUTHOR]
Copyright of Journal of Educational Measurement is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Education Research Complete
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
Text:
  Availability: 1
Header DbId: ehh
DbLabel: Education Research Complete
An: 175800281
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Computation and Accuracy Evaluation of Comparable Scores on Culturally Responsive Assessments.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Sinharay%2C+Sandip%22">Sinharay, Sandip</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> ssinharay@ets.org</i><br /><searchLink fieldCode="AR" term="%22Johnson%2C+Matthew+S%2E%22">Johnson, Matthew S.</searchLink><relatesTo>1</relatesTo> (AUTHOR)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Journal+of+Educational+Measurement%22">Journal of Educational Measurement</searchLink>. Mar2024, Vol. 61 Issue 1, p5-46. 42p.
– Name: Subject
  Label: Subject Terms
  Group: Su
  Data: *<searchLink fieldCode="DE" term="%22Computer+adaptive+testing%22">Computer adaptive testing</searchLink><br /><searchLink fieldCode="DE" term="%22Rasch+models%22">Rasch models</searchLink><br /><searchLink fieldCode="DE" term="%22Multidimensional+databases%22">Multidimensional databases</searchLink><br /><searchLink fieldCode="DE" term="%22Data+modeling%22">Data modeling</searchLink><br /><searchLink fieldCode="DE" term="%22Fairness%22">Fairness</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Culturally responsive assessments have been proposed as potential tools to ensure equity and fairness for examinees from all backgrounds including those from traditionally underserved or minoritized groups. However, these assessments are relatively new and, with few exceptions, are yet to be implemented in large scale. Consequently, there is a lack of guidance on how one can compute comparable scores on various versions of these assessments. In this paper, the multigroup multidimensional Rasch model is repurposed for modeling data originating from various versions of a culturally responsive assessment and for analyzing such data to compute comparable scores. Two simulation studies are performed to evaluate the performance of the model for data simulated from hypothetical culturally responsive assessments and to find the conditions under which the computed scores are accurate. Recommendations are made for measurement practitioners interested in culturally responsive assessments. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Journal of Educational Measurement is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=ehh&AN=175800281
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1111/jedm.12381
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 42
        StartPage: 5
    Subjects:
      – SubjectFull: Computer adaptive testing
        Type: general
      – SubjectFull: Rasch models
        Type: general
      – SubjectFull: Multidimensional databases
        Type: general
      – SubjectFull: Data modeling
        Type: general
      – SubjectFull: Fairness
        Type: general
    Titles:
      – TitleFull: Computation and Accuracy Evaluation of Comparable Scores on Culturally Responsive Assessments.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Sinharay, Sandip
      – PersonEntity:
          Name:
            NameFull: Johnson, Matthew S.
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 03
              Text: Mar2024
              Type: published
              Y: 2024
          Identifiers:
            – Type: issn-print
              Value: 00220655
          Numbering:
            – Type: volume
              Value: 61
            – Type: issue
              Value: 1
          Titles:
            – TitleFull: Journal of Educational Measurement
              Type: main
ResultId 1